Understanding Agents, Storage, and Accessor in CloudSoda

Introduction

CloudSoda is a modern data management platform that provides analytics and mobility solutions for unstructured data across storage environments. A key part of its architecture involves Agents, Storage, Attachments, and Controllers, which work together to enable data movement and insights. This document explains their differences and interactions.

1. What is a Storage?

Storage refers to any data repository configured within CloudSoda. This can be an on-premises storage system, a cloud storage service, or a hybrid environment. CloudSoda supports various storage types, including:

• File-based storage (e.g., NFS, SMB)

• Object storage (e.g., AWS S3, Azure Blob, Google Cloud Storage)

• Custom S3-compatible storage

Key Functions of Storage:

• Stores unstructured data such as files, media, or documents.

• Can be configured as a source or destination for data transfers.

• Can have policies for tiering, retention, or data governance.

• Works with CloudSoda’s analytics module to provide insights on data usage, costs, and redundancy.

2. What is an Agent?

Agents are software components deployed to facilitate communication between CloudSoda and external storage systems. They enable CloudSoda to read, move, and manage data across different storage types.

Types of Agents:

1. External Agent – Installed on remote systems to enable secure data transfers across storage environments.

Key Functions of Agents:

• Facilitate data movement between different storages.

• Perform scanning and indexing to collect metadata from storage.

• Ensure efficient and secure transfer of files between environments.

• Communicate with the CloudSoda Controller over designated ports (e.g., UDP 7498 and 7499).

3. What is an Accessor?

Attachments in CloudSoda refer to the association between an Agent and a Storage system via an Accessor.

How Attachments Work:

• Agents attach to Storage via an Accessor, which acts as a connection method.

• Accessors define the protocol and authentication settings needed to connect.

• An Agent can have multiple storage attachments, enabling it to handle data from different sources and move it between locations.

Example of an Attachment Workflow:

1. Storage is created (e.g., an AWS S3 bucket or an on-prem SMB share).

2. Agent is installed on a server with access to the storage.

3. Accessor is configured to define how the Agent connects to Storage.

4. Attachment is created by linking the Agent to the Storage through the Accessor.

4. What is the CloudSoda Controller?

The CloudSoda Controller is the central component that orchestrates all interactions between Agents, Storage, and Attachments. It acts as the control plane for:

• Managing and monitoring Agents – Ensuring Agents are online, configured, and functioning correctly.

• Coordinating Data Transfers – Directing Agents to perform scans, indexing, and data movement operations.

• Handling Storage Insights – Aggregating metadata and analytics to provide a unified view of all storage resources.

• Enforcing Policies and Security – Managing access control, authentication, and role-based permissions across storage environments.

5. Interaction Between Controllers, Agents, Storage, and Attachments

CloudSoda’s data management process relies on these four components working together:

1. Storage holds the data that needs to be analyzed or transferred.

2. Agents act as intermediaries to read, index, and move data.

3. Attachments establish the connection between Agents and Storage.

4. The Controller orchestrates and manages all operations, providing a single interface for policy enforcement and monitoring.

Practical Use Cases:

• Data Migration – Moving files from an on-premises NAS to cloud storage.

• Storage Insights – Analyzing storage usage across multiple locations.

• Policy-based Archiving – Automatically moving older files to lower-cost storage tiers.

Conclusion

Understanding the roles of Controllers, Agents, Storage, and Attachments is essential for efficiently using CloudSoda’s data management capabilities. By correctly configuring these components, users can optimize data transfers, gain better insights, and enhance storage efficiency across their enterprise environments.