October 2024 – CloudSoda

Data Orchestration

An additional confirmation step has been added when deleting a role, scope, or account to prevent accidental deletion.
CloudSoda now display negative changes when the platform deletes files/folders during a transfer. The job summary will show the number of deleted files, total size removed, and cost changes from a transfer.
This release also includes performance improvements and fixes to the platform.

Storage Cost Analysis: View detailed cost breakdowns for projects or storage, highlighting the percentage of cold and duplicate data.
Potential Savings: Calculate and visualize potential savings when data is deleted or moved to lower-cost storage tiers.

Enhanced SMB Mounting on Windows: SMB shares can now be mounted via UNC paths without specifying a drive letter.
Detailed Logging: Improved granularity in SMB and NFS mount error logs.
Extended Mount Options: Support for additional mount options and domain configurations for SMB and NFS mounts.
Configurable Scan Types: Tailor scanning strategies per on-premises storage type:
- Volume Multithread (default): Optimized for simultaneous scanning across multiple storages.
- Folder Multithread: Ideal for single storage, scanning each folder with an individual thread.
- Hybrid Multithread: For deep folder structures with extensive file counts (5+ million per folder).
Selective Folder Indexing: Configure folders to index only folder metadata, improving performance for directories with large file volumes.
Automatic Share Unmounting: NFS and SMB shares unmount automatically on agent startup, preventing conflicts if interrupted during a scan.
Advanced First-Scan Configuration: New option adjusts first daily scan behavior, influencing tagging of deleted and duplicate files (for advanced debugging and specific scenarios).

New Reporting Section: Execute reports to flag and analyze files/folders based on custom rules:
- Duplicate Report: Identify files/folders duplicated across storages, folders, or projects.
- Unique Report: Identify unique files/folders within a reference list without copies elsewhere.
- Search Query Report: Flag files/folders based on advanced search queries (supports complex AND/OR logic).

Seamless PowerScale Scanning: Directly integrate with Dell PowerScale for file/folder indexing without SMB/NFS mounts, using PowerScale API credentials and HTTPS.
Snapshot-Based Delta Scanning: Leverage PowerScale Snapshots to track and index changes, greatly optimizing scan performance for storages with over 100 million files.

Single Sign-On: Enable Okta-based SSO for streamlined user, role, and group management within the platform.
Setup: Configure this feature under Settings > General.

Folder Creation in Data Orchestration: Create new folders within the transfer panel during file moves in the CloudSoda Orchestration module.
Timeline View Enhancement: View delta size changes between the initial and final days of the timeline under File Management and Project.