CopyStorm 10.62.1

Release Date: 16-Dec-2024

This is a  feature, bug fix, and Salesforce API version upgrade release. As always, existing CopyStorm configuration files are backwards compatible.

Patch Levels

16-Dec-2024 Original Release

Salesforce API Update

This release updates CopyStorm to use Salesforce API version 62.

Release Highlights

This release focuses on customer experience and bug fixes. Notable items include:

  • API Threshold Option: CopyStorm will not use more than the specified percentage of API calls in a day.
  • Snowflake Updates: Focus on improving the performance of Salesforce to Snowflake data extracts.

Release Details

API Threshold Option

This release introduces a new feature that provides additional control over Salesforce API call consumption. The API Threshold setting allows you to set a percentage value that will prevent a CopyStorm job from starting if Salesforce Organization’s API utilization is above the provided percentage. For example, if the API Threshold is set to 80, CopyStorm will not run if the current Salesforce API use is >80% of the total allowed API calls. 

Snowflake Updates and Bug Fixes

  • Snowflake JDBC Driver: Update
    • Upgrade the Snowflake JDBC Driver to support JDK 21.
  • Option to specify a Role when connecting to Snowflake: Feature
    • Adds the option to provide a ‘Role’ when using the connection string builder to create the database connection to Snowflake 
  • Update to prevent parallel jobs from creating duplicate records: Fix
    • Resolve issue where duplicate records can be inserted to Snowflake if multiple CopyStorm jobs are running at the same time writing to the same Snowflake database.
  • Add SocialPersona as Reserved Word: Fix
    • The “Following” column in the “SocialPersona” table is added to the list of reserved words in Snowflake.
  • Capture MaxTimestamp in UTC: Fix 
    • The ‘maxTimestamp’ column in “CopyForceTable” is stored in UTC time rather than in local time.
  • Update CSV Transfer Process: Fix
    • Resolves an issue where CSV flushes to the database halted the rest of the extract process. The extract will now continue in parallel with the CSV transfer to Snowflake.
    • This also resolves an issue that can potentially skip a single batch of records.

Salesforce Related Improvements & Bug Fixes

  • Default exclusion of SalesforceQuote, AssetStatePeriodAttribute, and PendingOrderSummary objects: Update
    • These objects are non-restorable with undocumented query restrictions  
  • Metadata Thread Count: Update
    • Reduce the default Metadata thread count to “5” to optimize performance. Higher thread counts often lead to exceptions during the metadata backup.
  • HyperForce “Upstream Error” Handling: Improvement
    • HyperForce specific “Upstream Error” exceptions now include additional details in the error messages.

Application Experience & Interface

  • Snapshot Name Trimming: Improvement
    • Trims extra whitespace on the end of Snapshot Names is. This is designed to alleviate confusion when searching for Snapshot names.
  • Zero-Length Base64 Handling: Fix
    • Resolves an issue that causes zero-length file bodies to halt a CopyStorm job in certain scenarios.
  • Notifications Tab: Fix
    • Fixes an issue where the “Send Email To” parameter did not update in the UI when switching configuration files.
  • “Excluded Audit Fields”: Fix
    • Address an issue where “LastModifiedDate” and “LastModifiedId” are not properly excluded from Field History.
  • Extract to CSV: Fix
    • Resolves an initialization issue encountered when initially copying records to a fresh directory.
  • Hierarchical Snapshots scanning: Fix
    • Resolves an issue where some grandchild records can get skipped during a  Hierarchical Snapshot scan due to threading issues.
  • Metadata Case Insensitivity: Fix
    • Adjustment to ensure that an exception is not generated when the case changes for an object name.

Infrastructure & Environment Updates 

  • Max Memory Limit in AppLoader.xml: Improvement
    • Adds an option to AppLoader.xml that can set -Xmx to a percentage of system RAM.
  • Formula Fields Definition: Fix
    • Fixes an issue that prevents certain Formula field definitions from updating properly in the database.
  • TenantSecurityMonitorMetric: Fixed Reserved Word
    • Resolves an issue while copying the Count column from the “TenantSecurityMonitorMetric” object due to a reserved word.