Release notes
| Product Version | LiveData UI | LiveData Migrator | Hive Migrator | CLI |
|---|---|---|---|---|
| 4.0.0 | 15.0.2 | 4.0.3 | 4.0.4 | 4.0.2 |
Release Highlights
Java Upgrade
We are excited to announce that Cirata Data Migrator has been upgraded to Java 17, a major architectural upgrade that delivers hardened security and modernized performance. This transition eliminates legacy vulnerabilities and leverages the latest features to ensure your data migrations remain compliant, stable, and future-proof. By modernizing our technology stack, we are providing a more resilient foundation that reduces technical debt and optimizes memory management for your most critical data workloads. This major step forward will also act as a springboard for future product developments.
HVM Metadata Verification & Repair
We have significantly broadened the scope of our metadata verification capabilities. Metadata verifications and repairs are no longer restricted to Hive-to-Hive migrations. Support has been expanded to include Hive to Iceberg (Apache Iceberg REST Catalog and the Iceberg Hive Catalog on Watsonx.data) and Hive to AWS Glue Data Catalog. The repair feature now resolves all major inconsistency types rather than just missing source objects.
The Metadata Verification Repair feature is now enabled by default and ready for production use. While repairs remain powerful and should be reviewed carefully before execution, the functionality is fully supported. Furthermore, repair performance has been significantly improved with support for parallel processing, lifting the previous limitation of running only one repair at a time.
For more information on metadata verification and repair see here.
Other Improvements
CLI & UI Enhancements
The UI now permits the verification of recurring migrations which are not active at the point when the verification process is initiated. We have also significantly improved the performance of the UI for the display of both migration information and for the list in the migration table. The display of the migration list table in the CLI has also been enhanced, in addition to improvements for selected CLI commands related to migrations.
Resolved Issues
Data Migrator Core
LM2-9201 Fix metrics registration issues following normalization
LM2-9217 Improve robustness for a particular scenario involving the order of operations
LM2-9223 Manage ConcurrentModificationException in getReadyGates
LM2-9225 Protect against failure of dangling directory deletion
LM2-9257 Reduce logging in AcidPathReorderer
LM2-9261 Resolution of performance issue associated with log message: Removing Gate dependencies on gate
Hive Migrator
HVM-5978 Improve scalability of HVM listeners
HVM-6015 Handle missed event exception
HVM-6018 Retry S3 race condition for drops
HVM-6025 Enhanced performance for Hive to Iceberg migration restart
HVM-6045 Handle migration failure on HA metastore failovers
UI
ONEUI-8618 Render the scan duration correctly
ONEUI-8677 Manage race condition when creating and displaying a migration
Feature Removal
The Data Transfer Agent feature which was deprecated in the previous release has now been removed. This reduces cost and simplifies Data Migrator for the new Java 17 release and future product developments.
The Azure HDI Metastore Agent has been completely removed from the product, meaning Azure SQL Database is no longer supported as a metadata source or target. Consequently, the supported use-case for migrating transactional tables is now strictly limited to Hive 3 to Hive 3.