Manage metadata migrations
Manage your metadata migrations with Data Migrator using either the UI or CLI.
Manage metadata migrations with the UI
The Dashboard displays an overview of metadata migrations and their status, showing what metadata has been transferred and added since the migration started.
For an overview of the progress and status of individual metadata migrations, go to the Metadata Migrations panel, and search for or filter migrations by migration name.
Status
Select a migration from the Dashboard, Metadata Migrations panel to view its current state, to pause, stop, reset, resume, or delete a migration and view objects migrated information.
The object counts displayed on the Metadata Migration Status page show the number of actions taken on the target by Hive Migrator. This includes: creation of databases, tables, views and partitions; changes to write ids and responses to events received from Hive on the source.
Pause a metadata migration
When you start a metadata migration, you can select Pause to suspend transferring metadata.
You can resume a metadata migration that is paused.
Stop a metadata migration
Once a metadata migration has started, you can select Stop to suspend transferring metadata.
You can resume a metadata migration that is stopped.
Reset a metadata migration
After stopping a metadata migration, select Reset to set it to it's origional state before it was started.
You can then start the metadata migration after reset.
Resume a metadata migration
See Manage metadata changes for more information on Listening mode.
Resume a paused metadata migration
You can select Resume on a paused migration. If Listening mode is enabled, the migration continues to process the events provided by the listener. If listeners aren't configured, the migration restarts scanning for changes.
Resume a stopped metadata migration
You can select Resume on a stopped migration. If Listening mode is enabled, the migration scans once for changes before continuing to process the events provided by the listener. If listeners aren't configured, the migration restarts scanning for changes.
Delete a metadata migration
You must stop or pause a metadata migration before you can delete it.
To delete a metadata migration:
- Select the metadata migration from your Metadata Migrations panel.
- On the Migration Status page, select Stop.
- Select Delete.
Bulk actions
You can apply Resume, Start, Reset, and Stop actions to multiple metadata migrations at once with the UI. See Bulk actions for more details.
Settings
Select a migration from the Dashboard, Metadata Migrations panel then select Settings to see additional configuration information.
Assign management group
To assign a migration group to a metadata migration:
- From the Dashboard, select a metadata migration.
- Select Settings.
- Under Management Group, select a management group.
- Select Submit to apply the change.
See Migration Managment for information on the use of management groups and how to delegate migration management.
Manage metadata migrations with the CLI
Command | Action |
---|---|
hive migration delete | Delete a metadata migration |
hive migration list | List all metadata migrations |
hive migration show | Display information about a metadata migration |
hive migration start | Start a metadata migration or a list of metadata migrations |
hive migration start all | Start all metadata migrations |
hive migration status | Show the status of a metadata migration or a list of metadata migrations |
hive migration status all | Show the status of all metadata migrations |
hive migration stop | Stop a hive migration or a list of metadata migrations |
hive migration stop all | Stop all metadata migrations |
hive migration reset | Reset a metadata migration or a list of metadata migrations |