Supported metadata agents
The table below shows deployment details for the supported agents used for metadata migration.
Source
Platform | Agent Type | Local Agent | Remote Agent |
---|---|---|---|
CDH5.x | Apache Hive | Yes | No |
CDH6.x | Apache Hive | Yes | No |
HDP3.x | Apache Hive | Yes | No |
CDP7.x | Apache Hive | Yes | No |
AWS Glue Data Catalog | AWS Glue | Yes | Yes |
IBM Cloud Object Storage | N/A | N/A | N/A |
Target
Platform | Agent Type | Local Agent | Remote Agent |
---|---|---|---|
CDH5.x | Apache Hive | Yes - if same version as source | Yes |
CDH6.x | Apache Hive | Yes - if same version as source | Yes |
HDP3.x | Apache Hive | Yes - if same version as source | Yes |
CDP7.x | Apache Hive | Yes - if same version as source | Yes |
AWS Glue Data Catalog | AWS Glue | Yes | Yes |
HDI 4.0 internal DB | Azure SQL Database | Yes | Yes |
HDI 4.0 external DB | Azure SQL Database | Yes | Yes |
HDI 3.6 internal DB | Azure SQL Database | Yes | Yes |
HDI 3.6 external DB | Azure SQL Database | Yes | Yes |
Google Dataproc 2.1 (Ubuntu 20.04 LTS) | Dataproc | No | Yes |
Google Dataproc 2.0 (Ubuntu 18.04 LTS) | Dataproc | No | Yes |
Databricks | Databricks | Yes | No |
Snowflake | Snowflake | Yes | No |
Watsonx.data | Iceberg | Yes | No |
note
You can use Hive filesystem agents with all supported data targets.