Skip to main content

Catalog Type Reference

Each catalog type requires specific properties. The new catalog form pre-populates sensible defaults for the selected type. This page lists the complete property set for each type.


Hadoop

Catalogs backed by a Hadoop-compatible filesystem (HDFS).

PropertyRequiredDescription
uriYesHDFS nameservice URI, e.g. hdfs://nameservice1:8020

Supports Kerberos authentication for secured HDFS clusters.


Hive

Catalogs using Apache Hive Metastore via the Thrift protocol.

PropertyRequiredDescription
uriYesThrift Metastore URI, e.g. thrift://metastore.example.com:9083
catalogNoCatalog name, if the Metastore hosts multiple catalogs

Supports Kerberos authentication. When Kerberos is enabled, Ice Flow automatically configures SASL transport for the Hive Metastore Thrift client.

Hive catalogs support continuous replication mode via the Metastore event stream.


JDBC

Catalogs stored in a relational database.

PropertyRequiredDescription
uriYesJDBC connection string, e.g. jdbc:postgresql://db.example.com:5432/iceberg

Additional JDBC driver JARs must be provided via the -Djdbc.extra.driver.jars JVM flag. Provide a comma-separated list of absolute paths:

-Djdbc.extra.driver.jars=/opt/drivers/postgresql.jar,/opt/drivers/mysql.jar

AWS Glue

Amazon Web Services Glue Data Catalog integration.

PropertyRequiredDescription
uriYesAWS Glue endpoint URL
s3.access-key-idYesAWS access key ID
s3.secret-access-keyYesAWS secret access key
aws.regionYesAWS region, e.g. us-east-1

Authentication uses AWS IAM credentials. Kerberos is not applicable.


REST

Catalogs accessible via the Apache Iceberg REST Catalog API.

PropertyRequiredDescription
uriYesREST catalog endpoint, e.g. http://rest-catalog.example.com:8234/catalog
s3.endpointNoS3-compatible storage endpoint (for non-AWS storage)
rest.sigv4-enabledNoSet to true to enable AWS SigV4 request signing
rest.authorization.header.enabledNoSet to true to include authorization headers

Nessie

Project Nessie versioned catalog with git-like branching for Iceberg tables.

PropertyRequiredDescription
uriYesNessie API endpoint, e.g. http://nessie.example.com:19120/api/v1
refNoBranch or tag reference (default: main)
warehouseNoDefault warehouse location, e.g. s3://bucket/path

Adding Custom Properties

All catalog types accept additional properties via the Add property button on the catalog creation or settings page. These are passed directly to the underlying Iceberg catalog implementation.

Common additional properties include:

PropertyDescription
io-implCustom FileIO implementation class
s3.endpointS3-compatible storage endpoint
s3.path-style-accessUse path-style S3 URLs (true/false)
s3.regionOverride S3 region
client.assume-role.arnAWS IAM role ARN to assume

Catalog properties also flow through to the FileIO used during data transfers, so a region or credentials set on the catalog apply to the target bucket too. Properties on a matched warehouse override the catalog values, letting you target a different region or set of credentials per warehouse.