Set Up Monitoring
Monitors observe changes to tables in an Iceberg catalog by polling the Hive Metastore event stream. They record events but do not copy data.
Create a Monitor
- Navigate to Iceberg > Monitors
- Click Add New Monitor
- Fill in the form:
| Field | Description |
|---|---|
| Name | A descriptive label |
| Source catalog | The Hive catalog to monitor |
| Inclusion scopes | Which tables to observe |
| Exclusion scopes | Optional — tables to skip |
| Poll period | Milliseconds between event checks (default: 1000) |
- Click Create
Monitors require a Hive catalog because they rely on the Hive Metastore event stream. Other catalog types do not support event-based monitoring.
View Events
Once a monitor is running, view detected changes on the Events tab:
| Field | Description |
|---|---|
| Namespace | The namespace (database) containing the table |
| Table | The table name |
| Timestamp | When the event occurred |
| Record count | Current number of records in the table |
| Record delta | Change in record count (+ additions, - deletions) |
| File count | Number of data files |
| File size | Total size of data files |
| Snapshot | The Iceberg snapshot ID that triggered the event |
Click an event to expand its full details. Events are displayed chronologically and paginated when the history is large.
Individual events are retained for 2 days. Older events are automatically compacted into daily summaries. See Data Retention for details.
View Scopes
The Scopes tab shows the inclusion and exclusion scopes applied to the monitor. This is a read-only view of the configuration set during creation.
Edit a Monitor
- Open the monitor from Iceberg > Monitors
- Click the Settings tab
- Modify the name, notes, or poll period
- Click Save
Delete a Monitor
- Stop the monitor if it is running
- Open the Settings tab
- Click Delete Monitor