Skip to main content

Iceberg: Weather Observations with Time-Travel

This example demonstrates how to use Apache Iceberg as a data source in hugr, featuring a weather observations dataset with time-travel across monthly snapshots. It uses Apache Polaris as the Iceberg REST catalog with OAuth2 authentication, MinIO for S3-compatible data storage, and showcases self-describing schemas, namespace-to-module mapping, and relationship extensions.

You can find the complete example in the Hugr examples repository.

To read more about the Iceberg data source, see the Iceberg data source documentation.

Prerequisites

You need the example environment running (sh scripts/start.sh) and the Polaris services started with: docker compose --profile iceberg up -d

Example​

Loading documentation...