IcebergCatalogAdapter
The IcebergCatalogAdapter
class provides an interface for interacting with Iceberg catalogs. It allows listing namespaces, tables, and snapshots, as well as reading Iceberg tables into Deephaven tables.
Constructors
An IcebergCatalogAdapter
is constructed using one of the following methods:
Methods
namespaces
- Returns a table of Iceberg namespaces that belong to a given namespace. If no namespace is given, a table of the top-level namespaces is returned.tables
- Returns information on the tables in the specified namespace.load_table
- Load an Iceberg table into Deephaven from a catalog.
Examples
The following example creates an IcebergCatalogAdapter
using an AWS glue catalog:
from deephaven.experimental import iceberg
glue_adapter = iceberg.adapter_aws_glue(
name="aws-iceberg",
catalog_uri="s3://lab-warehouse/sales",
warehouse_location="s3://lab-warehouse/sales",
)
The following example creates an IcebergCatalogAdapter
using a local MinIO instance and a REST catalog:
from deephaven.experimental import iceberg
rest_adapter = iceberg.adapter_s3_rest(
name="minio-iceberg",
catalog_uri="http://rest:8181",
warehouse_location="s3a://warehouse/wh",
region_name="us-east-1",
access_key_id="admin",
secret_access_key="password",
end_point_override="http://minio:9000",
)