Show your appreciation for Deephaven by starring us on GitHub.
The IcebergTable class is a subclass of Deephaven table that allows users to dynamically update the table with new snapshots from an Iceberg catalog.
update: Updates the table to match the contents of the specified snapshot ID. This is only useable if the update mode is set to IcebergUpdateMode.manual_refresh. If no snapshot ID is given, the most recent snapshot is used.The following code block.
from deephaven.experimental import iceberg
local_adapter = iceberg.adapter_s3_rest(
name="minio-iceberg",
catalog_uri="http://rest:8181",
warehouse_location="s3a://warehouse/wh",
region_name="us-east-1",
access_key_id="admin",
secret_access_key="password",
end_point_override="http://minio:9000",
)
manual_refresh_instructions = iceberg.IcebergReadInstructions(
update_mode=iceberg.IcebergUpdateMode.manual_refresh()
)
taxis = iceberg_taxis.table(manual_refresh_instructions)
# Some time later, refresh the Iceberg table
taxis = taxis.update()