Package io.deephaven.iceberg.util

Class IcebergTableImpl

java.lang.Object

io.deephaven.util.referencecounting.ReferenceCounted

io.deephaven.engine.liveness.ReferenceCountedLivenessReferent

io.deephaven.engine.liveness.ReferenceCountedLivenessNode

io.deephaven.engine.liveness.LivenessArtifact

io.deephaven.engine.table.impl.LiveAttributeMap<IFACE_TYPE,IMPL_TYPE>

io.deephaven.engine.table.impl.BaseGridAttributes<Table,IMPL_TYPE>

io.deephaven.engine.table.impl.BaseTable<IMPL_TYPE>

io.deephaven.engine.table.impl.UncoalescedTable<IMPL_TYPE>

io.deephaven.engine.table.impl.RedefinableTable<IMPL_TYPE>

io.deephaven.engine.table.impl.SourceTable<PartitionAwareSourceTable>

io.deephaven.engine.table.impl.PartitionAwareSourceTable

io.deephaven.iceberg.util.IcebergTableImpl

All Implemented Interfaces:

TableOperations<Table,Table>, TableOperationsDefaults<Table,Table>, LogOutputAppendable, LivenessManager, LivenessNode, LivenessReferent, AttributeMap<Table>, GridAttributes<Table>, NotificationStepReceiver, NotificationStepSource, TableDefaults, Table, DynamicNode, NotificationQueue.Dependency, SystemicObject<Table>, IcebergTable, LongSizedDataStructure, Serializable

public class IcebergTableImpl
extends PartitionAwareSourceTable
implements IcebergTable

Table implementation for static and refreshing Iceberg tables.

See Also:

• Serialized Form

Nested Class Summary

Nested classes/interfaces inherited from class io.deephaven.engine.table.impl.BaseTable

BaseTable.CopyAttributeOperation, BaseTable.ListenerImpl, BaseTable.ShiftObliviousListenerImpl, BaseTable.SnapshotControlFactory<T extends ConstructSnapshot.SnapshotControl>

Field Summary

Fields inherited from class io.deephaven.engine.table.impl.BaseTable

definition, description, PRINT_SERIALIZED_UPDATE_OVERLAPS, updateGraph, VALIDATE_UPDATE_OVERLAPS

Fields inherited from interface io.deephaven.engine.table.GridAttributes

COLUMN_DESCRIPTIONS_ATTRIBUTE, DESCRIPTION_ATTRIBUTE, LAYOUT_HINTS_ATTRIBUTE, SORTABLE_COLUMNS_ATTRIBUTE

Fields inherited from interface io.deephaven.engine.table.impl.NotificationStepReceiver

NULL_NOTIFICATION_STEP

Fields inherited from interface io.deephaven.engine.table.Table

ADD_ONLY_TABLE_ATTRIBUTE, AGGREGATION_ROW_LOOKUP_ATTRIBUTE, APPEND_ONLY_TABLE_ATTRIBUTE, BARRAGE_PERFORMANCE_KEY_ATTRIBUTE, BLINK_TABLE_ATTRIBUTE, FILTERABLE_COLUMNS_ATTRIBUTE, INITIALLY_EMPTY_COALESCED_SOURCE_TABLE_ATTRIBUTE, INPUT_TABLE_ATTRIBUTE, KEY_COLUMNS_ATTRIBUTE, MERGED_TABLE_ATTRIBUTE, NON_DISPLAY_TABLE, PLUGIN_NAME, PREVIEW_PARENT_TABLE, SNAPSHOT_VIEWPORT_TYPE, SORT_REVERSE_LOOKUP_ATTRIBUTE, SORTED_COLUMNS_ATTRIBUTE, SYSTEMIC_TABLE_ATTRIBUTE, TEST_SOURCE_TABLE_ATTRIBUTE, TOTALS_TABLE_ATTRIBUTE, UNIQUE_KEYS_ATTRIBUTE

Fields inherited from interface io.deephaven.engine.table.impl.TableDefaults

ZERO_LENGTH_TABLE_ARRAY

Fields inherited from interface io.deephaven.api.TableOperations

AGG_BY_PRESERVE_EMPTY_DEFAULT

Fields inherited from interface io.deephaven.api.TableOperationsDefaults

ZERO_LENGTH_COLUMNNAME_ARRAY, ZERO_LENGTH_FILTER_ARRAY

Method Summary

Modifier and Type	Method	Description
void	update()	When the update mode for this table is IcebergUpdateMode.manualRefreshingMode(), this call will update the table with the latest snapshot from the catalog.
void	update(long snapshotId)	When the update mode for this table is IcebergUpdateMode.manualRefreshingMode(), this call will update the table with a specific snapshot from the catalog.
void	update(@NotNull org.apache.iceberg.Snapshot snapshot)	When the update mode for this table is IcebergUpdateMode.manualRefreshingMode(), this call will update the table with a specific snapshot from the catalog.

Methods inherited from class io.deephaven.engine.table.impl.PartitionAwareSourceTable

copy, filterLocationKeys, newInstance, redefine, redefine, selectDistinct, where

Methods inherited from class io.deephaven.engine.table.impl.SourceTable

destroy, doCoalesce, initialize, refresh, tableLocationProvider

Methods inherited from class io.deephaven.engine.table.impl.RedefinableTable

dropColumns, renameColumns, updateView, view

Methods inherited from class io.deephaven.engine.table.impl.UncoalescedTable

addUpdateListener, addUpdateListener, addUpdateListener, addUpdateListenerUncoalesced, addUpdateListenerUncoalesced, aggAllBy, aggBy, apply, asOfJoin, awaitUpdate, awaitUpdate, byteColumnIterator, characterColumnIterator, coalesce, columnIterator, doubleColumnIterator, exactJoin, flatten, floatColumnIterator, getCoalesced, getColumnSource, getColumnSourceMap, getColumnSources, getRowSet, getSubTable, head, headBy, headPct, integerColumnIterator, isFlat, join, lazyUpdate, longColumnIterator, moveColumns, naturalJoin, objectColumnIterator, objectColumnIterator, partitionBy, partitionedAggBy, rangeJoin, removeUpdateListener, removeUpdateListener, removeUpdateListenerUncoalesced, reverse, rollup, select, setCoalesced, shortColumnIterator, size, sizeForInstrumentation, slice, slicePct, snapshot, snapshotWhen, sort, tail, tailBy, tailPct, tree, ungroup, update, updateBy, whereIn, whereNotIn, wouldMatch

Methods inherited from class io.deephaven.engine.table.impl.BaseTable

addParentReference, append, checkAvailableColumns, copyAttributes, copyAttributes, copySortableColumns, createSnapshotControlIfRefreshing, getDefinition, getDescription, getLastNotificationStep, getNotificationQueue, getUpdateGraph, hasListeners, initializeWithSnapshot, isAddOnly, isAppendOnly, isBlink, isFailed, isRefreshing, isSystemicObject, markSystemic, notifyListeners, notifyListeners, notifyListenersOnError, removeBlink, satisfied, setLastNotificationStep, setRefreshing, setTotalsTable, shouldCopyAttribute, toString, withKeys, withUniqueKeys

Methods inherited from class io.deephaven.engine.table.impl.BaseGridAttributes

clearSortingRestrictions, getSortableColumns, restrictSortTo, setColumnDescriptions, setLayoutHints, setSortableColumns, withColumnDescription, withColumnDescriptions, withDescription

Methods inherited from class io.deephaven.engine.table.impl.LiveAttributeMap

copyAttributes, getAttribute, getAttributeKeys, getAttributes, getAttributes, hasAttribute, prepareReturnCopy, prepareReturnThis, published, retainingAttributes, setAttribute, setAttribute, withAttributes, withAttributes, withoutAttributes

Methods inherited from class io.deephaven.engine.liveness.LivenessArtifact

manageWithCurrentScope

Methods inherited from class io.deephaven.engine.liveness.ReferenceCountedLivenessNode

getWeakReference, initializeTransientFieldsForLiveness, onReferenceCountAtZero, tryManage, tryUnmanage, tryUnmanage

Methods inherited from class io.deephaven.engine.liveness.ReferenceCountedLivenessReferent

dropReference, tryRetainReference

Methods inherited from class io.deephaven.util.referencecounting.ReferenceCounted

decrementReferenceCount, forceReferenceCountToZero, getReferenceCountDebug, incrementReferenceCount, resetReferenceCount, tryDecrementReferenceCount, tryIncrementReferenceCount

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, wait, wait, wait

Methods inherited from interface io.deephaven.engine.table.AttributeMap

getAttribute, getAttributeKeys, getAttributes, getAttributes, hasAttribute, retainingAttributes, withAttributes, withAttributes, withoutAttributes

Methods inherited from interface io.deephaven.engine.updategraph.DynamicNode

addParentReference, setRefreshing

Methods inherited from interface io.deephaven.engine.table.GridAttributes

clearSortingRestrictions, restrictSortTo, setLayoutHints, withColumnDescription, withColumnDescriptions, withDescription

Methods inherited from interface io.deephaven.engine.liveness.LivenessManager

manage, tryManage, tryUnmanage, tryUnmanage, unmanage, unmanage

Methods inherited from interface io.deephaven.engine.liveness.LivenessReferent

dropReference, getReferentDescription, getWeakReference, retainReference, tryRetainReference

Methods inherited from interface io.deephaven.base.log.LogOutputAppendable

append

Methods inherited from interface io.deephaven.util.datastructures.LongSizedDataStructure

intSize, intSize, size

Methods inherited from interface io.deephaven.engine.updategraph.NotificationQueue.Dependency

getUpdateGraph, getUpdateGraph, satisfied

Methods inherited from interface io.deephaven.engine.table.impl.NotificationStepReceiver

initializeLastNotificationStep

Methods inherited from interface io.deephaven.engine.util.systemicmarking.SystemicObject

isSystemicObject, markSystemic

Methods inherited from interface io.deephaven.engine.table.Table

addUpdateListener, addUpdateListener, addUpdateListener, apply, awaitUpdate, awaitUpdate, byteColumnIterator, characterColumnIterator, columnIterator, doubleColumnIterator, flatten, floatColumnIterator, getColumnSource, getColumnSourceMap, getColumnSources, getDefinition, getDescription, getRowSet, getSubTable, headBy, headPct, integerColumnIterator, isFailed, isFlat, isRefreshing, longColumnIterator, moveColumns, objectColumnIterator, objectColumnIterator, partitionBy, partitionedAggBy, removeBlink, removeUpdateListener, removeUpdateListener, renameColumns, rollup, setTotalsTable, shortColumnIterator, slicePct, tailBy, tailPct, tree, withKeys, withUniqueKeys, wouldMatch

Methods inherited from interface io.deephaven.engine.table.impl.TableDefaults

addUpdateListener, applyToAllBy, applyToAllBy, applyToAllBy, close, dropColumnFormats, formatColumns, formatColumnWhere, formatRowWhere, getColumnSource, getColumnSource, hasColumns, hasColumns, headBy, isEmpty, join, meta, moveColumnsDown, moveColumnsUp, numColumns, partitionBy, releaseCachedResources, renameAllColumns, renameColumns, rollup, rollup, rollup, rollup, rollup, selectDistinct, snapshotWhen, snapshotWhen, tailBy, wouldMatch

Methods inherited from interface io.deephaven.api.TableOperations

aggAllBy, aggBy, asOfJoin, dropColumns, exactJoin, head, join, lazyUpdate, naturalJoin, rangeJoin, reverse, select, selectDistinct, slice, snapshot, snapshotWhen, sort, tail, ungroup, update, updateBy, updateView, view, where, whereIn, whereNotIn

Methods inherited from interface io.deephaven.api.TableOperationsDefaults

absSumBy, absSumBy, absSumBy, absSumBy, aggAllBy, aggAllBy, aggAllBy, aggBy, aggBy, aggBy, aggBy, aggBy, aggBy, aggBy, aj, aj, avgBy, avgBy, avgBy, avgBy, countBy, countBy, countBy, countBy, dropColumns, dropColumns, exactJoin, exactJoin, firstBy, firstBy, firstBy, firstBy, groupBy, groupBy, groupBy, join, join, join, lastBy, lastBy, lastBy, lastBy, lazyUpdate, maxBy, maxBy, maxBy, maxBy, medianBy, medianBy, medianBy, medianBy, minBy, minBy, minBy, minBy, naturalJoin, naturalJoin, raj, raj, rangeJoin, select, select, selectDistinct, sort, sortDescending, stdBy, stdBy, stdBy, stdBy, sumBy, sumBy, sumBy, sumBy, ungroup, ungroup, ungroup, ungroup, update, updateBy, updateBy, updateBy, updateBy, updateBy, updateBy, updateBy, updateBy, updateView, varBy, varBy, varBy, varBy, view, wavgBy, wavgBy, wavgBy, wavgBy, where, whereIn, whereNotIn, wsumBy, wsumBy, wsumBy, wsumBy

Method Details

update

public void update()

Description copied from interface: IcebergTable

When the update mode for this table is IcebergUpdateMode.manualRefreshingMode(), this call will update the table with the latest snapshot from the catalog.

If any other update mode is specified, this call will throw an UnsupportedOperationException.

Specified by:

update in interface IcebergTable

update

public void update(long snapshotId)

Description copied from interface: IcebergTable

When the update mode for this table is IcebergUpdateMode.manualRefreshingMode(), this call will update the table with a specific snapshot from the catalog. If the snapshotId is not found in the list of snapshots for the table, an IllegalArgumentException is thrown. The input snapshot must also be newer (higher in sequence number) than the current snapshot or an IllegalArgumentException is thrown.

If any other update mode is specified, this call will throw an UnsupportedOperationException.

Specified by:

update in interface IcebergTable

Parameters:

snapshotId - The identifier of the snapshot to use when updating the table.

update

public void update(@NotNull
 @NotNull org.apache.iceberg.Snapshot snapshot)

Description copied from interface: IcebergTable

When the update mode for this table is IcebergUpdateMode.manualRefreshingMode(), this call will update the table with a specific snapshot from the catalog. The input snapshot must be newer (higher in sequence number) than the current snapshot or an IllegalArgumentException is thrown.

If any other update mode is specified, this call will throw an UnsupportedOperationException.

Specified by:

update in interface IcebergTable

Parameters:

snapshot - The snapshot to use when updating the table.