Package io.deephaven.engine.table.impl.by

Class BaseBlinkFirstOrLastChunkedOperator

java.lang.Object

io.deephaven.engine.table.impl.by.BaseBlinkFirstOrLastChunkedOperator

All Implemented Interfaces:

IterativeChunkedAggregationOperator

Direct Known Subclasses:

BlinkFirstChunkedOperator, CopyingPermutedBlinkFirstOrLastChunkedOperator

public abstract class BaseBlinkFirstOrLastChunkedOperator
extends Object
implements IterativeChunkedAggregationOperator

Base class with shared boilerplate for BlinkFirstChunkedOperator and BlinkLastChunkedOperator.

Nested Class Summary

Nested classes/interfaces inherited from interface io.deephaven.engine.table.impl.by.IterativeChunkedAggregationOperator

IterativeChunkedAggregationOperator.BucketedContext, IterativeChunkedAggregationOperator.SingletonContext

Field Summary

Fields

Modifier and Type	Field	Description
protected static final int	COPY_CHUNK_SIZE
protected final ColumnSource<?>[]	inputColumns	Input columns, parallel to outputColumns and resultColumns.
protected final int	numResultColumns	The number of result columns.
protected final WritableColumnSource<?>[]	outputColumns	Output columns, parallel to inputColumns and resultColumns.
protected LongArraySource	redirections	Map from destination slot to first key.

Fields inherited from interface io.deephaven.engine.table.impl.by.IterativeChunkedAggregationOperator

ZERO_LENGTH_ITERATIVE_CHUNKED_AGGREGATION_OPERATOR_ARRAY

Constructor Summary

Constructors

Modifier	Constructor	Description
protected	BaseBlinkFirstOrLastChunkedOperator(@NotNull MatchPair[] resultPairs, @NotNull Table blinkTable)

Method Summary

Modifier and Type	Method	Description
final void	finishRecording()
final Map<String,? extends ColumnSource<?>>	getResultColumns()	Return a map of result columns produced by this operator.
final void	modifyChunk(IterativeChunkedAggregationOperator.BucketedContext bucketedContext, Chunk<? extends Values> previousValues, Chunk<? extends Values> newValues, LongChunk<? extends RowKeys> postShiftRowKeys, IntChunk<RowKeys> destinations, IntChunk<ChunkPositions> startPositions, IntChunk<ChunkLengths> length, WritableBooleanChunk<Values> stateModified)	Modify a chunk of data previously aggregated into the result columns using a parallel chunk of new values.
final boolean	modifyChunk(IterativeChunkedAggregationOperator.SingletonContext singletonContext, int chunkSize, Chunk<? extends Values> previousValues, Chunk<? extends Values> newValues, LongChunk<? extends RowKeys> postShiftRowKeys, long destination)	Modify a chunk of data previously aggregated into the result columns using a parallel chunk of new values.
final void	modifyRowKeys(IterativeChunkedAggregationOperator.BucketedContext context, LongChunk<? extends RowKeys> inputRowKeys, IntChunk<RowKeys> destinations, IntChunk<ChunkPositions> startPositions, IntChunk<ChunkLengths> length, WritableBooleanChunk<Values> stateModified)	Called with the modified row keys when IterativeChunkedAggregationOperator.requiresRowKeys() returns true if our input columns have not changed (or we have none).
final boolean	modifyRowKeys(IterativeChunkedAggregationOperator.SingletonContext context, LongChunk<? extends RowKeys> rowKeys, long destination)	Called with the modified row keys when IterativeChunkedAggregationOperator.requiresRowKeys() returns true if our input columns have not changed (or we have none).
final void	removeChunk(IterativeChunkedAggregationOperator.BucketedContext bucketedContext, Chunk<? extends Values> values, LongChunk<? extends RowKeys> inputRowKeys, IntChunk<RowKeys> destinations, IntChunk<ChunkPositions> startPositions, IntChunk<ChunkLengths> length, WritableBooleanChunk<Values> stateModified)	Remove a chunk of data previously aggregated into the result columns.
final boolean	removeChunk(IterativeChunkedAggregationOperator.SingletonContext singletonContext, int chunkSize, Chunk<? extends Values> values, LongChunk<? extends RowKeys> inputRowKeys, long destination)	Remove a chunk of data previously aggregated into the result columns.
final boolean	requiresRowKeys()	Whether the operator requires row keys.
void	resetForStep(@NotNull TableUpdate upstream, int startingDestinationsCount)	Reset any per-step internal state.
final void	shiftChunk(IterativeChunkedAggregationOperator.BucketedContext bucketedContext, Chunk<? extends Values> previousValues, Chunk<? extends Values> newValues, LongChunk<? extends RowKeys> preShiftRowKeys, LongChunk<? extends RowKeys> postShiftRowKeys, IntChunk<RowKeys> destinations, IntChunk<ChunkPositions> startPositions, IntChunk<ChunkLengths> length, WritableBooleanChunk<Values> stateModified)	Called with shifted row keys when IterativeChunkedAggregationOperator.requiresRowKeys() returns true, including shifted same-slot modifies.
final boolean	shiftChunk(IterativeChunkedAggregationOperator.SingletonContext singletonContext, Chunk<? extends Values> previousValues, Chunk<? extends Values> newValues, LongChunk<? extends RowKeys> preShiftRowKeys, LongChunk<? extends RowKeys> postShiftRowKeys, long destination)	Shift a chunk of data previously aggregated into the result columns, including shifted same-slot modifies.
final void	startRecording(LongConsumer reincarnatedDestinationCallback, LongConsumer emptiedDestinationCallback)

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Methods inherited from interface io.deephaven.engine.table.impl.by.IterativeChunkedAggregationOperator

addChunk, addChunk, addRowSet, ensureCapacity, initializeRefreshing, makeBucketedContext, makeSingletonContext, propagateFailure, propagateInitialState, propagateUpdates, requiresRunFinds, startTrackingPrevValues, unchunkedRowSet

Field Details

COPY_CHUNK_SIZE

protected static final int COPY_CHUNK_SIZE

See Also:

• Constant Field Values

numResultColumns

protected final int numResultColumns

The number of result columns. This is the size of resultColumns and the length of inputColumns and outputColumns.

inputColumns

protected final ColumnSource<?>[] inputColumns

Input columns, parallel to outputColumns and resultColumns.

These are the source columns from the upstream table, reinterpreted to primitives where applicable.

outputColumns

protected final WritableColumnSource<?>[] outputColumns

Output columns, parallel to inputColumns and resultColumns.

These are the result columns, reinterpreted to primitives where applicable.

redirections

protected LongArraySource redirections

Map from destination slot to first key. Only used during a step to keep track of the appropriate rows to copy into the output columns.

Constructor Details

BaseBlinkFirstOrLastChunkedOperator

protected BaseBlinkFirstOrLastChunkedOperator(@NotNull
 @NotNull MatchPair[] resultPairs,
 @NotNull
 @NotNull Table blinkTable)

Method Details

getResultColumns

public final Map<String,? extends ColumnSource<?>> getResultColumns()

Description copied from interface: IterativeChunkedAggregationOperator

Return a map of result columns produced by this operator.

Specified by:

getResultColumns in interface IterativeChunkedAggregationOperator

Returns:

a map of name to columns for the result table

requiresRowKeys

public final boolean requiresRowKeys()

Description copied from interface: IterativeChunkedAggregationOperator

Whether the operator requires row keys. This implies that the operator must process shifts (i.e. IterativeChunkedAggregationOperator.shiftChunk(io.deephaven.engine.table.impl.by.IterativeChunkedAggregationOperator.BucketedContext, io.deephaven.chunk.Chunk<? extends io.deephaven.chunk.attributes.Values>, io.deephaven.chunk.Chunk<? extends io.deephaven.chunk.attributes.Values>, io.deephaven.chunk.LongChunk<? extends io.deephaven.engine.rowset.chunkattributes.RowKeys>, io.deephaven.chunk.LongChunk<? extends io.deephaven.engine.rowset.chunkattributes.RowKeys>, io.deephaven.chunk.IntChunk<io.deephaven.engine.rowset.chunkattributes.RowKeys>, io.deephaven.chunk.IntChunk<io.deephaven.chunk.attributes.ChunkPositions>, io.deephaven.chunk.IntChunk<io.deephaven.chunk.attributes.ChunkLengths>, io.deephaven.chunk.WritableBooleanChunk<io.deephaven.chunk.attributes.Values>)), and must observe modifications even when its input columns (if any) are not modified (i.e. IterativeChunkedAggregationOperator.modifyRowKeys(io.deephaven.engine.table.impl.by.IterativeChunkedAggregationOperator.BucketedContext, io.deephaven.chunk.LongChunk<? extends io.deephaven.engine.rowset.chunkattributes.RowKeys>, io.deephaven.chunk.IntChunk<io.deephaven.engine.rowset.chunkattributes.RowKeys>, io.deephaven.chunk.IntChunk<io.deephaven.chunk.attributes.ChunkPositions>, io.deephaven.chunk.IntChunk<io.deephaven.chunk.attributes.ChunkLengths>, io.deephaven.chunk.WritableBooleanChunk<io.deephaven.chunk.attributes.Values>)).

Specified by:

requiresRowKeys in interface IterativeChunkedAggregationOperator

Returns:

true if the operator requires row keys, false otherwise

resetForStep

@OverridingMethodsMustInvokeSuper
public void resetForStep(@NotNull
 @NotNull TableUpdate upstream,
 int startingDestinationsCount)

Description copied from interface: IterativeChunkedAggregationOperator

Reset any per-step internal state. Note that the arguments to this method should not be mutated in any way.

Specified by:

resetForStep in interface IterativeChunkedAggregationOperator

Parameters:

upstream - The upstream ShiftAwareListener.Update

startingDestinationsCount - The number of used destinations at the beginning of this step

removeChunk

public final void removeChunk(IterativeChunkedAggregationOperator.BucketedContext bucketedContext,
 Chunk<? extends Values> values,
 LongChunk<? extends RowKeys> inputRowKeys,
 IntChunk<RowKeys> destinations,
 IntChunk<ChunkPositions> startPositions,
 IntChunk<ChunkLengths> length,
 WritableBooleanChunk<Values> stateModified)

Description copied from interface: IterativeChunkedAggregationOperator

Remove a chunk of data previously aggregated into the result columns.

Specified by:

removeChunk in interface IterativeChunkedAggregationOperator

Parameters:

bucketedContext - the operator-specific context

values - a chunk of values that have been previously aggregated.

inputRowKeys - the input row keys, in pre-shift space

destinations - the destinations in resultColumn to remove the values from, parallel with startPositions and length

startPositions - the starting positions in the chunk for each destination

length - the number of values in the chunk for each destination

stateModified - a boolean output array, parallel to destinations, which is set to true if the corresponding destination has been modified

modifyChunk

public final void modifyChunk(IterativeChunkedAggregationOperator.BucketedContext bucketedContext,
 Chunk<? extends Values> previousValues,
 Chunk<? extends Values> newValues,
 LongChunk<? extends RowKeys> postShiftRowKeys,
 IntChunk<RowKeys> destinations,
 IntChunk<ChunkPositions> startPositions,
 IntChunk<ChunkLengths> length,
 WritableBooleanChunk<Values> stateModified)

Description copied from interface: IterativeChunkedAggregationOperator

Modify a chunk of data previously aggregated into the result columns using a parallel chunk of new values. Never includes modifies that have been shifted if IterativeChunkedAggregationOperator.requiresRowKeys() returns true - those are handled in IterativeChunkedAggregationOperator.shiftChunk(BucketedContext, Chunk, Chunk, LongChunk, LongChunk, IntChunk, IntChunk, IntChunk, WritableBooleanChunk).

Specified by:

modifyChunk in interface IterativeChunkedAggregationOperator

Parameters:

bucketedContext - the operator-specific context

previousValues - a chunk of values that have been previously aggregated

newValues - a chunk of values to aggregate

postShiftRowKeys - the input row keys, in post-shift space

destinations - the destinations in resultColumn to remove the values from, parallel with startPositions and length

startPositions - the starting positions in the chunk for each destination

length - the number of values in the chunk for each destination

stateModified - a boolean output array, parallel to destinations, which is set to true if the corresponding destination has been modified

shiftChunk

public final void shiftChunk(IterativeChunkedAggregationOperator.BucketedContext bucketedContext,
 Chunk<? extends Values> previousValues,
 Chunk<? extends Values> newValues,
 LongChunk<? extends RowKeys> preShiftRowKeys,
 LongChunk<? extends RowKeys> postShiftRowKeys,
 IntChunk<RowKeys> destinations,
 IntChunk<ChunkPositions> startPositions,
 IntChunk<ChunkLengths> length,
 WritableBooleanChunk<Values> stateModified)

Description copied from interface: IterativeChunkedAggregationOperator

Called with shifted row keys when IterativeChunkedAggregationOperator.requiresRowKeys() returns true, including shifted same-slot modifies.

Specified by:

shiftChunk in interface IterativeChunkedAggregationOperator

Parameters:

bucketedContext - the operator-specific context

previousValues - a chunk of values that have been previously aggregated.

newValues - a chunk of values to aggregate

preShiftRowKeys - the input row keys, in pre-shift space

postShiftRowKeys - the input row keys, in post-shift space

destinations - the destinations in resultColumn to aggregate into, parallel with startPositions and length

startPositions - the starting positions in the chunk for each destination

length - the number of values in the chunk for each destination

stateModified - a boolean output array, parallel to destinations, which is set to true if the corresponding destination has been modified

modifyRowKeys

public final void modifyRowKeys(IterativeChunkedAggregationOperator.BucketedContext context,
 LongChunk<? extends RowKeys> inputRowKeys,
 IntChunk<RowKeys> destinations,
 IntChunk<ChunkPositions> startPositions,
 IntChunk<ChunkLengths> length,
 WritableBooleanChunk<Values> stateModified)

Description copied from interface: IterativeChunkedAggregationOperator

Called with the modified row keys when IterativeChunkedAggregationOperator.requiresRowKeys() returns true if our input columns have not changed (or we have none).

Specified by:

modifyRowKeys in interface IterativeChunkedAggregationOperator

Parameters:

context - the operator-specific context

inputRowKeys - the input row keys, in post-shift space

destinations - the destinations in resultColumn to aggregate into, parallel with startPositions and length

startPositions - the starting positions in the chunk for each destination

length - the number of values in the chunk for each destination

stateModified - a boolean output array, parallel to destinations, which is set to true if the corresponding destination has been modified

removeChunk

public final boolean removeChunk(IterativeChunkedAggregationOperator.SingletonContext singletonContext,
 int chunkSize,
 Chunk<? extends Values> values,
 LongChunk<? extends RowKeys> inputRowKeys,
 long destination)

Description copied from interface: IterativeChunkedAggregationOperator

Remove a chunk of data previously aggregated into the result columns.

Specified by:

removeChunk in interface IterativeChunkedAggregationOperator

Parameters:

singletonContext - the operator-specific context

chunkSize - the size of the removal

values - the values to remove from the aggregation

inputRowKeys - the input row keys, in pre-shift space

destination - the destination in the result columns

Returns:

true if the state was modified, false otherwise

modifyChunk

public final boolean modifyChunk(IterativeChunkedAggregationOperator.SingletonContext singletonContext,
 int chunkSize,
 Chunk<? extends Values> previousValues,
 Chunk<? extends Values> newValues,
 LongChunk<? extends RowKeys> postShiftRowKeys,
 long destination)

Description copied from interface: IterativeChunkedAggregationOperator

Modify a chunk of data previously aggregated into the result columns using a parallel chunk of new values. Never includes modifies that have been shifted if IterativeChunkedAggregationOperator.requiresRowKeys() returns true - those are handled in IterativeChunkedAggregationOperator.shiftChunk(SingletonContext, Chunk, Chunk, LongChunk, LongChunk, long).

Specified by:

modifyChunk in interface IterativeChunkedAggregationOperator

Parameters:

singletonContext - the operator-specific context

chunkSize - the size of the modification

previousValues - a chunk of values that have been previously aggregated.

newValues - a chunk of values to aggregate

postShiftRowKeys - the input row keys, in post-shift space

Returns:

true if the state was modified, false otherwise

shiftChunk

public final boolean shiftChunk(IterativeChunkedAggregationOperator.SingletonContext singletonContext,
 Chunk<? extends Values> previousValues,
 Chunk<? extends Values> newValues,
 LongChunk<? extends RowKeys> preShiftRowKeys,
 LongChunk<? extends RowKeys> postShiftRowKeys,
 long destination)

Description copied from interface: IterativeChunkedAggregationOperator

Shift a chunk of data previously aggregated into the result columns, including shifted same-slot modifies.

Specified by:

shiftChunk in interface IterativeChunkedAggregationOperator

Parameters:

singletonContext - the operator-specific context

previousValues - a chunk of values that have been previously aggregated.

newValues - a chunk of values to aggregate

preShiftRowKeys - the input row keys, in pre-shift space

postShiftRowKeys - the input row keys, in post-shift space

destination - the destination in the result columns

Returns:

true if the result should be considered modified

modifyRowKeys

public final boolean modifyRowKeys(IterativeChunkedAggregationOperator.SingletonContext context,
 LongChunk<? extends RowKeys> rowKeys,
 long destination)

Description copied from interface: IterativeChunkedAggregationOperator

Called with the modified row keys when IterativeChunkedAggregationOperator.requiresRowKeys() returns true if our input columns have not changed (or we have none).

Specified by:

modifyRowKeys in interface IterativeChunkedAggregationOperator

Parameters:

context - the operator-specific context

rowKeys - the modified row keys for a given destination, in post-shift space

destination - the destination that was modified

Returns:

true if the result should be considered modified

startRecording

public final void startRecording(LongConsumer reincarnatedDestinationCallback,
 LongConsumer emptiedDestinationCallback)

finishRecording

public final void finishRecording()