Package io.deephaven.extensions.arrow

Class ArrowWrapperTools

java.lang.Object

io.deephaven.extensions.arrow.ArrowWrapperTools

public class ArrowWrapperTools
extends Object

This class contains tools for dealing apache arrow data.

• ArrowBooleanColumnSource - uses BitVector under the hood, returns Boolean
• ArrowByteColumnSource - uses TinyIntVector under the hood, returns byte
• ArrowCharColumnSource - uses UInt2Vector under the hood, returns long
• ArrowFloatColumnSource - uses Float4Vector under the hood, returns float
• ArrowDoubleColumnSource - uses Float8Vector under the hood, returns double
• ArrowShortColumnSource - uses SmallIntVector under the hood, returns short
• ArrowIntColumnSource - uses IntVector under the hood, returns int
• ArrowLongColumnSource - uses BigIntVector under the hood, returns long
• ArrowUInt1ColumnSource - uses UInt1Vector under the hood, returns short
• ArrowUInt4ColumnSource - uses UInt4Vector under the hood, returns long
• ArrowObjectColumnSource<BigInteger> - uses UInt8Vector under the hood, returns BigInteger
• ArrowLocalTimeColumnSource - uses TimeMilliVector under the hood, returns LocalTime
• ArrowInstantColumnSource - uses TimeStampVector under the hood, returns DateTime
• ArrowStringColumnSource - uses VarCharVector under the hood, returns String
• ArrowObjectColumnSource<byte[]> - uses FixedSizeBinaryVector under the hood, returns byte[]
• ArrowObjectColumnSource<byte[]> - uses VarBinaryVector under the hood, returns byte[]
• ArrowObjectColumnSource<BigDecimal> - uses DecimalVector under the hood, returns BigDecimal
• ArrowObjectColumnSource<BigDecimal> - uses Decimal256Vector under the hood, returns BigDecimal
• ArrowObjectColumnSource<LocalDateTime> - uses DateMilliVector under the hood, returns LocalDateTime

Note that Arrow's Java implementation only supports feather v2, as a result this class only supports feather v2.

There are some performance issues under certain data access patterns. See deephaven-core#3633 for details and suggested future improvements.

Nested Class Summary

Nested Classes

Modifier and Type	Class	Description
static class	ArrowWrapperTools.ArrowTableContext
static class	ArrowWrapperTools.FillContext
static final class	ArrowWrapperTools.Shareable

Constructor Summary

Constructors

Constructor	Description
ArrowWrapperTools()

Method Summary

Modifier and Type	Method	Description
static QueryTable	readFeather(@NotNull String path)	Reads arrow data from a feather-formatted file and returns a query table

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Details

ArrowWrapperTools

public ArrowWrapperTools()

Method Details

readFeather

public static QueryTable readFeather(@NotNull
 @NotNull String path)

Reads arrow data from a feather-formatted file and returns a query table