Class ParquetMetadataFileLayout

java.lang.Object
io.deephaven.parquet.table.layout.ParquetMetadataFileLayout
All Implemented Interfaces:
TableLocationKeyFinder<ParquetTableLocationKey>

public class ParquetMetadataFileLayout extends Object implements TableLocationKeyFinder<ParquetTableLocationKey>

Location finder that will examine a parquet metadata file to discover locations.

Note that we expect to find the following files:

  • "_metadata" - A file containing Parquet metadata for all row groups in all .parquet files for the entire data set, including schema information non-partitioning columns and key-value metadata
  • "_common_metadata" (optional) - A file containing Parquet metadata with schema information that applies to the entire data set, including partitioning columns that are inferred from file paths rather than explicitly written in column chunks within .parquet files
  • Constructor Details

    • ParquetMetadataFileLayout

      public ParquetMetadataFileLayout(@NotNull @NotNull File directory)
    • ParquetMetadataFileLayout

      public ParquetMetadataFileLayout(@NotNull @NotNull File directory, @NotNull @NotNull ParquetInstructions inputInstructions)
    • ParquetMetadataFileLayout

      public ParquetMetadataFileLayout(@NotNull @NotNull File metadataFile, @Nullable @Nullable File commonMetadataFile)
    • ParquetMetadataFileLayout

      public ParquetMetadataFileLayout(@NotNull @NotNull File metadataFile, @Nullable @Nullable File commonMetadataFile, @NotNull @NotNull ParquetInstructions inputInstructions)
  • Method Details