Package

io.eels.component

parquet

Permalink

package parquet

Visibility
  1. Public
  2. All

Type Members

  1. class ArrayBuilder extends ValuesBuilder

    Permalink
  2. class ArrayConverter extends GroupConverter with Logging

    Permalink
  3. class ArrayRecordWriter extends RecordWriter with Logging

    Permalink
  4. class DateConverter extends PrimitiveConverter

    Permalink
  5. class DecimalConverter extends PrimitiveConverter

    Permalink
  6. class DecimalWriter extends RecordWriter

    Permalink
  7. class DefaultPrimitiveConverter extends PrimitiveConverter with Logging

    Permalink
  8. class MapConverter extends GroupConverter

    Permalink
  9. class MapRecordWriter extends RecordWriter

    Permalink
  10. class ParquetPublisher extends Publisher[Seq[Row]] with Logging with Using

    Permalink
  11. case class ParquetReaderConfig(parallelism: Int) extends Product with Serializable

    Permalink
  12. case class ParquetSink(path: Path, options: ParquetWriteOptions = ParquetWriteOptions())(implicit fs: FileSystem) extends Sink with Logging with Product with Serializable

    Permalink
  13. case class ParquetSource(pattern: FilePattern, predicate: Option[Predicate] = None, projection: Seq[String] = Nil, dictionaryFiltering: Boolean = true, caseSensitive: Boolean = true)(implicit fs: FileSystem, conf: Configuration) extends Source with Logging with Using with Product with Serializable

    Permalink
  14. case class ParquetWriteOptions(overwrite: Boolean = false, permission: Option[FsPermission] = None, dictionary: Boolean = true, inheritPermissions: Option[Boolean] = None, roundingMode: RoundingMode = RoundingMode.UNNECESSARY, metadata: Map[String, String] = Map.empty) extends Product with Serializable

    Permalink
  15. case class ParquetWriterConfig(blockSize: Int, pageSize: Int, compressionCodec: CompressionCodecName, enableDictionary: Boolean, validating: Boolean) extends Product with Serializable

    Permalink
  16. trait RecordWriter extends AnyRef

    Permalink
  17. class RowReadSupport extends ReadSupport[Row] with Logging

    Permalink
  18. class RowRecordMaterializer extends RecordMaterializer[Row] with Logging

    Permalink
  19. class RowWriteSupport extends WriteSupport[Row] with Logging

    Permalink
  20. class RowWriter extends AnyRef

    Permalink
  21. case class Statistics(count: Long, compressedSize: Long, uncompressedSize: Long) extends Product with Serializable

    Permalink
  22. class StringConverter extends PrimitiveConverter with Logging

    Permalink
  23. class StructConverter extends GroupConverter with Logging

    Permalink
  24. class StructRecordWriter extends RecordWriter with Logging

    Permalink
  25. class TimestampConverter extends PrimitiveConverter

    Permalink
  26. trait ValuesBuilder extends AnyRef

    Permalink
  27. class VectorBuilder extends ValuesBuilder with Logging

    Permalink

Value Members

  1. object BigIntRecordWriter extends RecordWriter

    Permalink
  2. object BinaryParquetWriter extends RecordWriter

    Permalink
  3. object BooleanRecordWriter extends RecordWriter

    Permalink
  4. object Converter

    Permalink
  5. object DateRecordWriter extends RecordWriter

    Permalink
  6. object DoubleRecordWriter extends RecordWriter

    Permalink
  7. object FloatRecordWriter extends RecordWriter

    Permalink
  8. object IntRecordWriter extends RecordWriter

    Permalink
  9. object LongRecordWriter extends RecordWriter

    Permalink
  10. object ParquetPredicateBuilder extends PredicateBuilder[FilterPredicate]

    Permalink
  11. object ParquetReaderConfig extends Logging with Serializable

    Permalink
  12. object ParquetSchemaFns

    Permalink

    See parquet formats at https://github.com/Parquet/parquet-format/blob/master/LogicalTypes.md

  13. object ParquetSink extends Serializable

    Permalink
  14. object ParquetSource extends Serializable

    Permalink
  15. object ParquetWriterConfig extends Logging with ConfigSupport with Serializable

    Permalink
  16. object RecordWriter

    Permalink
  17. object RowParquetReaderFn extends Logging

    Permalink

    Helper function to create a native parquet reader for Row objects, using the apache parquet library.

    Helper function to create a native parquet reader for Row objects, using the apache parquet library. The reader supports optional predicate (for row filtering) and a projection schema (for column filtering).

  18. object RowParquetWriterFn

    Permalink

    Helper function to create a native ParquetWriter for Row objects using the apache parquet library.

    Helper function to create a native ParquetWriter for Row objects using the apache parquet library. Uses config keys to support compression codec, page size, and block size.

  19. object ShortParquetWriter extends RecordWriter

    Permalink
  20. object Statistics extends Serializable

    Permalink
  21. object StringRecordWriter extends RecordWriter

    Permalink
  22. object TimeRecordWriter extends RecordWriter

    Permalink
  23. object TimestampRecordWriter extends RecordWriter

    Permalink
  24. package avro

    Permalink
  25. package util

    Permalink

Ungrouped