Package

io.eels.component.parquet

avro

Permalink

package avro

Visibility
  1. Public
  2. All

Type Members

  1. class AvroParquetPart extends Part with Logging with Using

    Permalink

  2. class AvroParquetRowWriter extends Logging

    Permalink

    Will write io.eel Rows out to a given path using an underlying apache parquet writer.

  3. case class AvroParquetSink(path: Path, overwrite: Boolean = false)(implicit fs: FileSystem) extends Sink with Logging with Product with Serializable

    Permalink

  4. case class AvroParquetSource(pattern: FilePattern, predicate: Option[Predicate] = None)(implicit fs: FileSystem, conf: Configuration) extends Source with Logging with Using with Product with Serializable

    Permalink

Value Members

  1. object AvroParquetReaderFn

    Permalink

    Helper function to create a parquet reader, using the apache parquet library.

    Helper function to create a parquet reader, using the apache parquet library. The reader supports optional predicate (for row filtering) and a projection schema (for column filtering).

  2. object AvroParquetSink extends Serializable

    Permalink

  3. object AvroParquetSource extends Serializable

    Permalink

  4. object AvroParquetWriterFn extends Logging

    Permalink

    Helper function for create an AvroParquetWriter using the apache parquet library.

    Helper function for create an AvroParquetWriter using the apache parquet library. Uses config keys to support compression codec, page size, and block size.

Ungrouped