Package

io.eels.component

parquet

Permalink

package parquet

Visibility
  1. Public
  2. All

Type Members

  1. class ParquetPart extends Part

    Permalink
  2. class ParquetRowWriter extends Logging

    Permalink

    Will write io.eel Rows out to a given path using an underlying apache parquet writer.

  3. case class ParquetSink(path: Path)(implicit fs: FileSystem) extends Sink with Logging with Product with Serializable

    Permalink
  4. case class ParquetSource(pattern: FilePattern)(implicit fs: FileSystem) extends Source with Logging with Using with Product with Serializable

    Permalink

Value Members

  1. object ParquetLogMute

    Permalink
  2. object ParquetReaderFn extends Logging

    Permalink

    Helper function to create a parquet reader, using the apache parquet library.

    Helper function to create a parquet reader, using the apache parquet library. The reader supports optional predicate (for row level filtering) and a projection schema (for column level filtering).

  3. object ParquetRowIterator

    Permalink

    Creates an Iterator[Row] that will return a Row object for each GenericRecord contained in the parquet reader.

    Creates an Iterator[Row] that will return a Row object for each GenericRecord contained in the parquet reader. The Row objects returned will have the same schema as defined in the parquet records.

  4. object ParquetSource extends Serializable

    Permalink
  5. object ParquetWriterFn extends Logging

    Permalink

    Helper function for create a ParquetWriter using the apache parquet library.

    Helper function for create a ParquetWriter using the apache parquet library. Uses config keys to support compression codec, page size, and block size.

Ungrouped