Package

com.twitter.scalding.parquet

scrooge

Permalink

package scrooge

Visibility
  1. Public
  2. All

Type Members

  1. class DailySuffixParquetScrooge[T <: ThriftStruct] extends DailySuffixSource with ParquetScrooge[T]

    Permalink
  2. class FixedPathParquetScrooge[T <: ThriftStruct] extends FixedPathSource with ParquetScrooge[T]

    Permalink
  3. class HourlySuffixParquetScrooge[T <: ThriftStruct] extends HourlySuffixSource with ParquetScrooge[T]

    Permalink
  4. class Parquet346ScroogeRecordConverter[T <: ThriftStruct] extends ThriftRecordConverter[T]

    Permalink

    Same as ScroogeRecordConverter with one important (subtle) difference.

    Same as ScroogeRecordConverter with one important (subtle) difference. It passes a repaired schema (StructType) to ThriftRecordConverter's constructor. This is important because older files don't contain all the metadata needed for ThriftSchemaConverter to not throw, but we can put dummy data in there because it's not actually used.

  5. class Parquet346ScroogeScheme[T <: ThriftStruct] extends ParquetScroogeScheme[T]

    Permalink

    The same as ParquetScroogeScheme, but sets the record convert to Parquet346ScroogeRecordConverter

  6. trait ParquetScrooge[T <: ThriftStruct] extends FileSource with ParquetThriftBase[T]

    Permalink
  7. class ParquetScroogeInputFormat[T] extends ParquetThriftInputFormat[T]

    Permalink
  8. class ParquetScroogeOutputFormat[T <: ThriftStruct] extends ParquetOutputFormat[T]

    Permalink
  9. class ParquetScroogeScheme[T <: ThriftStruct] extends ParquetValueScheme[T]

    Permalink
  10. class ScroogeReadSupport[T] extends ThriftReadSupport[T]

    Permalink
  11. class ScroogeRecordConverter[T <: ThriftStruct] extends ThriftRecordConverter[T]

    Permalink
  12. class ScroogeStructConverter extends AnyRef

    Permalink
  13. class ScroogeWriteSupport[T <: ThriftStruct] extends AbstractThriftWriteSupport[T]

    Permalink

Value Members

  1. object Parquet346ScroogeRecordConverter

    Permalink

Ungrouped