scheme

Type Members

1. class BooleanConverter extends PrimitiveConverter with PrimitiveFieldConverter[Boolean]

   

2. class ByteConverter extends PrimitiveConverter with PrimitiveFieldConverter[Byte]

   

3. trait CollectionConverter[T] extends AnyRef

   

   Collection field converter, such as list(Scala Option is also seen as a collection).

   Collection field converter, such as list(Scala Option is also seen as a collection).

   T

   collection element type(can be primitive types or nested types)

4. abstract class CollectionElementGroupConverter[T] extends GroupConverter with TupleFieldConverter[T]

   

   A wrapper of group converters for modeling group type element in a collection

   A wrapper of group converters for modeling group type element in a collection

   T

   group tuple type(can be a collection type, such as list)

5. abstract class CollectionElementPrimitiveConverter[T] extends PrimitiveConverter with TupleFieldConverter[T]

   

   A wrapper of primitive converters for modeling primitive fields in a collection

   A wrapper of primitive converters for modeling primitive fields in a collection

   T

   primitive types (String, Double, Float, Long, Int, Short, Byte, Boolean)

6. class DoubleConverter extends PrimitiveConverter with PrimitiveFieldConverter[Double]

   

7. class FloatConverter extends PrimitiveConverter with PrimitiveFieldConverter[Float]

   

8. class IntConverter extends PrimitiveConverter with PrimitiveFieldConverter[Int]

   

9. abstract class ListConverter[T] extends GroupConverter with TupleFieldConverter[List[T]] with CollectionConverter[T]

   

   List converter for modeling list field

   List converter for modeling list field

   T

   list element type(can be primitive types or nested types)

10. class LongConverter extends PrimitiveConverter with PrimitiveFieldConverter[Long]

    

11. abstract class MapConverter[K, V] extends GroupConverter with TupleFieldConverter[Map[K, V]] with CollectionConverter[(K, V)]

    

    Map converter for modeling map field

    Map converter for modeling map field

    K

    map key type

    V

    map value type

12. abstract class MapKeyValueConverter[K, V] extends CollectionElementGroupConverter[(K, V)]

    

13. abstract class OptionConverter[T] extends Converter with TupleFieldConverter[Option[T]] with CollectionConverter[T]

    

    Option converter for modeling option field

    Option converter for modeling option field

    T

    option element type(can be primitive types or nested types)

14. class ParquetOutputFormatFromWriteSupportInstance[T] extends ParquetOutputFormat[T]

    

15. abstract class ParquetReadSupport[T] extends ReadSupport[T] with Serializable

    

    Parquet read support used by org.apache.parquet.hadoop.ParquetInputFormat to read values from parquet input.

    Parquet read support used by org.apache.parquet.hadoop.ParquetInputFormat to read values from parquet input. User must define record schema and parquet tuple converter that permits to convert parquet tuple to user defined type For case class types, we provide a macro to generate the schema and read support: com.twitter.scalding.parquet.tuple.macros.Macros.caseClassParquetReadSupport

    T

    user defined value type

16. abstract class ParquetTupleConverter[T] extends GroupConverter with TupleFieldConverter[T]

    

    Parquet tuple converter used to create user defined tuple value from parquet column values

17. class ParquetTupleMaterializer[T] extends RecordMaterializer[T]

    

    Parquet tuple materializer permits to create user defined type record from parquet tuple values

    Parquet tuple materializer permits to create user defined type record from parquet tuple values

    T

    User defined value type

18. abstract class ParquetWriteSupport[T] extends WriteSupport[T] with Serializable

    

    Parquet write support used by org.apache.parquet.hadoop.ParquetOutputFormat to write values to parquet output.

    Parquet write support used by org.apache.parquet.hadoop.ParquetOutputFormat to write values to parquet output. User must provide record schema and a function which permits to write a used defined case class to parquet store with the record consumer and schema definition.

    For case class value types, we provide a macro to generate the write support, please check com.twitter.scalding.parquet.tuple.macros.Macros.caseClassParquetWriteSupport

    T

    user defined value type

19. trait PrimitiveFieldConverter[T] extends PrimitiveConverter with TupleFieldConverter[T]

    

    Primitive fields converter

    Primitive fields converter

    T

    primitive types (String, Double, Float, Long, Int, Short, Byte, Boolean)

20. class ReadSupportInstanceProxy[T] extends ReadSupport[T]

    

21. abstract class SetConverter[T] extends GroupConverter with TupleFieldConverter[Set[T]] with CollectionConverter[T]

    

    Set converter for modeling set field

    Set converter for modeling set field

    T

    list element type(can be primitive types or nested types)

22. class ShortConverter extends PrimitiveConverter with PrimitiveFieldConverter[Short]

    

23. class StringConverter extends PrimitiveConverter with PrimitiveFieldConverter[String]

    

24. trait TupleFieldConverter[+T] extends Converter with Serializable

    

25. class TypedParquetTupleScheme[T] extends Scheme[JobConf, RecordReader[AnyRef, Container[T]], OutputCollector[AnyRef, T], Array[AnyRef], Array[AnyRef]]

    

    Typed parquet tuple scheme.

    Typed parquet tuple scheme.

    T

    tuple value type