avro

Type Members

1. sealed trait AvroIO[T] extends ScioIO[T]

   

2. final case class AvroTaps(self: Taps) extends Product with Serializable

   

3. final case class GenericRecordIO(path: String, schema: Schema) extends AvroIO[GenericRecord] with Product with Serializable

   

4. final case class GenericRecordParseIO[T](path: String, parseFn: (GenericRecord) ⇒ T)(implicit coder: Coder[T]) extends AvroIO[T] with Product with Serializable

   

   Given a parseFn, read GenericRecord and apply a function mapping => T before producing output.

   Given a parseFn, read GenericRecord and apply a function mapping => T before producing output. This IO applies the function at the time of de-serializing Avro GenericRecords.

   This IO doesn't define write, and should not be used to write Avro GenericRecords.

5. final case class GenericRecordParseTap[T](path: String, parseFn: (GenericRecord) ⇒ T)(implicit evidence$4: Coder[T]) extends Tap[T] with Product with Serializable

   

   Tap for reading GenericRecord Avro files and applying a parseFn to parse it to the given type T

6. final case class GenericRecordTap(path: String, schema: Schema) extends Tap[GenericRecord] with Product with Serializable

   

   Tap for GenericRecord Avro files.

7. final case class ObjectFileIO[T](path: String)(implicit evidence$1: Coder[T]) extends ScioIO[T] with Product with Serializable

   

8. case class ObjectFileTap[T](path: String)(implicit evidence$5: Coder[T]) extends Tap[T] with Product with Serializable

   

   Tap for object files.

   Tap for object files. Note that serialization is not guaranteed to be compatible across Scio releases.

9. final case class ProtobufIO[T <: Message](path: String)(implicit evidence$2: ClassTag[T]) extends ScioIO[T] with Product with Serializable

   

10. final case class ReflectiveRecordTap[T](path: String, schema: Schema)(implicit evidence$1: Coder[T]) extends Tap[T] with Product with Serializable

    

    Tap for GenericRecord Avro files.

11. final case class SpecificRecordIO[T <: SpecificRecord](path: String)(implicit evidence$3: ClassTag[T], evidence$4: Coder[T]) extends AvroIO[T] with Product with Serializable

    

12. final case class SpecificRecordTap[T <: SpecificRecord](path: String)(implicit evidence$2: ClassTag[T], evidence$3: Coder[T]) extends Tap[T] with Product with Serializable

    

    Tap for SpecificRecord Avro files.

13. type doc = avro.types.doc

    

    Annotation for Avro field and record documentation.

14. final case class ReflectiveRecordIO[T](path: String, schema: Schema)(implicit evidence$5: Coder[T]) extends AvroIO[T] with Product with Serializable

    

    Annotations

    @deprecated

    Deprecated

    (Since version 0.8.0) The use of reflective records is discouraged. Consider converting to GenericRecord explicitly