avro

Type Members

1. class ArraySerializer extends AvroSerializer

   

2. class AvroDeserializer extends AnyRef

   

   Returns an row from the given avro record using the schema present in the record.

   Returns an row from the given avro record using the schema present in the record. The row values will be created in the order that the record schema fields are declared.

3. trait AvroSerializer extends AnyRef

   

   Serializes JVM types into the suitable Avro type.

   Serializes JVM types into the suitable Avro type.

   Rows are serialized into records Scala collections are serialized into arrays Options into nulls.

   Also, if you have an Avro Boolean field, you can't use a String "true" but it must be boolean true. So it's less "forgiving" than JDBC for example which will do the automatic conversion for you. This serializer allows it.

4. case class AvroSink(path: Path, overwrite: Boolean = false, permission: Option[FsPermission] = None, inheritPermissions: Option[Boolean] = None)(implicit conf: Configuration, fs: FileSystem) extends Sink with Product with Serializable

   

5. case class AvroSource(path: Path)(implicit conf: Configuration, fs: FileSystem) extends Source with Using with Product with Serializable

   

6. case class AvroSourcePublisher(path: Path)(implicit conf: Configuration, fs: FileSystem) extends Publisher[Seq[Row]] with Logging with Using with Product with Serializable

   

7. class AvroWriter extends AnyRef

   

8. class MapSerializer extends AvroSerializer

   

9. class OptionSerializer extends AvroSerializer

   

10. class RowSerializer extends AvroSerializer

    

    Marshalls rows as avro records using the given schema.