Coder
Related Docs:
trait Coder
| package coders
Create a Coder for Avro GenericRecord given the schema of the GenericRecord.
Create a Coder for Avro GenericRecord given the schema of the GenericRecord.
AvroSchema for the Coder.
Coder[GenericRecord]
Create a ScioCoder from a Beam Coder
Create a ScioCoder from a Beam Coder
Derive a Coder for a type T given implicit coders of all parameters in the constructor of type T is in scope.
Derive a Coder for a type T given implicit coders of all parameters in the constructor of type T is in scope. For sealed trait, implicit coders of parameters of the constructors of all sub-types should be in scope.
In case of a missing shapeless.LowPriority implicit error when calling this method as , it means that Scio is unable to derive a BeamCoder for some parameter [P] in the constructor of Type. This happens when no implicit Coder instance for type P is in scope. This is fixed by placing an implicit Coder of type P in scope, using or defining the Coder manually (see also Coder.xmap)
Create an instance of Kryo Coder for a given Type.
Create an instance of Kryo Coder for a given Type.
Eg: A kryo Coder for org.joda.time.Interval would look like:
implicit def jiKryo: Coder[Interval] = Coder.kryo[Interval]
Given a Coder[A], create a Coder[B] by defining two functions A => B and B => A.
Given a Coder[A], create a Coder[B] by defining two functions A => B and B => A. The Coder[A] can be resolved implicitly by calling Coder[A]
Eg: Coder for org.joda.time.Interval can be defined by having the following implicit in scope. Without this implicit in scope Coder derivation falls back to Kryo.
implicit def jiCoder: Coder[Interval] = Coder.xmap(Coder[(Long, Long)])(t => new Interval(t._1, t._2), i => (i.getStartMillis, i.getEndMillis))
In the above example we implicitly derive Coder[(Long, Long)] and we define two functions, one to convert a tuple (Long, Long) to Interval, and a second one to convert an Interval to a tuple of (Long, Long)