ParquetAvroScioContext

Value Members

1. final def !=(arg0: Any): Boolean

   

   Definition Classes

   Any

2. final def ##(): Int

   

   Definition Classes

   Any

3. final def ==(arg0: Any): Boolean

   

   Definition Classes

   Any

4. final def asInstanceOf[T0]: T0

   

   Definition Classes

   Any

5. def getClass(): Class[_ <: AnyVal]

   

   Definition Classes

   AnyVal → Any

6. final def isInstanceOf[T0]: Boolean

   

   Definition Classes

   Any

7. def parquetAvroFile[T <: SpecificRecordBase](path: String, projection: Schema = null, predicate: FilterPredicate = null)(implicit arg0: ClassTag[T]): ParquetAvroFile[T]

   

   Get an SCollection for a Parquet file as Avro records.

   Get an SCollection for a Parquet file as Avro records. Since Avro records produced by Parquet column projection may be incomplete and may fail serialization, you must map the result to extract projected fields from the Avro records.

   Note that due to limitations of the underlying HadoopInputFormatIO, Avro GenericRecord and dynamic work rebalancing are not supported. Without the latter, pipelines may not autoscale up or down during the initial read and subsequent fused transforms.

8. val self: ScioContext

   

9. def toString(): String

   

   Definition Classes

   Any