values

Type Members

1. trait Accumulator[T] extends Serializable

   

   Encapsulate an accumulator, similar to Hadoop counters.

2. class AccumulatorContext extends AnyRef

   

   Encapsulate context of one or more Accumulators in an SCollectionWithAccumulator.

3. sealed trait AccumulatorType[T] extends AnyRef

   

   Type class for T that can be used in an Accumulator.

4. sealed trait DistCache[F] extends Serializable

   

   Encapsulate arbitrary data that can be distributed to all workers.

5. class DoubleSCollectionFunctions extends AnyRef

   

   Extra functions available on SCollections of Doubles through an implicit conversion.

6. class PairSCollectionFunctions[K, V] extends AnyRef

   

   Extra functions available on SCollections of (key, value) pairs through an implicit conversion.

7. sealed trait SCollection[T] extends PCollectionWrapper[T]

   

   A Scala wrapper for PCollection.

   A Scala wrapper for PCollection. Represents an immutable, partitioned collection of elements that can be operated on in parallel. This class contains the basic operations available on all SCollections, such as map, filter, and persist. In addition, PairSCollectionFunctions contains operations available only on SCollections of key-value pairs, such as groupByKey and join; DoubleSCollectionFunctions contains operations available only on SCollections of Doubles.

8. class SCollectionWithAccumulator[T] extends PCollectionWrapper[T]

   

   An enhanced SCollection that provides access to one or more Accumulators for some transforms.

   An enhanced SCollection that provides access to one or more Accumulators for some transforms. Accumulators are accessed via the additional AccumulatorContext argument.

9. class SCollectionWithFanout[T] extends PCollectionWrapper[T]

   

   An enhanced SCollection that uses an intermediate node to combine parts of the data to reduce load on the final global combine step.

10. class SCollectionWithHotKeyFanout[K, V] extends TransformNameable

    

    An enhanced SCollection that uses an intermediate node to combine "hot" keys partially before performing the full combine.

11. class SCollectionWithSideInput[T] extends PCollectionWrapper[T]

    

    An enhanced SCollection that provides access to one or more SideInputs for some transforms.

    An enhanced SCollection that provides access to one or more SideInputs for some transforms. SideInputs are accessed via the additional SideInputContext argument.

12. class SCollectionWithSideOutput[T] extends PCollectionWrapper[T]

    

    An enhanced SCollection that provides access to one or more SideOutputs for some transforms.

    An enhanced SCollection that provides access to one or more SideOutputs for some transforms. SideOutputs are accessed via the additional SideOutputContext argument. SCollections of the SideOutputs are accessed via the additional SideOutputCollections return value.

13. trait SideInput[T] extends Serializable

    

    Encapsulate an SCollection when it is being used as a side input.

14. class SideInputContext[T] extends AnyRef

    

    Encapsulate context of one or more SideInputs in an SCollectionWithSideInput.

15. trait SideOutput[T] extends Serializable

    

    Encapsulate a side output for a transform.

16. class SideOutputCollections extends AnyRef

    

    Encapsulate output of one or more SideOutputs in an SCollectionWithSideOutput.

17. class SideOutputContext[T] extends AnyRef

    

    Encapsulate context of one or more SideOutputs in an SCollectionWithSideOutput.

18. trait TransformNameable extends AnyRef

    

    Trait for setting custom names on transforms.

19. case class WindowOptions[W <: BoundedWindow](trigger: TriggerBuilder[W] = null, accumulationMode: AccumulationMode = null, allowedLateness: Duration = null, closingBehavior: ClosingBehavior = null, outputTimeFn: OutputTimeFn[BoundedWindow] = null) extends Product with Serializable

    

20. class WindowedSCollection[T] extends PCollectionWrapper[T]

    

21. case class WindowedValue[T](value: T, timestamp: Instant, window: BoundedWindow, pane: PaneInfo) extends Product with Serializable