values

Type Members

1. sealed trait DistCache[F] extends Serializable

   

   Encapsulate arbitrary data that can be distributed to all workers.

   Encapsulate arbitrary data that can be distributed to all workers. Similar to Hadoop distributed cache.

2. class DoubleSCollectionFunctions extends AnyRef

   

   Extra functions available on SCollections of Doubles through an implicit conversion.

3. class PairHashSCollectionFunctions[K, V] extends AnyRef

   

   Extra functions available on SCollections of (key, value) pairs for hash based joins through an implicit conversion.

4. class PairSCollectionFunctions[K, V] extends AnyRef

   

   Extra functions available on SCollections of (key, value) pairs through an implicit conversion.

5. class PairSkewedSCollectionFunctions[K, V] extends AnyRef

   

   Extra functions available on SCollections of (key, value) pairs for skwed joins through an implicit conversion.

6. sealed trait SCollection[T] extends PCollectionWrapper[T]

   

   A Scala wrapper for PCollection.

   A Scala wrapper for PCollection. Represents an immutable, partitioned collection of elements that can be operated on in parallel. This class contains the basic operations available on all SCollections, such as map, filter, and sum. In addition, PairSCollectionFunctions contains operations available only on SCollections of key-value pairs, such as groupByKey and join; DoubleSCollectionFunctions contains operations available only on SCollections of Doubles.

7. class SCollectionWithFanout[T] extends PCollectionWrapper[T]

   

   An enhanced SCollection that uses an intermediate node to combine parts of the data to reduce load on the final global combine step.

8. class SCollectionWithHotKeyFanout[K, V] extends TransformNameable

   

   An enhanced SCollection that uses an intermediate node to combine "hot" keys partially before performing the full combine.

9. class SCollectionWithSideInput[T] extends PCollectionWrapper[T]

   

   An enhanced SCollection that provides access to one or more SideInputs for some transforms.

   An enhanced SCollection that provides access to one or more SideInputs for some transforms. SideInputs are accessed via the additional SideInputContext argument.

10. class SCollectionWithSideOutput[T] extends PCollectionWrapper[T]

    

    An enhanced SCollection that provides access to one or more SideOutputs for some transforms.

    An enhanced SCollection that provides access to one or more SideOutputs for some transforms. SideOutputs are accessed via the additional SideOutputContext argument. SCollections of the SideOutputs are accessed via the additional SideOutputCollections return value.

11. trait SideInput[T] extends Serializable

    

    Encapsulate an SCollection when it is being used as a side input.

12. class SideInputContext[T] extends AnyRef

    

    Encapsulate context of one or more SideInputs in an SCollectionWithSideInput.

13. sealed trait SideOutput[T] extends Serializable

    

    Encapsulate a side output for a transform.

14. class SideOutputCollections extends AnyRef

    

    Encapsulate output of one or more SideOutputs in an SCollectionWithSideOutput.

15. class SideOutputContext[T] extends AnyRef

    

    Encapsulate context of one or more SideOutputs in an SCollectionWithSideOutput.

16. trait TransformNameable extends AnyRef

    

    Trait for setting custom names on transforms.

17. case class WindowOptions(trigger: Trigger = null, accumulationMode: AccumulationMode = null, allowedLateness: Duration = null, closingBehavior: ClosingBehavior = null, timestampCombiner: TimestampCombiner = null) extends Product with Serializable

    

    Window options for an SCollection.

18. class WindowedSCollection[T] extends PCollectionWrapper[T]

    

    An enhanced SCollection that provides access to window information via WindowedValue.

19. case class WindowedValue[T](value: T, timestamp: Instant, window: BoundedWindow, pane: PaneInfo) extends Product with Serializable

    

    Value with window information to be used inside a WindowedSCollection.

20. case class SideMap[K, V](side: SideInput[Map[K, ArrayBuffer[V]]]) extends Product with Serializable

    

    Annotations

    @deprecated

    Deprecated

    (Since version 0.8.0) Use SCollection[(K, V)]#asMultiMapSideInput instead

21. case class SideSet[T](side: SideInput[Set[T]]) extends Product with Serializable

    

    Annotations

    @deprecated

    Deprecated

    (Since version 0.8.0) Use SCollection[T]#asSetSingletonSideInput instead