com.spotify.scio

values

package values

Visibility
  1. Public
  2. All

Type Members

  1. trait Accumulator[T] extends Serializable

    Encapsulate an accumulator, similar to Hadoop counters.

  2. class AccumulatorContext extends AnyRef

    Encapsulate context of one or more Accumulators in an SCollectionWithAccumulator.

  3. sealed trait AccumulatorType[T] extends AnyRef

    Type class for T that can be used in an Accumulator.

  4. sealed trait DistCache[F] extends Serializable

    Encapsulate arbitrary data that can be distributed to all workers.

  5. class DoubleSCollectionFunctions extends AnyRef

    Extra functions available on SCollections of Doubles through an implicit conversion.

  6. class PairSCollectionFunctions[K, V] extends AnyRef

    Extra functions available on SCollections of (key, value) pairs through an implicit conversion.

  7. sealed trait SCollection[T] extends PCollectionWrapper[T]

    A Scala wrapper for PCollection.

  8. class SCollectionWithAccumulator[T] extends PCollectionWrapper[T]

    An enhanced SCollection that provides access to one or more Accumulators for some transforms.

  9. class SCollectionWithFanout[T] extends PCollectionWrapper[T]

    An enhanced SCollection that uses an intermediate node to combine parts of the data to reduce load on the final global combine step.

  10. class SCollectionWithHotKeyFanout[K, V] extends AnyRef

    An enhanced SCollection that uses an intermediate node to combine "hot" keys partially before performing the full combine.

  11. class SCollectionWithSideInput[T] extends PCollectionWrapper[T]

    An enhanced SCollection that provides access to one or more SideInputs for some transforms.

  12. class SCollectionWithSideOutput[T] extends PCollectionWrapper[T]

    An enhanced SCollection that provides access to one or more SideOutputs for some transforms.

  13. trait SideInput[T] extends Serializable

    Encapsulate an SCollection when it is being used as a side input.

  14. class SideInputContext[T] extends AnyRef

    Encapsulate context of one or more SideInputs in an SCollectionWithSideInput.

  15. trait SideOutput[T] extends Serializable

    Encapsulate a side output for a transform.

  16. class SideOutputCollections extends AnyRef

    Encapsulate output of one or more SideOutputs in an SCollectionWithSideOutput.

  17. class SideOutputContext[T] extends AnyRef

    Encapsulate context of one or more SideOutputs in an SCollectionWithSideOutput.

  18. case class WindowOptions[W <: BoundedWindow](trigger: TriggerBuilder[W] = null, accumulationMode: AccumulationMode = null, allowedLateness: Duration = null, closingBehavior: ClosingBehavior = null, outputTimeFn: OutputTimeFn[BoundedWindow] = null) extends Product with Serializable

  19. class WindowedSCollection[T] extends PCollectionWrapper[T]

  20. case class WindowedValue[T](value: T, timestamp: Instant, window: BoundedWindow, pane: PaneInfo) extends Product with Serializable

Value Members

  1. object MockDistCache extends Serializable

  2. object SCollection

    Convenience functions for creating SCollections.

  3. object SideOutput extends Serializable

    Companion object for SideOutput.

Ungrouped