Add artifact to stage in workers.
Add artifact to stage in workers. Artifact can be jar/text-files etc. NOTE: currently one can only add artifacts before pipeline object is created.
Apply a PTransform and wrap the output in an SCollection.
Get an SCollection for an Avro file.
Get an SCollection for a BigQuery SELECT query.
Get an SCollection for a BigQuery table.
Get an SCollection for a BigQuery table.
Close the context.
Close the context. No operation can be performed once the context is closed.
Get an SCollection for a Datastore query.
Whether the context is closed.
Create a new Accumulator that keeps track of the maximum value.
Create a new Accumulator that keeps track of the maximum value. See SCollection.withAccumulator for examples.
Create a new Accumulator that keeps track of the minimum value.
Create a new Accumulator that keeps track of the minimum value. See SCollection.withAccumulator for examples.
Get an SCollection for an object file.
Get PipelineOptions as a more specific sub-type.
Distribute a local Scala Map to form an SCollection.
Distribute a local Scala Iterable to form an SCollection.
Distribute a local Scala Iterable with timestamps to form an SCollection.
Distribute a local Scala Iterable with timestamps to form an SCollection.
Underlying pipeline.
Get an SCollection for a Protobuf file.
Get an SCollection for a Pub/Sub subscription.
Get an SCollection for a Pub/Sub topic.
Set name for the context.
Create a new Accumulator that keeps track of the sum of values.
Create a new Accumulator that keeps track of the sum of values. See SCollection.withAccumulator for examples.
Get an SCollection of TableRow for a JSON file.
Get an SCollection for a text file.
Wrap a PCollection.
Main entry point for Scio functionality. A ScioContext represents a pipeline and can be used to create SCollections and distributed caches on that cluster.