Feed command line arguments to the pipeline being tested.
Evaluate a Counter in the pipeline being tested.
Evaluate a Counter in the pipeline being tested.
counter to be evaluated
assertion for the counter result's committed value
Feed an distributed cache to the pipeline being tested.
Feed an distributed cache to the pipeline being tested. Note that DistCacheIO[T]
must
match the one used inside the pipeline, e.g. DistCacheIO[Set[String]]("dc.txt")
with
sc.distCache("dc.txt")(f => scala.io.Source.fromFile(f).getLines().toSet)
.
mock value, must be serializable.
Feed an distributed cache to the pipeline being tested.
Feed an distributed cache to the pipeline being tested. Note that DistCacheIO[T]
must
match the one used inside the pipeline, e.g. DistCacheIO[Set[String]]("dc.txt")
with
sc.distCache("dc.txt")(f => scala.io.Source.fromFile(f).getLines().toSet)
.
init function, must be serializable.
Evaluate a Distribution in the pipeline being tested.
Evaluate a Distribution in the pipeline being tested.
distribution to be evaluated
assertion for the distribution result's committed value
Evaluate a Gauge in the pipeline being tested.
Evaluate a Gauge in the pipeline being tested.
gauge to be evaluated
assertion for the gauge result's committed value
Feed an input to the pipeline being tested.
Feed an input to the pipeline being tested. Note that TestIO[T]
must match the one used
inside the pipeline, e.g. AvroIO[MyRecord]("in.avro")
with
sc.avroFile[MyRecord]("in.avro")
.
Evaluate an output of the pipeline being tested.
Evaluate an output of the pipeline being tested. Note that TestIO[T]
must match the one
used inside the pipeline, e.g. AvroIO[MyRecord]("out.avro")
with
data.saveAsAvroFile("out.avro")
where data
is of type SCollection[MyRecord]
.
assertion for output data. See SCollectionMatchers for available matchers on an SCollection.
Run the pipeline with test wiring.
Set up test wiring.
Tear down test wiring.
Test ID for input and output wiring.