Class

com.spotify.scio.testing.JobTest

Builder

Related Doc: package JobTest

Permalink

class Builder extends AnyRef

Linear Supertypes
Ordering
  1. Alphabetic
  2. By Inheritance
Inherited
  1. Builder
  2. AnyRef
  3. Any
  1. Hide All
  2. Show All
Visibility
  1. Public
  2. All

Instance Constructors

  1. new Builder(state: BuilderState)

    Permalink

Value Members

  1. final def !=(arg0: Any): Boolean

    Permalink
    Definition Classes
    AnyRef → Any
  2. final def ##(): Int

    Permalink
    Definition Classes
    AnyRef → Any
  3. final def ==(arg0: Any): Boolean

    Permalink
    Definition Classes
    AnyRef → Any
  4. def args(newArgs: String*): Builder

    Permalink

    Feed command line arguments to the pipeline being tested.

  5. final def asInstanceOf[T0]: T0

    Permalink
    Definition Classes
    Any
  6. def clone(): AnyRef

    Permalink
    Attributes
    protected[java.lang]
    Definition Classes
    AnyRef
    Annotations
    @throws( ... )
  7. def counter(counter: Counter)(assertion: (Long) ⇒ Any): Builder

    Permalink

    Evaluate a Counter in the pipeline being tested.

    Evaluate a Counter in the pipeline being tested.

    counter

    counter to be evaluated

    assertion

    assertion for the counter result's committed value

  8. def counters(assertion: (Map[MetricName, Long]) ⇒ Any): Builder

    Permalink

    Evaluate all Counters in the pipeline being tested.

    Evaluate all Counters in the pipeline being tested.

    assertion

    assertion on the collection of all job counters' committed values

  9. def distCache[T](key: DistCacheIO[T], value: T): Builder

    Permalink

    Feed an distributed cache to the pipeline being tested.

    Feed an distributed cache to the pipeline being tested. Note that DistCacheIO[T] must match the one used inside the pipeline, e.g. DistCacheIO[Set[String]]("dc.txt") with sc.distCache("dc.txt")(f => scala.io.Source.fromFile(f).getLines().toSet).

    value

    mock value, must be serializable.

  10. def distCacheFunc[T](key: DistCacheIO[T], initFn: () ⇒ T): Builder

    Permalink

    Feed an distributed cache to the pipeline being tested.

    Feed an distributed cache to the pipeline being tested. Note that DistCacheIO[T] must match the one used inside the pipeline, e.g. DistCacheIO[Set[String]]("dc.txt") with sc.distCache("dc.txt")(f => scala.io.Source.fromFile(f).getLines().toSet).

    initFn

    init function, must be serializable.

  11. def distribution(distribution: Distribution)(assertion: (DistributionResult) ⇒ Any): Builder

    Permalink

    Evaluate a Distribution in the pipeline being tested.

    Evaluate a Distribution in the pipeline being tested.

    distribution

    distribution to be evaluated

    assertion

    assertion for the distribution result's committed value

  12. def distributions(assertion: (Map[MetricName, DistributionResult]) ⇒ Any): Builder

    Permalink

    Evaluate all Distributions in the pipeline being tested.

    Evaluate all Distributions in the pipeline being tested.

    assertion

    assertion on the collection of all job distribution results' committed values

  13. final def eq(arg0: AnyRef): Boolean

    Permalink
    Definition Classes
    AnyRef
  14. def equals(arg0: Any): Boolean

    Permalink
    Definition Classes
    AnyRef → Any
  15. def finalize(): Unit

    Permalink
    Attributes
    protected[java.lang]
    Definition Classes
    AnyRef
    Annotations
    @throws( classOf[java.lang.Throwable] )
  16. def gauge(gauge: Gauge)(assertion: (GaugeResult) ⇒ Any): Builder

    Permalink

    Evaluate a Gauge in the pipeline being tested.

    Evaluate a Gauge in the pipeline being tested.

    gauge

    gauge to be evaluated

    assertion

    assertion for the gauge result's committed value

  17. def gauges(assertion: (Map[MetricName, GaugeResult]) ⇒ Any): Builder

    Permalink

    Evaluate all Gauges in the pipeline being tested.

    Evaluate all Gauges in the pipeline being tested.

    assertion

    assertion on the collection of all job gauge results' committed values

  18. final def getClass(): Class[_]

    Permalink
    Definition Classes
    AnyRef → Any
  19. def hashCode(): Int

    Permalink
    Definition Classes
    AnyRef → Any
  20. def input[T](io: ScioIO[T], value: Iterable[T]): Builder

    Permalink

    Feed an input in the form of a raw Iterable[T] to the pipeline being tested.

    Feed an input in the form of a raw Iterable[T] to the pipeline being tested. Note that TestIO[T] must match the one used inside the pipeline, e.g. AvroIO[MyRecord]("in.avro") with sc.avroFile[MyRecord]("in.avro").

  21. def inputStream[T](io: ScioIO[T], stream: TestStream[T]): Builder

    Permalink

    Feed an input in the form of a PTransform[PBegin, PCollection[T]] to the pipeline being tested.

    Feed an input in the form of a PTransform[PBegin, PCollection[T]] to the pipeline being tested. Note that PTransform inputs may not be supported for all TestIO[T] types.

  22. final def isInstanceOf[T0]: Boolean

    Permalink
    Definition Classes
    Any
  23. final def ne(arg0: AnyRef): Boolean

    Permalink
    Definition Classes
    AnyRef
  24. final def notify(): Unit

    Permalink
    Definition Classes
    AnyRef
  25. final def notifyAll(): Unit

    Permalink
    Definition Classes
    AnyRef
  26. def output[T](io: ScioIO[T])(assertion: (SCollection[T]) ⇒ Any): Builder

    Permalink

    Evaluate an output of the pipeline being tested.

    Evaluate an output of the pipeline being tested. Note that TestIO[T] must match the one used inside the pipeline, e.g. AvroIO[MyRecord]("out.avro") with data.saveAsAvroFile("out.avro") where data is of type SCollection[MyRecord].

    assertion

    assertion for output data. See SCollectionMatchers for available matchers on an SCollection.

  27. def run(): Unit

    Permalink

    Run the pipeline with test wiring.

  28. def setUp(): Unit

    Permalink

    Set up test wiring.

    Set up test wiring. Use this only if you have custom pipeline wiring and are bypassing run. Make sure tearDown is called afterwards.

  29. final def synchronized[T0](arg0: ⇒ T0): T0

    Permalink
    Definition Classes
    AnyRef
  30. def tearDown(): Unit

    Permalink

    Tear down test wiring.

    Tear down test wiring. Use this only if you have custom pipeline wiring and are bypassing run. Make sure setUp is called before.

  31. val testId: String

    Permalink

    Test ID for input and output wiring.

  32. def toString(): String

    Permalink
    Definition Classes
    Builder → AnyRef → Any
  33. final def wait(): Unit

    Permalink
    Definition Classes
    AnyRef
    Annotations
    @throws( ... )
  34. final def wait(arg0: Long, arg1: Int): Unit

    Permalink
    Definition Classes
    AnyRef
    Annotations
    @throws( ... )
  35. final def wait(arg0: Long): Unit

    Permalink
    Definition Classes
    AnyRef
    Annotations
    @throws( ... )

Inherited from AnyRef

Inherited from Any

Ungrouped