com.spotify.scio.testing

PipelineTestUtils

trait PipelineTestUtils extends AnyRef

Trait with utility methods for unit testing pipelines.

Linear Supertypes
AnyRef, Any
Known Subclasses
Ordering
  1. Alphabetic
  2. By inheritance
Inherited
  1. PipelineTestUtils
  2. AnyRef
  3. Any
  1. Hide All
  2. Show all
Learn more about member selection
Visibility
  1. Public
  2. All

Value Members

  1. final def !=(arg0: AnyRef): Boolean

    Definition Classes
    AnyRef
  2. final def !=(arg0: Any): Boolean

    Definition Classes
    Any
  3. final def ##(): Int

    Definition Classes
    AnyRef → Any
  4. final def ==(arg0: AnyRef): Boolean

    Definition Classes
    AnyRef
  5. final def ==(arg0: Any): Boolean

    Definition Classes
    Any
  6. final def asInstanceOf[T0]: T0

    Definition Classes
    Any
  7. def clone(): AnyRef

    Attributes
    protected[java.lang]
    Definition Classes
    AnyRef
    Annotations
    @throws( ... )
  8. final def eq(arg0: AnyRef): Boolean

    Definition Classes
    AnyRef
  9. def equals(arg0: Any): Boolean

    Definition Classes
    AnyRef → Any
  10. def finalize(): Unit

    Attributes
    protected[java.lang]
    Definition Classes
    AnyRef
    Annotations
    @throws( classOf[java.lang.Throwable] )
  11. final def getClass(): Class[_]

    Definition Classes
    AnyRef → Any
  12. def hashCode(): Int

    Definition Classes
    AnyRef → Any
  13. final def isInstanceOf[T0]: Boolean

    Definition Classes
    Any
  14. final def ne(arg0: AnyRef): Boolean

    Definition Classes
    AnyRef
  15. final def notify(): Unit

    Definition Classes
    AnyRef
  16. final def notifyAll(): Unit

    Definition Classes
    AnyRef
  17. def runWithContext[T](fn: (ScioContext) ⇒ T): ScioResult

    Test pipeline components with a ScioContext.

    Test pipeline components with a ScioContext.

    fn

    code that tests the components and verifies the result

    runWithContext { sc =>
    sc.parallelize(Seq(1, 2, 3)).sum should containSingleValue (6)
    }
  18. def runWithData[T1, T2, T3, T4, U](data1: Iterable[T1], data2: Iterable[T2], data3: Iterable[T3], data4: Iterable[T4])(fn: (SCollection[T1], SCollection[T2], SCollection[T3], SCollection[T4]) ⇒ SCollection[U])(implicit arg0: ClassTag[T1], arg1: ClassTag[T2], arg2: ClassTag[T3], arg3: ClassTag[T4], arg4: ClassTag[U]): Seq[U]

    Test pipeline components with in-memory data.

    Test pipeline components with in-memory data.

    Input data is passed to fn as SCollections and the result SCollection from fn is extracted and to be verified.

    data1

    input data

    data2

    input data

    data3

    input data

    data4

    input data

    fn

    transform to be tested

    returns

    output data

  19. def runWithData[T1, T2, T3, U](data1: Iterable[T1], data2: Iterable[T2], data3: Iterable[T3])(fn: (SCollection[T1], SCollection[T2], SCollection[T3]) ⇒ SCollection[U])(implicit arg0: ClassTag[T1], arg1: ClassTag[T2], arg2: ClassTag[T3], arg3: ClassTag[U]): Seq[U]

    Test pipeline components with in-memory data.

    Test pipeline components with in-memory data.

    Input data is passed to fn as SCollections and the result SCollection from fn is extracted and to be verified.

    data1

    input data

    data2

    input data

    data3

    input data

    fn

    transform to be tested

    returns

    output data

  20. def runWithData[T1, T2, U](data1: Iterable[T1], data2: Iterable[T2])(fn: (SCollection[T1], SCollection[T2]) ⇒ SCollection[U])(implicit arg0: ClassTag[T1], arg1: ClassTag[T2], arg2: ClassTag[U]): Seq[U]

    Test pipeline components with in-memory data.

    Test pipeline components with in-memory data.

    Input data is passed to fn as SCollections and the result SCollection from fn is extracted and to be verified.

    data1

    input data

    data2

    input data

    fn

    transform to be tested

    returns

    output data

  21. def runWithData[T, U](data: Iterable[T])(fn: (SCollection[T]) ⇒ SCollection[U])(implicit arg0: ClassTag[T], arg1: ClassTag[U]): Seq[U]

    Test pipeline components with in-memory data.

    Test pipeline components with in-memory data.

    Input data is passed to fn as an SCollection and the result SCollection from fn is extracted and to be verified.

    data

    input data

    fn

    transform to be tested

    returns

    output data

    runWithData(Seq(1, 2, 3)) { p =>
      p.sum
    } should equal (Seq(6))
  22. final def synchronized[T0](arg0: ⇒ T0): T0

    Definition Classes
    AnyRef
  23. def toString(): String

    Definition Classes
    AnyRef → Any
  24. final def wait(): Unit

    Definition Classes
    AnyRef
    Annotations
    @throws( ... )
  25. final def wait(arg0: Long, arg1: Int): Unit

    Definition Classes
    AnyRef
    Annotations
    @throws( ... )
  26. final def wait(arg0: Long): Unit

    Definition Classes
    AnyRef
    Annotations
    @throws( ... )

Inherited from AnyRef

Inherited from Any

Ungrouped