SparkTestDsOps

Value Members

1. final def !=(arg0: Any): Boolean

   

   Definition Classes

   AnyRef → Any

2. final def ##(): Int

   

   Definition Classes

   AnyRef → Any

3. final def ==(arg0: Any): Boolean

   

   Definition Classes

   AnyRef → Any

4. final def asInstanceOf[T0]: T0

   

   Definition Classes

   Any

5. def assertApproxEquals(otherDs: Dataset[T], approx: Double): Unit

   

   Approximate comparison between two Datasets, can be customized using the Spark-Test configuration If the Datasets match the instances of Double, Float, or Timestamp, 'approx' will be used to compare an approximate equality of the two DSs.

   Approximate comparison between two Datasets, can be customized using the Spark-Test configuration If the Datasets match the instances of Double, Float, or Timestamp, 'approx' will be used to compare an approximate equality of the two DSs.

   otherDs

   Dataset to compare to

   approx

   double for the approximate comparison. If the absolute value of the difference between two values is less than approx, then the two values are considered equal.

6. def assertContains(values: T*): Unit

   

   Check if all values are present into the dataset.

   Check if all values are present into the dataset. If not, return a AssertionError.

   values

   values that should be in the dataset

7. def assertEquals(seq: Seq[T]): Unit

   

   Verify if the Dataset and Sequence are equals, can be customized using the Spark-Test configuration

   Verify if the Dataset and Sequence are equals, can be customized using the Spark-Test configuration

   seq

   Sequence to compare to

   returns

   an exception if the Dataset and the Sequence are not equals

8. def assertEquals[B](otherDs: Dataset[B])(implicit encB: Encoder[B]): Unit

   

   Comparison between two Datasets, can be customized using the Spark-Test configuration

   Comparison between two Datasets, can be customized using the Spark-Test configuration

   otherDs

   Dataset to compare to

   returns

   an exception if both Datasets are not equals

9. def clone(): AnyRef

   

   Attributes

   protected[java.lang]

   Definition Classes

   AnyRef

   Annotations

   @throws( ... )

10. final def eq(arg0: AnyRef): Boolean

    

    Definition Classes

    AnyRef

11. def equals(arg0: Any): Boolean

    

    Definition Classes

    AnyRef → Any

12. def finalize(): Unit

    

    Attributes

    protected[java.lang]

    Definition Classes

    AnyRef

    Annotations

    @throws( classOf[java.lang.Throwable] )

13. final def getClass(): Class[_]

    

    Definition Classes

    AnyRef → Any

14. def hashCode(): Int

    

    Definition Classes

    AnyRef → Any

15. final def isInstanceOf[T0]: Boolean

    

    Definition Classes

    Any

16. final def ne(arg0: AnyRef): Boolean

    

    Definition Classes

    AnyRef

17. final def notify(): Unit

    

    Definition Classes

    AnyRef

18. final def notifyAll(): Unit

    

    Definition Classes

    AnyRef

19. def shouldExist(expr: String): Unit

    

    Check if at least one row from the Dataset match the sql expression.

    Check if at least one row from the Dataset match the sql expression. If not, return a SparkTestError.

    expr

    expression to match

20. def shouldExist(pred: (T) ⇒ Boolean): Unit

    

    Check if at least one row from the Dataset match the predicate.

    Check if at least one row from the Dataset match the predicate. If not, return a SparkTestError.

    pred

    predicate to match

21. def shouldForAll(expr: String): Unit

    

    Check if all the rows from the Dataset match the sql expression.

    Check if all the rows from the Dataset match the sql expression. If not, return a SparkTestError.

    expr

    expression to match

22. def shouldForAll(pred: (T) ⇒ Boolean): Unit

    

    Check if all the rows from the Dataset match the predicate.

    Check if all the rows from the Dataset match the predicate. If not, return a SparkTestError.

    pred

    predicate to match

23. final def synchronized[T0](arg0: ⇒ T0): T0

    

    Definition Classes

    AnyRef

24. def toString(): String

    

    Definition Classes

    AnyRef → Any

25. final def wait(): Unit

    

    Definition Classes

    AnyRef

    Annotations

    @throws( ... )

26. final def wait(arg0: Long, arg1: Int): Unit

    

    Definition Classes

    AnyRef

    Annotations

    @throws( ... )

27. final def wait(arg0: Long): Unit

    

    Definition Classes

    AnyRef

    Annotations

    @throws( ... )