JavaDatasetSuiteBase

Value Members

1. final def !=(arg0: Any): Boolean

   

   Definition Classes

   AnyRef → Any

2. final def ##(): Int

   

   Definition Classes

   AnyRef → Any

3. final def ==(arg0: Any): Boolean

   

   Definition Classes

   AnyRef → Any

4. def appID(): String

   

   Definition Classes

   SharedJavaSparkContext → SparkContextProvider

5. def approxEquals(r1: Row, r2: Row, tol: Double): Boolean

   

   Definition Classes

   DataFrameSuiteBaseLike

6. final def asInstanceOf[T0]: T0

   

   Definition Classes

   Any

7. def assert[U](message: String, expected: U, actual: U)(implicit CT: ClassTag[U]): Unit

   

   Definition Classes

   JavaTestSuite → TestSuiteLike

8. def assert[U](expected: U, actual: U)(implicit CT: ClassTag[U]): Unit

   

   Definition Classes

   JavaTestSuite → TestSuiteLike

9. def assertDataFrameApproximateEquals(expected: DataFrame, result: DataFrame, tol: Double): Unit

   

   Compares if two DataFrames are equal, checks that the schemas are the same.

   Compares if two DataFrames are equal, checks that the schemas are the same. When comparing inexact fields uses tol.

   tol

   max acceptable tolerance, should be less than 1.

   Definition Classes

   DataFrameSuiteBaseLike

10. def assertDataFrameEquals(expected: DataFrame, result: DataFrame): Unit

    

    Compares if two DataFrames are equal, checks the schema and then if that matches checks if the rows are equal.

    Compares if two DataFrames are equal, checks the schema and then if that matches checks if the rows are equal.

    Definition Classes

    DataFrameSuiteBaseLike

11. def assertDatasetApproximateEquals[U](expected: Dataset[U], result: Dataset[U], tol: Double): Unit

    

    Compares if two Datasets are equal, Datasets should have the same type.

    Compares if two Datasets are equal, Datasets should have the same type. When comparing inexact fields uses tol.

    tol

    max acceptable tolerance, should be less than 1.

12. def assertDatasetApproximateEquals[U](expected: Dataset[U], result: Dataset[U], tol: Double)(implicit UCT: ClassTag[U]): Unit

    

    Compares if two Datasets are equal, Datasets should have the same type.

    Compares if two Datasets are equal, Datasets should have the same type. When comparing inexact fields uses tol.

    tol

    max acceptable tolerance, should be less than 1.

    Definition Classes

    DatasetSuiteBaseLike

13. def assertDatasetEquals[U](expected: Dataset[U], result: Dataset[U]): Unit

    

    Check if two Datasets are equals, Datasets should have the same type.

    Check if two Datasets are equals, Datasets should have the same type. This method could be customized by overriding equals method for the given class type.

14. def assertDatasetEquals[U](expected: Dataset[U], result: Dataset[U])(implicit UCT: ClassTag[U]): Unit

    

    Check if two Datasets are equals, Datasets should have the same type.

    Check if two Datasets are equals, Datasets should have the same type. This method could be customized by overriding equals method for the given class type.

    Definition Classes

    DatasetSuiteBaseLike

15. def assertEmpty[U](arr: Array[U])(implicit CT: ClassTag[U]): Unit

    

    Definition Classes

    JavaTestSuite → TestSuiteLike

16. def assertTrue(expected: Boolean): Unit

    

    Definition Classes

    JavaTestSuite → TestSuiteLike

17. def beforeAllTestCasesHook(): Unit

    

    Definition Classes

    JavaDataFrameSuiteBase → SharedJavaSparkContext

18. def clone(): AnyRef

    

    Attributes

    protected[java.lang]

    Definition Classes

    AnyRef

    Annotations

    @throws( ... )

19. def conf(): SparkConf

    

    Definition Classes

    SharedJavaSparkContext → SparkContextProvider

20. implicit def enableHiveSupport: Boolean

    

    Attributes

    protected

    Definition Classes

    DataFrameSuiteBaseLike

21. final def eq(arg0: AnyRef): Boolean

    

    Definition Classes

    AnyRef

22. def equals(arg0: Any): Boolean

    

    Definition Classes

    AnyRef → Any

23. def finalize(): Unit

    

    Attributes

    protected[java.lang]

    Definition Classes

    AnyRef

    Annotations

    @throws( classOf[java.lang.Throwable] )

24. final def getClass(): Class[_]

    

    Definition Classes

    AnyRef → Any

25. def hashCode(): Int

    

    Definition Classes

    AnyRef → Any

26. implicit def impSqlContext: SQLContext

    

    Attributes

    protected

    Definition Classes

    DataFrameSuiteBaseLike

27. final def isInstanceOf[T0]: Boolean

    

    Definition Classes

    Any

28. def jsc(): JavaSparkContext

    

    Definition Classes

    SharedJavaSparkContext

29. val maxUnequalRowsToShow: Int

    

    Definition Classes

    DataFrameSuiteBaseLike

30. final def ne(arg0: AnyRef): Boolean

    

    Definition Classes

    AnyRef

31. final def notify(): Unit

    

    Definition Classes

    AnyRef

32. final def notifyAll(): Unit

    

    Definition Classes

    AnyRef

33. def runBefore(): Unit

    

    Definition Classes

    SharedJavaSparkContext

34. def sc(): SparkContext

    

    Definition Classes

    SharedJavaSparkContext → SparkContextProvider

35. def setup(sc: SparkContext): Unit

    

    Setup work to be called when creating a new SparkContext.

    Setup work to be called when creating a new SparkContext. Default implementation currently sets a checkpoint directory.

    This _should_ be called by the context provider automatically.

    Definition Classes

    SharedJavaSparkContext → SparkContextProvider

36. lazy val spark: SparkSession

    

    Definition Classes

    DataFrameSuiteBaseLike

37. def sqlBeforeAllTestCases(): Unit

    

    Definition Classes

    DataFrameSuiteBaseLike

38. lazy val sqlContext: SQLContext

    

    Definition Classes

    DataFrameSuiteBaseLike

39. final def synchronized[T0](arg0: ⇒ T0): T0

    

    Definition Classes

    AnyRef

40. def toString(): String

    

    Definition Classes

    AnyRef → Any

41. final def wait(arg0: Long, arg1: Int): Unit

    

    Definition Classes

    AnyRef

    Annotations

    @throws( ... )

42. final def wait(arg0: Long): Unit

    

    Definition Classes

    AnyRef

    Annotations

    @throws( ... )

43. final def wait(): Unit

    

    Definition Classes

    AnyRef

    Annotations

    @throws( ... )