testing

Type Members

1. class BatchCountListener extends StreamingListener

2. class Column extends ColumnGenerator

   Previously ColumnGenerator.

3. abstract class ColumnGenerator extends Serializable

   ColumnGenerator - prevously Column; it is now the base class for all ColumnGenerators.

4. class ColumnList extends ColumnGenerator

   ColumnList allows users to specify custom generators for a list of columns inside a StructType column.

5. trait DataFrameSuiteBase extends TestSuite with SharedSparkContext with DataFrameSuiteBaseLike

   :: Experimental :: Base class for testing Spark DataFrames.

6. trait DataFrameSuiteBaseLike extends SparkContextProvider with TestSuiteLike with Serializable

7. trait DatasetSuiteBase extends DataFrameSuiteBase with DatasetSuiteBaseLike

8. trait DatasetSuiteBaseLike extends DataFrameSuiteBaseLike

9. class HDFSCluster extends HDFSClusterLike

10. trait HDFSClusterLike extends AnyRef

11. class JavaDataFrameSuiteBase extends SharedJavaSparkContext with DataFrameSuiteBaseLike with JavaTestSuite

12. class JavaDatasetSuiteBase extends JavaDataFrameSuiteBase with DatasetSuiteBaseLike with Serializable

13. class JavaStreamingSuiteBase extends JavaSuiteBase with StreamingSuiteCommon

    This is the base trait for Spark Streaming testsuite.

14. class JavaSuiteBase extends SharedJavaSparkContext

15. trait JavaTestSuite extends TestSuiteLike

16. trait LocalSparkContext extends BeforeAndAfterEach with BeforeAndAfterAll

    Manages a local sc SparkContext variable, correctly stopping it after each test.

17. trait PerTestSparkContext extends LocalSparkContext with BeforeAndAfterEach with SparkContextProvider

    Provides a local sc SparkContext variable, correctly stopping it after each test.

18. class PerfListener extends SparkListener

    This listener collects basic execution time information to be used in micro type performance tests.

19. trait Prettify extends AnyRef

20. trait RDDComparisons extends RDDComparisonsLike with TestSuite

21. trait RDDComparisonsLike extends TestSuiteLike

22. class SharedJavaSparkContext extends SparkContextProvider

23. trait SharedMiniCluster extends BeforeAndAfterAll with HDFSClusterLike with YARNClusterLike with SparkContextProvider

    Shares an HDFS MiniCluster based SparkContext between all tests in a suite and closes it at the end.

24. trait SharedSparkContext extends BeforeAndAfterAll with SparkContextProvider

    Shares a local SparkContext between all tests in a suite and closes it at the end.

25. trait SparkContextProvider extends AnyRef

26. trait StreamingActionBase extends StreamingSuiteBase

    Methods for testing Spark actions.

27. trait StreamingSuiteBase extends BeforeAndAfterAll with Logging with StreamingSuiteCommon with SharedSparkContext

    This is the base trait for Spark Streaming testsuites.

28. class TestInputStream[T] extends FriendlyInputDStream[T]

    This is a input stream just for the testsuites.

29. class TestOutputStream[T] extends Serializable

    This is a output stream just for testing.

30. trait TestSuite extends TestSuiteLike

31. trait TestSuiteLike extends AnyRef

32. class YARNCluster extends YARNClusterLike

    Shares an HDFS MiniCluster based SparkContext between all tests in a suite and closes it at the end.

33. trait YARNClusterLike extends AnyRef