testing

Type Members

1. trait DataFrameSuiteBase extends FunSuite with BeforeAndAfterAll with SharedSparkContext

   :: Experimental :: Base class for testing Spark DataFrames.

2. class JavaStreamingSuiteBase extends JavaSuiteBase with StreamingSuiteCommon

   This is the base trait for Spark Streaming testsuites.

3. class JavaSuiteBase extends SharedJavaSparkContext

4. trait LocalSparkContext extends BeforeAndAfterEach with BeforeAndAfterAll

   Manages a local sc SparkContext variable, correctly stopping it after each test.

5. trait PerTestSparkContext extends LocalSparkContext with BeforeAndAfterEach

   Provides a local sc SparkContext variable, correctly stopping it after each test.

6. class PerfListener extends SparkListener

   This listener collects basic execution time information to be used in micro type performance tests.

7. class SharedJavaSparkContext extends SparkContextProvider

8. trait SharedMiniCluster extends BeforeAndAfterAll

   Shares an HDFS MiniCluster based SparkContext between all tests in a suite and closes it at the end.

9. trait SharedSparkContext extends BeforeAndAfterAll with SparkContextProvider

   Shares a local SparkContext between all tests in a suite and closes it at the end

10. trait SparkContextProvider extends AnyRef

11. trait StreamingActionBase extends FunSuite with StreamingSuiteBase

    Methods for testing Spark actions.

12. trait StreamingSuiteBase extends FunSuite with BeforeAndAfterAll with Logging with StreamingSuiteCommon with SharedSparkContext

    This is the base trait for Spark Streaming testsuites.

13. class TestInputStream[T] extends FriendlyInputDStream[T]

    This is a input stream just for the testsuites.

14. class TestOutputStream[T] extends Serializable

    This is a output stream just for testing.