com.holdenkarau.spark.testing
Provides a local sc SparkContext variable, correctly stopping it after each test. The stopping logic is provided in LocalSparkContext.
sc
SparkContext
LocalSparkContext
Setup work to be called when creating a new SparkContext.
Setup work to be called when creating a new SparkContext. Default implementation currently sets a checkpoint directory.
This _should_ be called by the context provider automatically.
Provides a local
sc
SparkContext
variable, correctly stopping it after each test. The stopping logic is provided inLocalSparkContext
.