Class/Object

org.hammerlab.magic.test.listener

TestSparkListener

Related Docs: object TestSparkListener | package listener

Permalink

class TestSparkListener extends HasStatus with SparkListener with Temporal with Logging

SparkListener that accumulates various statistics for verification by tests.

NOTE: not threadsafe! Use with extreme caution, cf. https://github.com/hammerlab/magic-rdds/issues/18.

Linear Supertypes
Logging, SparkListener, HasStatus, Temporal, AnyRef, Any
Ordering
  1. Alphabetic
  2. By Inheritance
Inherited
  1. TestSparkListener
  2. Logging
  3. SparkListener
  4. HasStatus
  5. Temporal
  6. AnyRef
  7. Any
  1. Hide All
  2. Show All
Visibility
  1. Public
  2. All

Instance Constructors

  1. new TestSparkListener()

    Permalink

Value Members

  1. final def !=(arg0: Any): Boolean

    Permalink
    Definition Classes
    AnyRef → Any

  2. final def ##(): Int

    Permalink
    Definition Classes
    AnyRef → Any

  3. final def ==(arg0: Any): Boolean

    Permalink
    Definition Classes
    AnyRef → Any

  4. final def asInstanceOf[T0]: T0

    Permalink
    Definition Classes
    Any

  5. def clone(): AnyRef

    Permalink
    Attributes
    protected[java.lang]
    Definition Classes
    AnyRef
    Annotations
    @throws( ... )

  6. var end: Time

    Permalink
    Definition Classes
    Temporal

  7. final def eq(arg0: AnyRef): Boolean

    Permalink
    Definition Classes
    AnyRef

  8. def equals(arg0: Any): Boolean

    Permalink
    Definition Classes
    AnyRef → Any

  9. def finalize(): Unit

    Permalink
    Attributes
    protected[java.lang]
    Definition Classes
    AnyRef
    Annotations
    @throws( classOf[java.lang.Throwable] )

  10. final def getClass(): Class[_]

    Permalink
    Definition Classes
    AnyRef → Any

  11. def getStageAttempt(stageId: StageId, attemptId: StageAttemptId): StageAttempt

    Permalink

  12. def getStageAttempt(taskEndEvent: SparkListenerTaskEnd): StageAttempt

    Permalink

  13. def getStageAttempt(taskStartEvent: SparkListenerTaskStart): StageAttempt

    Permalink

  14. def getStageAttemptFromInfo(stageAttemptInfo: StageInfo): StageAttempt

    Permalink

  15. def handleRDDInfo(rddInfo: RDDInfo, stage: Stage): RDD

    Permalink

  16. def hashCode(): Int

    Permalink
    Definition Classes
    AnyRef → Any

  17. var id: AppId

    Permalink

  18. final def isInstanceOf[T0]: Boolean

    Permalink
    Definition Classes
    Any

  19. def isTraceEnabled(): Boolean

    Permalink
    Attributes
    protected
    Definition Classes
    Logging

  20. val jobs: HashMap[JobId, Job]

    Permalink

  21. def log: Logger

    Permalink
    Attributes
    protected
    Definition Classes
    Logging

  22. def logDebug(msg: ⇒ String, throwable: Throwable): Unit

    Permalink
    Attributes
    protected
    Definition Classes
    Logging

  23. def logDebug(msg: ⇒ String): Unit

    Permalink
    Attributes
    protected
    Definition Classes
    Logging

  24. def logError(msg: ⇒ String, throwable: Throwable): Unit

    Permalink
    Attributes
    protected
    Definition Classes
    Logging

  25. def logError(msg: ⇒ String): Unit

    Permalink
    Attributes
    protected
    Definition Classes
    Logging

  26. def logInfo(msg: ⇒ String, throwable: Throwable): Unit

    Permalink
    Attributes
    protected
    Definition Classes
    Logging

  27. def logInfo(msg: ⇒ String): Unit

    Permalink
    Attributes
    protected
    Definition Classes
    Logging

  28. def logName: String

    Permalink
    Attributes
    protected
    Definition Classes
    Logging

  29. def logTrace(msg: ⇒ String, throwable: Throwable): Unit

    Permalink
    Attributes
    protected
    Definition Classes
    Logging

  30. def logTrace(msg: ⇒ String): Unit

    Permalink
    Attributes
    protected
    Definition Classes
    Logging

  31. def logWarning(msg: ⇒ String, throwable: Throwable): Unit

    Permalink
    Attributes
    protected
    Definition Classes
    Logging

  32. def logWarning(msg: ⇒ String): Unit

    Permalink
    Attributes
    protected
    Definition Classes
    Logging

  33. var metrics: Metrics

    Permalink

  34. var name: AppName

    Permalink

  35. final def ne(arg0: AnyRef): Boolean

    Permalink
    Definition Classes
    AnyRef

  36. final def notify(): Unit

    Permalink
    Definition Classes
    AnyRef

  37. final def notifyAll(): Unit

    Permalink
    Definition Classes
    AnyRef

  38. def onApplicationEnd(applicationEnd: SparkListenerApplicationEnd): Unit

    Permalink
    Definition Classes
    TestSparkListener → SparkListener

  39. def onApplicationStart(applicationStart: SparkListenerApplicationStart): Unit

    Permalink
    Definition Classes
    TestSparkListener → SparkListener

  40. def onBlockManagerAdded(blockManagerAdded: SparkListenerBlockManagerAdded): Unit

    Permalink
    Definition Classes
    SparkListener

  41. def onBlockManagerRemoved(blockManagerRemoved: SparkListenerBlockManagerRemoved): Unit

    Permalink
    Definition Classes
    SparkListener

  42. def onBlockUpdated(blockUpdated: SparkListenerBlockUpdated): Unit

    Permalink
    Definition Classes
    SparkListener

  43. def onEnvironmentUpdate(environmentUpdate: SparkListenerEnvironmentUpdate): Unit

    Permalink
    Definition Classes
    SparkListener

  44. def onExecutorAdded(executorAdded: SparkListenerExecutorAdded): Unit

    Permalink
    Definition Classes
    SparkListener

  45. def onExecutorMetricsUpdate(executorMetricsUpdate: SparkListenerExecutorMetricsUpdate): Unit

    Permalink
    Definition Classes
    SparkListener

  46. def onExecutorRemoved(executorRemoved: SparkListenerExecutorRemoved): Unit

    Permalink
    Definition Classes
    SparkListener

  47. def onJobEnd(jobEnd: SparkListenerJobEnd): Unit

    Permalink
    Definition Classes
    TestSparkListener → SparkListener

  48. def onJobStart(jobStart: SparkListenerJobStart): Unit

    Permalink
    Definition Classes
    TestSparkListener → SparkListener

  49. def onStageCompleted(stageCompleted: SparkListenerStageCompleted): Unit

    Permalink
    Definition Classes
    TestSparkListener → SparkListener

  50. def onStageSubmitted(stageSubmitted: SparkListenerStageSubmitted): Unit

    Permalink
    Definition Classes
    TestSparkListener → SparkListener

  51. def onTaskEnd(taskEnd: SparkListenerTaskEnd): Unit

    Permalink
    Definition Classes
    TestSparkListener → SparkListener

  52. def onTaskGettingResult(taskGettingResult: SparkListenerTaskGettingResult): Unit

    Permalink
    Definition Classes
    SparkListener

  53. def onTaskStart(taskStart: SparkListenerTaskStart): Unit

    Permalink
    Definition Classes
    TestSparkListener → SparkListener

  54. def onUnpersistRDD(unpersistRDD: SparkListenerUnpersistRDD): Unit

    Permalink
    Definition Classes
    SparkListener

  55. val rdds: HashMap[RddId, RDD]

    Permalink

  56. val stages: HashMap[StageId, Stage]

    Permalink

  57. var start: Time

    Permalink
    Definition Classes
    Temporal

  58. var status: Status

    Permalink
    Definition Classes
    HasStatus

  59. final def synchronized[T0](arg0: ⇒ T0): T0

    Permalink
    Definition Classes
    AnyRef

  60. def toString(): String

    Permalink
    Definition Classes
    AnyRef → Any

  61. def updateMetrics(delta: Metrics): Unit

    Permalink

  62. final def wait(): Unit

    Permalink
    Definition Classes
    AnyRef
    Annotations
    @throws( ... )

  63. final def wait(arg0: Long, arg1: Int): Unit

    Permalink
    Definition Classes
    AnyRef
    Annotations
    @throws( ... )

  64. final def wait(arg0: Long): Unit

    Permalink
    Definition Classes
    AnyRef
    Annotations
    @throws( ... )

Inherited from Logging

Inherited from SparkListener

Inherited from HasStatus

Inherited from Temporal

Inherited from AnyRef

Inherited from Any

Ungrouped