Object

ch.cern.sparkmeasure

Utils

Related Doc: package sparkmeasure

Permalink

object Utils

The object Utils contains some helper code for the sparkMeasure package The methods formatDuration and formatBytes are used for printing stage metrics reports The methods readSerializedStageMetrics and readSerializedTaskMetrics are used to read data serialized into files by "flight recorder" mode

Linear Supertypes
AnyRef, Any
Ordering
  1. Alphabetic
  2. By Inheritance
Inherited
  1. Utils
  2. AnyRef
  3. Any
  1. Hide All
  2. Show All
Visibility
  1. Public
  2. All

Type Members

  1. class ObjectInputStreamWithCustomClassLoader extends ObjectInputStream

    Permalink

Value Members

  1. final def !=(arg0: Any): Boolean

    Permalink
    Definition Classes
    AnyRef → Any
  2. final def ##(): Int

    Permalink
    Definition Classes
    AnyRef → Any
  3. final def ==(arg0: Any): Boolean

    Permalink
    Definition Classes
    AnyRef → Any
  4. final def asInstanceOf[T0]: T0

    Permalink
    Definition Classes
    Any
  5. def clone(): AnyRef

    Permalink
    Attributes
    protected[java.lang]
    Definition Classes
    AnyRef
    Annotations
    @throws( ... )
  6. final def eq(arg0: AnyRef): Boolean

    Permalink
    Definition Classes
    AnyRef
  7. def equals(arg0: Any): Boolean

    Permalink
    Definition Classes
    AnyRef → Any
  8. def finalize(): Unit

    Permalink
    Attributes
    protected[java.lang]
    Definition Classes
    AnyRef
    Annotations
    @throws( classOf[java.lang.Throwable] )
  9. def formatBytes(bytes: Long): String

    Permalink
  10. def formatDuration(milliseconds: Long): String

    Permalink

    boilerplate code for pretty printing, formatDuration code borrowed from Spark UIUtils

  11. final def getClass(): Class[_]

    Permalink
    Definition Classes
    AnyRef → Any
  12. def hashCode(): Int

    Permalink
    Definition Classes
    AnyRef → Any
  13. final def isInstanceOf[T0]: Boolean

    Permalink
    Definition Classes
    Any
  14. final def ne(arg0: AnyRef): Boolean

    Permalink
    Definition Classes
    AnyRef
  15. final def notify(): Unit

    Permalink
    Definition Classes
    AnyRef
  16. final def notifyAll(): Unit

    Permalink
    Definition Classes
    AnyRef
  17. val objectMapper: ObjectMapper with ScalaObjectMapper

    Permalink
  18. val objectWriter: ObjectWriter

    Permalink
  19. def prettyPrintValues(metric: String, value: Long): String

    Permalink
  20. def readSerialized[T](metricsFileName: String): ListBuffer[T]

    Permalink
  21. def readSerializedStageMetrics(stageMetricsFileName: String): ListBuffer[StageVals]

    Permalink
  22. def readSerializedStageMetricsJSON(stageMetricsFileName: String): List[StageVals]

    Permalink
  23. def readSerializedTaskMetrics(stageMetricsFileName: String): ListBuffer[TaskVals]

    Permalink
  24. def readSerializedTaskMetricsJSON(taskMetricsFileName: String): List[TaskVals]

    Permalink
  25. final def synchronized[T0](arg0: ⇒ T0): T0

    Permalink
    Definition Classes
    AnyRef
  26. def toString(): String

    Permalink
    Definition Classes
    AnyRef → Any
  27. final def wait(): Unit

    Permalink
    Definition Classes
    AnyRef
    Annotations
    @throws( ... )
  28. final def wait(arg0: Long, arg1: Int): Unit

    Permalink
    Definition Classes
    AnyRef
    Annotations
    @throws( ... )
  29. final def wait(arg0: Long): Unit

    Permalink
    Definition Classes
    AnyRef
    Annotations
    @throws( ... )
  30. def writeSerialized(fullPath: String, metricsData: Any): Unit

    Permalink
  31. def writeSerializedJSON(fullPath: String, metricsData: AnyRef): Unit

    Permalink

Inherited from AnyRef

Inherited from Any

Ungrouped