Class/Object

com.salesforce.op.utils.spark

StageMetrics

Related Docs: object StageMetrics | package spark

Permalink

case class StageMetrics extends JsonLike with Product with Serializable

Spark stage metrics container for a org.apache.spark.scheduler.StageInfo Note: all the time values are in milliseconds.

Linear Supertypes
Product, Equals, JsonLike, Serializable, Serializable, AnyRef, Any
Ordering
  1. Alphabetic
  2. By Inheritance
Inherited
  1. StageMetrics
  2. Product
  3. Equals
  4. JsonLike
  5. Serializable
  6. Serializable
  7. AnyRef
  8. Any
  1. Hide All
  2. Show All
Visibility
  1. Public
  2. All

Value Members

  1. final def !=(arg0: Any): Boolean

    Permalink
    Definition Classes
    AnyRef → Any

  2. final def ##(): Int

    Permalink
    Definition Classes
    AnyRef → Any

  3. final def ==(arg0: Any): Boolean

    Permalink
    Definition Classes
    AnyRef → Any

  4. final def asInstanceOf[T0]: T0

    Permalink
    Definition Classes
    Any

  5. val attemptId: Int

    Permalink

  6. val bytesRead: Long

    Permalink

  7. val bytesWritten: Long

    Permalink

  8. def clone(): AnyRef

    Permalink
    Attributes
    protected[java.lang]
    Definition Classes
    AnyRef
    Annotations
    @throws( ... )

  9. val completionTime: Option[Long]

    Permalink

  10. val diskBytesSpilled: Long

    Permalink

  11. val duration: Option[Long]

    Permalink

  12. final def eq(arg0: AnyRef): Boolean

    Permalink
    Definition Classes
    AnyRef

  13. val executorCpuTime: Long

    Permalink

  14. val executorDeserializeCpuTime: Long

    Permalink

  15. val executorDeserializeTime: Long

    Permalink

  16. val executorRunTime: Long

    Permalink

  17. val failureReason: Option[String]

    Permalink

  18. def finalize(): Unit

    Permalink
    Attributes
    protected[java.lang]
    Definition Classes
    AnyRef
    Annotations
    @throws( classOf[java.lang.Throwable] )

  19. final def getClass(): Class[_]

    Permalink
    Definition Classes
    AnyRef → Any

  20. final def isInstanceOf[T0]: Boolean

    Permalink
    Definition Classes
    Any

  21. val jvmGCTime: Long

    Permalink

  22. val memoryBytesSpilled: Long

    Permalink

  23. val name: String

    Permalink

  24. final def ne(arg0: AnyRef): Boolean

    Permalink
    Definition Classes
    AnyRef

  25. final def notify(): Unit

    Permalink
    Definition Classes
    AnyRef

  26. final def notifyAll(): Unit

    Permalink
    Definition Classes
    AnyRef

  27. val numAccumulables: Int

    Permalink

  28. val numTasks: Int

    Permalink

  29. val numUpdatedBlockStatuses: Int

    Permalink

  30. val parentIds: Seq[Int]

    Permalink

  31. val peakExecutionMemory: Long

    Permalink

  32. val recordsRead: Long

    Permalink

  33. val recordsWritten: Long

    Permalink

  34. val resultSerializationTime: Long

    Permalink

  35. val resultSizeBytes: Long

    Permalink

  36. val shuffleBytesWritten: Long

    Permalink

  37. val shuffleFetchWaitTime: Long

    Permalink

  38. val shuffleLocalBlocksFetched: Long

    Permalink

  39. val shuffleRecordsWritten: Long

    Permalink

  40. val shuffleRemoteBlocksFetched: Long

    Permalink

  41. val shuffleTotalBlocksFetched: Long

    Permalink

  42. val shuffleTotalBytesRead: Long

    Permalink

  43. val shuffleWriteTime: Long

    Permalink

  44. val stageId: Int

    Permalink

  45. val status: String

    Permalink

  46. val submissionTime: Option[Long]

    Permalink

  47. final def synchronized[T0](arg0: ⇒ T0): T0

    Permalink
    Definition Classes
    AnyRef

  48. def toJson(pretty: Boolean = true): String

    Permalink

    Write this instance to json string

    Write this instance to json string

    pretty

    should pretty print

    returns

    json string of the instance

    Definition Classes
    JsonLike

  49. def toString(): String

    Permalink

    This instance json string

    This instance json string

    returns

    json string of the instance

    Definition Classes
    JsonLike → AnyRef → Any

  50. final def wait(): Unit

    Permalink
    Definition Classes
    AnyRef
    Annotations
    @throws( ... )

  51. final def wait(arg0: Long, arg1: Int): Unit

    Permalink
    Definition Classes
    AnyRef
    Annotations
    @throws( ... )

  52. final def wait(arg0: Long): Unit

    Permalink
    Definition Classes
    AnyRef
    Annotations
    @throws( ... )

Inherited from Product

Inherited from Equals

Inherited from JsonLike

Inherited from Serializable

Inherited from Serializable

Inherited from AnyRef

Inherited from Any

Ungrouped