org.apache.spark.sql.execution.streaming

StreamMetrics

class StreamMetrics extends metrics.source.Source with Logging

Class that manages all the metrics related to a StreamingQuery. It does the following. - Calculates metrics (rates, latencies, etc.) based on information reported by StreamExecution. - Allows the current metric values to be queried - Serves some of the metrics through Codahale/DropWizard metrics

Linear Supertypes
Logging, metrics.source.Source, AnyRef, Any
Ordering
  1. Alphabetic
  2. By inheritance
Inherited
  1. StreamMetrics
  2. Logging
  3. Source
  4. AnyRef
  5. Any
  1. Hide All
  2. Show all
Learn more about member selection
Visibility
  1. Public
  2. All

Instance Constructors

  1. new StreamMetrics(sources: Set[Source], triggerClock: Clock, codahaleSourceName: String)

    sources

    Unique set of sources in a query

    triggerClock

    Clock used for triggering in StreamExecution

    codahaleSourceName

    Root name for all the Codahale metrics

Value Members

  1. final def !=(arg0: AnyRef): Boolean

    Definition Classes
    AnyRef

  2. final def !=(arg0: Any): Boolean

    Definition Classes
    Any

  3. final def ##(): Int

    Definition Classes
    AnyRef → Any

  4. final def ==(arg0: AnyRef): Boolean

    Definition Classes
    AnyRef

  5. final def ==(arg0: Any): Boolean

    Definition Classes
    Any

  6. final def asInstanceOf[T0]: T0

    Definition Classes
    Any

  7. def clone(): AnyRef

    Attributes
    protected[java.lang]
    Definition Classes
    AnyRef
    Annotations
    @throws( ... )

  8. def currentInputRate(): Double

  9. def currentLatency(): Option[Double]

  10. def currentProcessingRate(): Double

  11. def currentSourceInputRate(source: Source): Double

  12. def currentSourceProcessingRate(source: Source): Double

  13. def currentSourceTriggerDetails(source: Source): Map[String, String]

  14. def currentTriggerDetails(): Map[String, String]

  15. final def eq(arg0: AnyRef): Boolean

    Definition Classes
    AnyRef

  16. def equals(arg0: Any): Boolean

    Definition Classes
    AnyRef → Any

  17. def finalize(): Unit

    Attributes
    protected[java.lang]
    Definition Classes
    AnyRef
    Annotations
    @throws( classOf[java.lang.Throwable] )

  18. final def getClass(): Class[_]

    Definition Classes
    AnyRef → Any

  19. def hashCode(): Int

    Definition Classes
    AnyRef → Any

  20. def initializeLogIfNecessary(isInterpreter: Boolean): Unit

    Attributes
    protected
    Definition Classes
    Logging

  21. final def isInstanceOf[T0]: Boolean

    Definition Classes
    Any

  22. def isTraceEnabled(): Boolean

    Attributes
    protected
    Definition Classes
    Logging

  23. def log: Logger

    Attributes
    protected
    Definition Classes
    Logging

  24. def logDebug(msg: ⇒ String, throwable: Throwable): Unit

    Attributes
    protected
    Definition Classes
    Logging

  25. def logDebug(msg: ⇒ String): Unit

    Attributes
    protected
    Definition Classes
    Logging

  26. def logError(msg: ⇒ String, throwable: Throwable): Unit

    Attributes
    protected
    Definition Classes
    Logging

  27. def logError(msg: ⇒ String): Unit

    Attributes
    protected
    Definition Classes
    Logging

  28. def logInfo(msg: ⇒ String, throwable: Throwable): Unit

    Attributes
    protected
    Definition Classes
    Logging

  29. def logInfo(msg: ⇒ String): Unit

    Attributes
    protected
    Definition Classes
    Logging

  30. def logName: String

    Attributes
    protected
    Definition Classes
    Logging

  31. def logTrace(msg: ⇒ String, throwable: Throwable): Unit

    Attributes
    protected
    Definition Classes
    Logging

  32. def logTrace(msg: ⇒ String): Unit

    Attributes
    protected
    Definition Classes
    Logging

  33. def logWarning(msg: ⇒ String, throwable: Throwable): Unit

    Attributes
    protected
    Definition Classes
    Logging

  34. def logWarning(msg: ⇒ String): Unit

    Attributes
    protected
    Definition Classes
    Logging

  35. val metricRegistry: MetricRegistry

    Definition Classes
    StreamMetrics → Source

  36. final def ne(arg0: AnyRef): Boolean

    Definition Classes
    AnyRef

  37. final def notify(): Unit

    Definition Classes
    AnyRef

  38. final def notifyAll(): Unit

    Definition Classes
    AnyRef

  39. def reportNumInputRows(inputRows: Map[Source, Long]): Unit

  40. def reportSourceTriggerDetail[T](source: Source, key: String, value: T): Unit

  41. def reportTriggerDetail[T](key: String, value: T): Unit

  42. def reportTriggerFinished(): Unit

  43. def reportTriggerStarted(triggerId: Long): Unit

  44. val sourceName: String

    Definition Classes
    StreamMetrics → Source

  45. def stop(): Unit

  46. final def synchronized[T0](arg0: ⇒ T0): T0

    Definition Classes
    AnyRef

  47. def toString(): String

    Definition Classes
    AnyRef → Any

  48. final def wait(): Unit

    Definition Classes
    AnyRef
    Annotations
    @throws( ... )

  49. final def wait(arg0: Long, arg1: Int): Unit

    Definition Classes
    AnyRef
    Annotations
    @throws( ... )

  50. final def wait(arg0: Long): Unit

    Definition Classes
    AnyRef
    Annotations
    @throws( ... )

Inherited from Logging

Inherited from metrics.source.Source

Inherited from AnyRef

Inherited from Any

Ungrouped