Class/Object

org.apache.spark.sql.execution.streaming

StreamMetrics

Related Docs: object StreamMetrics | package streaming

Permalink

class StreamMetrics extends metrics.source.Source with Logging

Class that manages all the metrics related to a StreamingQuery. It does the following. - Calculates metrics (rates, latencies, etc.) based on information reported by StreamExecution. - Allows the current metric values to be queried - Serves some of the metrics through Codahale/DropWizard metrics

Linear Supertypes
Logging, metrics.source.Source, AnyRef, Any
Ordering
  1. Alphabetic
  2. By Inheritance
Inherited
  1. StreamMetrics
  2. Logging
  3. Source
  4. AnyRef
  5. Any
  1. Hide All
  2. Show All
Visibility
  1. Public
  2. All

Instance Constructors

  1. new StreamMetrics(sources: Set[Source], triggerClock: Clock, codahaleSourceName: String)

    Permalink

    sources

    Unique set of sources in a query

    triggerClock

    Clock used for triggering in StreamExecution

    codahaleSourceName

    Root name for all the Codahale metrics

Value Members

  1. final def !=(arg0: Any): Boolean

    Permalink
    Definition Classes
    AnyRef → Any

  2. final def ##(): Int

    Permalink
    Definition Classes
    AnyRef → Any

  3. final def ==(arg0: Any): Boolean

    Permalink
    Definition Classes
    AnyRef → Any

  4. final def asInstanceOf[T0]: T0

    Permalink
    Definition Classes
    Any

  5. def clone(): AnyRef

    Permalink
    Attributes
    protected[java.lang]
    Definition Classes
    AnyRef
    Annotations
    @throws( ... )

  6. def currentInputRate(): Double

    Permalink

  7. def currentLatency(): Option[Double]

    Permalink

  8. def currentProcessingRate(): Double

    Permalink

  9. def currentSourceInputRate(source: Source): Double

    Permalink

  10. def currentSourceProcessingRate(source: Source): Double

    Permalink

  11. def currentSourceTriggerDetails(source: Source): Map[String, String]

    Permalink

  12. def currentTriggerDetails(): Map[String, String]

    Permalink

  13. final def eq(arg0: AnyRef): Boolean

    Permalink
    Definition Classes
    AnyRef

  14. def equals(arg0: Any): Boolean

    Permalink
    Definition Classes
    AnyRef → Any

  15. def finalize(): Unit

    Permalink
    Attributes
    protected[java.lang]
    Definition Classes
    AnyRef
    Annotations
    @throws( classOf[java.lang.Throwable] )

  16. final def getClass(): Class[_]

    Permalink
    Definition Classes
    AnyRef → Any

  17. def hashCode(): Int

    Permalink
    Definition Classes
    AnyRef → Any

  18. def initializeLogIfNecessary(isInterpreter: Boolean): Unit

    Permalink
    Attributes
    protected
    Definition Classes
    Logging

  19. final def isDebugEnabled: Boolean

    Permalink
    Attributes
    protected
    Definition Classes
    Logging

  20. final def isInfoEnabled: Boolean

    Permalink
    Attributes
    protected
    Definition Classes
    Logging

  21. final def isInstanceOf[T0]: Boolean

    Permalink
    Definition Classes
    Any

  22. final def isTraceEnabled: Boolean

    Permalink
    Attributes
    protected
    Definition Classes
    Logging

  23. def log: Logger

    Permalink
    Attributes
    protected
    Definition Classes
    Logging

  24. def logDebug(msg: ⇒ String, throwable: Throwable): Unit

    Permalink
    Attributes
    protected
    Definition Classes
    Logging

  25. def logDebug(msg: ⇒ String): Unit

    Permalink
    Attributes
    protected
    Definition Classes
    Logging

  26. def logError(msg: ⇒ String, throwable: Throwable): Unit

    Permalink
    Attributes
    protected
    Definition Classes
    Logging

  27. def logError(msg: ⇒ String): Unit

    Permalink
    Attributes
    protected
    Definition Classes
    Logging

  28. def logInfo(msg: ⇒ String, throwable: Throwable): Unit

    Permalink
    Attributes
    protected
    Definition Classes
    Logging

  29. def logInfo(msg: ⇒ String): Unit

    Permalink
    Attributes
    protected
    Definition Classes
    Logging

  30. def logName: String

    Permalink
    Attributes
    protected
    Definition Classes
    Logging

  31. def logTrace(msg: ⇒ String, throwable: Throwable): Unit

    Permalink
    Attributes
    protected
    Definition Classes
    Logging

  32. def logTrace(msg: ⇒ String): Unit

    Permalink
    Attributes
    protected
    Definition Classes
    Logging

  33. def logWarning(msg: ⇒ String, throwable: Throwable): Unit

    Permalink
    Attributes
    protected
    Definition Classes
    Logging

  34. def logWarning(msg: ⇒ String): Unit

    Permalink
    Attributes
    protected
    Definition Classes
    Logging

  35. val metricRegistry: MetricRegistry

    Permalink
    Definition Classes
    StreamMetrics → Source

  36. final def ne(arg0: AnyRef): Boolean

    Permalink
    Definition Classes
    AnyRef

  37. final def notify(): Unit

    Permalink
    Definition Classes
    AnyRef

  38. final def notifyAll(): Unit

    Permalink
    Definition Classes
    AnyRef

  39. def reportNumInputRows(inputRows: Map[Source, Long]): Unit

    Permalink

  40. def reportSourceTriggerDetail[T](source: Source, key: String, value: T): Unit

    Permalink

  41. def reportTriggerDetail[T](key: String, value: T): Unit

    Permalink

  42. def reportTriggerFinished(): Unit

    Permalink

  43. def reportTriggerStarted(triggerId: Long): Unit

    Permalink

  44. val sourceName: String

    Permalink
    Definition Classes
    StreamMetrics → Source

  45. def stop(): Unit

    Permalink

  46. final def synchronized[T0](arg0: ⇒ T0): T0

    Permalink
    Definition Classes
    AnyRef

  47. def toString(): String

    Permalink
    Definition Classes
    AnyRef → Any

  48. final def wait(): Unit

    Permalink
    Definition Classes
    AnyRef
    Annotations
    @throws( ... )

  49. final def wait(arg0: Long, arg1: Int): Unit

    Permalink
    Definition Classes
    AnyRef
    Annotations
    @throws( ... )

  50. final def wait(arg0: Long): Unit

    Permalink
    Definition Classes
    AnyRef
    Annotations
    @throws( ... )

Inherited from Logging

Inherited from metrics.source.Source

Inherited from AnyRef

Inherited from Any

Ungrouped