Packages

sealed trait StreamingAggregationStateManager extends Serializable

Base trait for state manager purposed to be used from streaming aggregations.

Linear Supertypes
Serializable, Serializable, AnyRef, Any
Known Subclasses
StreamingAggregationStateManagerBaseImpl, StreamingAggregationStateManagerImplV1, StreamingAggregationStateManagerImplV2
Ordering
  1. Alphabetic
  2. By Inheritance
Inherited
  1. StreamingAggregationStateManager
  2. Serializable
  3. Serializable
  4. AnyRef
  5. Any
  1. Hide All
  2. Show All
Visibility
  1. Public
  2. All

Abstract Value Members

  1. abstract def commit(store: StateStore): Long

    Commit all the updates that have been made to the target state store, and return the new version.

  2. abstract def get(store: ReadStateStore, key: UnsafeRow): UnsafeRow

    Get the current value of a non-null key from the target state store.

  3. abstract def getKey(row: UnsafeRow): UnsafeRow

    Extract columns consisting key from input row, and return the new row for key columns.

  4. abstract def getStateValueSchema: StructType

    Calculate schema for the value of state.

    Calculate schema for the value of state. The schema is mainly passed to the StateStoreRDD.

  5. abstract def iterator(store: ReadStateStore): Iterator[UnsafeRowPair]

    Return an iterator containing all the key-value pairs in target state store.

  6. abstract def keys(store: ReadStateStore): Iterator[UnsafeRow]

    Return an iterator containing all the keys in target state store.

  7. abstract def put(store: StateStore, row: UnsafeRow): Unit

    Put a new value for a non-null key to the target state store.

    Put a new value for a non-null key to the target state store. Note that key will be extracted from the input row, and the key would be same as the result of getKey(inputRow).

  8. abstract def remove(store: StateStore, key: UnsafeRow): Unit

    Remove a single non-null key from the target state store.

  9. abstract def values(store: ReadStateStore): Iterator[UnsafeRow]

    Return an iterator containing all the values in target state store.

Concrete Value Members

  1. final def !=(arg0: Any): Boolean
    Definition Classes
    AnyRef → Any
  2. final def ##(): Int
    Definition Classes
    AnyRef → Any
  3. final def ==(arg0: Any): Boolean
    Definition Classes
    AnyRef → Any
  4. final def asInstanceOf[T0]: T0
    Definition Classes
    Any
  5. def clone(): AnyRef
    Attributes
    protected[lang]
    Definition Classes
    AnyRef
    Annotations
    @throws( ... ) @native()
  6. final def eq(arg0: AnyRef): Boolean
    Definition Classes
    AnyRef
  7. def equals(arg0: Any): Boolean
    Definition Classes
    AnyRef → Any
  8. def finalize(): Unit
    Attributes
    protected[lang]
    Definition Classes
    AnyRef
    Annotations
    @throws( classOf[java.lang.Throwable] )
  9. final def getClass(): Class[_]
    Definition Classes
    AnyRef → Any
    Annotations
    @native()
  10. def hashCode(): Int
    Definition Classes
    AnyRef → Any
    Annotations
    @native()
  11. final def isInstanceOf[T0]: Boolean
    Definition Classes
    Any
  12. final def ne(arg0: AnyRef): Boolean
    Definition Classes
    AnyRef
  13. final def notify(): Unit
    Definition Classes
    AnyRef
    Annotations
    @native()
  14. final def notifyAll(): Unit
    Definition Classes
    AnyRef
    Annotations
    @native()
  15. final def synchronized[T0](arg0: ⇒ T0): T0
    Definition Classes
    AnyRef
  16. def toString(): String
    Definition Classes
    AnyRef → Any
  17. final def wait(): Unit
    Definition Classes
    AnyRef
    Annotations
    @throws( ... )
  18. final def wait(arg0: Long, arg1: Int): Unit
    Definition Classes
    AnyRef
    Annotations
    @throws( ... )
  19. final def wait(arg0: Long): Unit
    Definition Classes
    AnyRef
    Annotations
    @throws( ... ) @native()

Inherited from Serializable

Inherited from Serializable

Inherited from AnyRef

Inherited from Any

Ungrouped