Class

pl.touk.nussknacker.engine.flink.util.transformer.aggregate

EmitExtraWindowWhenNoDataTumblingAggregatorFunction

Related Doc: package aggregate

Permalink

class EmitExtraWindowWhenNoDataTumblingAggregatorFunction[MapT[K, V]] extends KeyedProcessFunction[String, ValueWithContext[StringKeyedValue[AnyRef]], ValueWithContext[AnyRef]] with StateHolder[MapT[Long, AnyRef]] with AggregatorFunctionMixin[MapT]

It behaves similar to Flink's TumblingWindow with one difference that we produce extra zero aggregate for each key when no data arrived. For this purpose we've used AggregatorFunctionMixin with minimalResolutionMs = timeWindowLengthMillis. We use it because it handles out of order elements. The other difference from AggregatorFunction is that we emit event only in timer and handle state eviction on ours own.

Linear Supertypes
AggregatorFunctionMixin[MapT], StateHolder[MapT[Long, AnyRef]], KeyedProcessFunction[String, ValueWithContext[StringKeyedValue[AnyRef]], ValueWithContext[AnyRef]], AbstractRichFunction, RichFunction, Function, Serializable, AnyRef, Any
Ordering
  1. Alphabetic
  2. By Inheritance
Inherited
  1. EmitExtraWindowWhenNoDataTumblingAggregatorFunction
  2. AggregatorFunctionMixin
  3. StateHolder
  4. KeyedProcessFunction
  5. AbstractRichFunction
  6. RichFunction
  7. Function
  8. Serializable
  9. AnyRef
  10. Any
  1. Hide All
  2. Show All
Visibility
  1. Public
  2. All

Instance Constructors

  1. new EmitExtraWindowWhenNoDataTumblingAggregatorFunction(aggregator: Aggregator, timeWindowLengthMillis: Long, nodeId: NodeId, aggregateElementType: TypingResult, aggregateTypeInformation: TypeInformation[AnyRef])(implicit rangeMap: FlinkRangeMap[MapT])

    Permalink

Type Members

  1. abstract class Context extends AnyRef

    Permalink
    Definition Classes
    KeyedProcessFunction

  2. type FlinkCtx = Context

    Permalink

  3. type FlinkOnTimerCtx = OnTimerContext

    Permalink

  4. abstract class OnTimerContext extends Context

    Permalink
    Definition Classes
    KeyedProcessFunction

Abstract Value Members

  1. abstract object Context

    Permalink
    Definition Classes
    KeyedProcessFunction

  2. abstract object OnTimerContext

    Permalink
    Definition Classes
    KeyedProcessFunction

Concrete Value Members

  1. final def !=(arg0: Any): Boolean

    Permalink
    Definition Classes
    AnyRef → Any

  2. final def ##(): Int

    Permalink
    Definition Classes
    AnyRef → Any

  3. final def ==(arg0: Any): Boolean

    Permalink
    Definition Classes
    AnyRef → Any

  4. def addElementToState(value: ValueWithContext[StringKeyedValue[AnyRef]], timestamp: Long, timeService: TimerService, out: Collector[ValueWithContext[AnyRef]]): MapT[Long, Aggregate]

    Permalink
    Attributes
    protected
    Definition Classes
    AggregatorFunctionMixin

  5. val aggregateElementType: TypingResult

    Permalink
    Attributes
    protected
    Definition Classes
    EmitExtraWindowWhenNoDataTumblingAggregatorFunction → AggregatorFunctionMixin

  6. val aggregateTypeInformation: TypeInformation[AnyRef]

    Permalink
    Attributes
    protected
    Definition Classes
    EmitExtraWindowWhenNoDataTumblingAggregatorFunction → AggregatorFunctionMixin

  7. val aggregator: Aggregator

    Permalink
    Attributes
    protected
    Definition Classes
    EmitExtraWindowWhenNoDataTumblingAggregatorFunction → AggregatorFunctionMixin

  8. def allowedOutOfOrderMs: Long

    Permalink
    Attributes
    protected
    Definition Classes
    AggregatorFunctionMixin

  9. final def asInstanceOf[T0]: T0

    Permalink
    Definition Classes
    Any

  10. def clone(): AnyRef

    Permalink
    Attributes
    protected[java.lang]
    Definition Classes
    AnyRef
    Annotations
    @HotSpotIntrinsicCandidate() @throws( ... )

  11. def close(): Unit

    Permalink
    Definition Classes
    AbstractRichFunction → RichFunction
    Annotations
    @throws( classOf[java.lang.Exception] )

  12. def computeFinalValue(newState: MapT[Long, Aggregate], timestamp: Long): AnyRef

    Permalink
    Attributes
    protected
    Definition Classes
    AggregatorFunctionMixin

  13. def computeFoldedAggregatedValue(state: MapT[Long, Aggregate], timestamp: Long): AnyRef

    Permalink
    Attributes
    protected
    Definition Classes
    AggregatorFunctionMixin

  14. def doMoveEvictionTime(time: Long, timeService: TimerService): Unit

    Permalink
    Attributes
    protected
    Definition Classes
    EmitExtraWindowWhenNoDataTumblingAggregatorFunction → StateHolder

  15. final def eq(arg0: AnyRef): Boolean

    Permalink
    Definition Classes
    AnyRef

  16. def equals(arg0: Any): Boolean

    Permalink
    Definition Classes
    AnyRef → Any

  17. def evictStates(): Unit

    Permalink
    Attributes
    protected

  18. final def getClass(): Class[_]

    Permalink
    Definition Classes
    AnyRef → Any
    Annotations
    @HotSpotIntrinsicCandidate()

  19. def getIterationRuntimeContext(): IterationRuntimeContext

    Permalink
    Definition Classes
    AbstractRichFunction → RichFunction

  20. def getRuntimeContext(): RuntimeContext

    Permalink
    Definition Classes
    AbstractRichFunction → RichFunction

  21. def handleElementAddedToState(newElementInStateTimestamp: Long, newElement: Element, nkCtx: api.Context, timerService: TimerService, out: Collector[ValueWithContext[AnyRef]]): Unit

    Permalink
    Attributes
    protected
    Definition Classes
    EmitExtraWindowWhenNoDataTumblingAggregatorFunction → AggregatorFunctionMixin

  22. def handleNewElementAdded(value: ValueWithContext[StringKeyedValue[AnyRef]], timestamp: Long, timeService: TimerService, out: Collector[ValueWithContext[AnyRef]]): Unit

    Permalink
    Attributes
    protected
    Definition Classes
    AggregatorFunctionMixin

  23. def hashCode(): Int

    Permalink
    Definition Classes
    AnyRef → Any
    Annotations
    @HotSpotIntrinsicCandidate()

  24. final def isInstanceOf[T0]: Boolean

    Permalink
    Definition Classes
    Any

  25. lazy val metricUtils: MetricUtils

    Permalink
    Attributes
    protected
    Definition Classes
    AggregatorFunctionMixin

  26. val minimalResolutionMs: Long

    Permalink
    Attributes
    protected
    Definition Classes
    EmitExtraWindowWhenNoDataTumblingAggregatorFunction → AggregatorFunctionMixin

  27. def name: String

    Permalink
    Attributes
    protected
    Definition Classes
    AggregatorFunctionMixin

  28. final def ne(arg0: AnyRef): Boolean

    Permalink
    Definition Classes
    AnyRef

  29. def newHistogram(): DropwizardHistogramWrapper

    Permalink
    Attributes
    protected
    Definition Classes
    AggregatorFunctionMixin

  30. val nodeId: NodeId

    Permalink
    Definition Classes
    EmitExtraWindowWhenNoDataTumblingAggregatorFunction → AggregatorFunctionMixin

  31. final def notify(): Unit

    Permalink
    Definition Classes
    AnyRef
    Annotations
    @HotSpotIntrinsicCandidate()

  32. final def notifyAll(): Unit

    Permalink
    Definition Classes
    AnyRef
    Annotations
    @HotSpotIntrinsicCandidate()

  33. def onTimer(timestamp: Long, ctx: FlinkOnTimerCtx, out: Collector[ValueWithContext[AnyRef]]): Unit

    Permalink
    Definition Classes
    EmitExtraWindowWhenNoDataTumblingAggregatorFunction → KeyedProcessFunction

  34. def open(parameters: Configuration): Unit

    Permalink
    Definition Classes
    EmitExtraWindowWhenNoDataTumblingAggregatorFunction → AbstractRichFunction → RichFunction

  35. val outputType: TypingResult

    Permalink
    Attributes
    protected
    Definition Classes
    AggregatorFunctionMixin

  36. def processElement(value: ValueWithContext[StringKeyedValue[AnyRef]], ctx: FlinkCtx, out: Collector[ValueWithContext[AnyRef]]): Unit

    Permalink
    Definition Classes
    EmitExtraWindowWhenNoDataTumblingAggregatorFunction → KeyedProcessFunction

  37. implicit val rangeMap: FlinkRangeMap[MapT]

    Permalink
    Definition Classes
    EmitExtraWindowWhenNoDataTumblingAggregatorFunction → AggregatorFunctionMixin

  38. def readState(): MapT[Long, AnyRef]

    Permalink
    Attributes
    protected
    Definition Classes
    EmitExtraWindowWhenNoDataTumblingAggregatorFunction → StateHolder

  39. def readStateOrInitial(): MapT[Long, Aggregate]

    Permalink
    Attributes
    protected
    Definition Classes
    AggregatorFunctionMixin

  40. lazy val retrievedBucketsHistogram: Histogram

    Permalink
    Attributes
    protected
    Definition Classes
    AggregatorFunctionMixin

  41. def setRuntimeContext(arg0: RuntimeContext): Unit

    Permalink
    Definition Classes
    AbstractRichFunction → RichFunction

  42. var state: ValueState[MapT[Long, AnyRef]]

    Permalink
    Attributes
    protected

  43. def stateDescriptor: ValueStateDescriptor[MapT[Long, AnyRef]]

    Permalink
    Attributes
    protected
    Definition Classes
    AggregatorFunctionMixin

  44. def stateForTimestampToRead[T](stateValue: MapT[Long, T], timestamp: Long): MapT[Long, T]

    Permalink
    Attributes
    protected
    Definition Classes
    AggregatorFunctionMixin

  45. def stateForTimestampToReadUntilEnd[T](stateValue: MapT[Long, T], timestamp: Long): MapT[Long, T]

    Permalink
    Attributes
    protected
    Definition Classes
    AggregatorFunctionMixin

  46. def stateForTimestampToSave[T](stateValue: MapT[Long, T], timestamp: Long): MapT[Long, T]

    Permalink
    Attributes
    protected
    Definition Classes
    AggregatorFunctionMixin

  47. final def synchronized[T0](arg0: ⇒ T0): T0

    Permalink
    Definition Classes
    AnyRef

  48. def tags: Map[String, String]

    Permalink
    Attributes
    protected
    Definition Classes
    AggregatorFunctionMixin

  49. lazy val timeHistogram: Histogram

    Permalink
    Attributes
    protected
    Definition Classes
    AggregatorFunctionMixin

  50. val timeWindowLengthMillis: Long

    Permalink
    Attributes
    protected
    Definition Classes
    EmitExtraWindowWhenNoDataTumblingAggregatorFunction → AggregatorFunctionMixin

  51. def toString(): String

    Permalink
    Definition Classes
    AnyRef → Any

  52. def updateState(stateValue: MapT[Long, AnyRef], stateValidity: Long, timeService: TimerService): Unit

    Permalink
    Attributes
    protected
    Definition Classes
    EmitExtraWindowWhenNoDataTumblingAggregatorFunction → StateHolder

  53. final def wait(arg0: Long, arg1: Int): Unit

    Permalink
    Definition Classes
    AnyRef
    Annotations
    @throws( ... )

  54. final def wait(arg0: Long): Unit

    Permalink
    Definition Classes
    AnyRef
    Annotations
    @throws( ... )

  55. final def wait(): Unit

    Permalink
    Definition Classes
    AnyRef
    Annotations
    @throws( ... )

Deprecated Value Members

  1. def finalize(): Unit

    Permalink
    Attributes
    protected[java.lang]
    Definition Classes
    AnyRef
    Annotations
    @Deprecated @deprecated @throws( classOf[java.lang.Throwable] )
    Deprecated

    (Since version ) see corresponding Javadoc for more information.

Inherited from AggregatorFunctionMixin[MapT]

Inherited from StateHolder[MapT[Long, AnyRef]]

Inherited from KeyedProcessFunction[String, ValueWithContext[StringKeyedValue[AnyRef]], ValueWithContext[AnyRef]]

Inherited from AbstractRichFunction

Inherited from RichFunction

Inherited from Function

Inherited from Serializable

Inherited from AnyRef

Inherited from Any

Ungrouped