org.apache.flink.table.runtime.operators.python.aggregate

Class PythonStreamGroupAggregateOperator

java.lang.Object

org.apache.flink.streaming.api.operators.AbstractStreamOperator<OUT>

org.apache.flink.streaming.api.operators.python.AbstractPythonFunctionOperator<OUT>

org.apache.flink.streaming.api.operators.python.AbstractOneInputPythonFunctionOperator<org.apache.flink.table.data.RowData,org.apache.flink.table.data.RowData>

org.apache.flink.table.runtime.operators.python.aggregate.AbstractPythonStreamAggregateOperator

org.apache.flink.table.runtime.operators.python.aggregate.AbstractPythonStreamGroupAggregateOperator

org.apache.flink.table.runtime.operators.python.aggregate.PythonStreamGroupAggregateOperator

All Implemented Interfaces:

Serializable, org.apache.flink.api.common.state.CheckpointListener, org.apache.flink.streaming.api.operators.BoundedOneInput, org.apache.flink.streaming.api.operators.Input<org.apache.flink.table.data.RowData>, org.apache.flink.streaming.api.operators.KeyContext, org.apache.flink.streaming.api.operators.OneInputStreamOperator<org.apache.flink.table.data.RowData,org.apache.flink.table.data.RowData>, org.apache.flink.streaming.api.operators.SetupableStreamOperator<org.apache.flink.table.data.RowData>, org.apache.flink.streaming.api.operators.StreamOperator<org.apache.flink.table.data.RowData>, org.apache.flink.streaming.api.operators.StreamOperatorStateHandler.CheckpointedStreamOperator, org.apache.flink.streaming.api.operators.Triggerable<org.apache.flink.table.data.RowData,org.apache.flink.runtime.state.VoidNamespace>, org.apache.flink.table.runtime.functions.CleanupState, org.apache.flink.util.Disposable

@Internal
public class PythonStreamGroupAggregateOperator
extends AbstractPythonStreamGroupAggregateOperator

The Python AggregateFunction operator for the blink planner.

See Also:

Serialized Form

Field Summary

Fields

Modifier and Type	Field and Description
protected static String	STREAM_GROUP_AGGREGATE_URN

Fields inherited from class org.apache.flink.table.runtime.operators.python.aggregate.AbstractPythonStreamAggregateOperator

bais, baisWrapper, baos, baosWrapper, FLINK_AGGREGATE_FUNCTION_SCHEMA_CODER_URN, inputType, outputType, rowDataWrapper, userDefinedFunctionInputType, userDefinedFunctionOutputType

Fields inherited from class org.apache.flink.streaming.api.operators.python.AbstractPythonFunctionOperator

elementCount, maxBundleSize, pythonFunctionRunner

Fields inherited from class org.apache.flink.streaming.api.operators.AbstractStreamOperator

chainingStrategy, latencyStats, LOG, metrics, output, processingTimeService

Constructor Summary

Constructors

Constructor and Description

PythonStreamGroupAggregateOperator(org.apache.flink.configuration.Configuration config, org.apache.flink.table.types.logical.RowType inputType, org.apache.flink.table.types.logical.RowType outputType, org.apache.flink.table.functions.python.PythonAggregateFunctionInfo[] aggregateFunctions, org.apache.flink.table.planner.typeutils.DataViewUtils.DataViewSpec[][] dataViewSpecs, int[] grouping, int indexOfCountStar, boolean countStarInserted, boolean generateUpdateBefore, long minRetentionTime, long maxRetentionTime)

Method Summary

Modifier and Type	Method and Description
String	getFunctionUrn()
FlinkFnApi.UserDefinedAggregateFunctions	getUserDefinedFunctionsProto() Gets the proto representation of the Python user-defined aggregate functions to be executed.

Methods inherited from class org.apache.flink.table.runtime.operators.python.aggregate.AbstractPythonStreamGroupAggregateOperator

emitResult, getUserDefinedFunctionInputType, getUserDefinedFunctionOutputType, onEventTime, onProcessingTime, open, processElementInternal

Methods inherited from class org.apache.flink.table.runtime.operators.python.aggregate.AbstractPythonStreamAggregateOperator

createPythonFunctionRunner, getCurrentKey, getKeyType, getPythonEnv, processElement, setCurrentKey

Methods inherited from class org.apache.flink.streaming.api.operators.python.AbstractOneInputPythonFunctionOperator

endInput

Methods inherited from class org.apache.flink.streaming.api.operators.python.AbstractPythonFunctionOperator

checkInvokeFinishBundleByCount, close, createPythonEnvironmentManager, dispose, emitResults, getConfig, getFlinkMetricContainer, getPythonConfig, invokeFinishBundle, isBundleFinished, prepareSnapshotPreBarrier, processWatermark, setPythonConfig

Methods inherited from class org.apache.flink.streaming.api.operators.AbstractStreamOperator

getChainingStrategy, getContainingTask, getExecutionConfig, getInternalTimerService, getKeyedStateBackend, getKeyedStateStore, getMetricGroup, getOperatorConfig, getOperatorID, getOperatorName, getOperatorStateBackend, getOrCreateKeyedState, getPartitionedState, getPartitionedState, getProcessingTimeService, getRuntimeContext, getTimeServiceManager, getUserCodeClassloader, initializeState, initializeState, isUsingCustomRawKeyedState, notifyCheckpointAborted, notifyCheckpointComplete, processLatencyMarker, processLatencyMarker1, processLatencyMarker2, processWatermark1, processWatermark2, reportOrForwardLatencyMarker, setChainingStrategy, setKeyContextElement1, setKeyContextElement2, setProcessingTimeService, setup, snapshotState, snapshotState

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Methods inherited from interface org.apache.flink.table.runtime.functions.CleanupState

registerProcessingCleanupTimer

Methods inherited from interface org.apache.flink.streaming.api.operators.OneInputStreamOperator

setKeyContextElement

Methods inherited from interface org.apache.flink.streaming.api.operators.StreamOperator

close, dispose, getMetricGroup, getOperatorID, initializeState, prepareSnapshotPreBarrier, setKeyContextElement1, setKeyContextElement2, snapshotState

Methods inherited from interface org.apache.flink.api.common.state.CheckpointListener

notifyCheckpointAborted, notifyCheckpointComplete

Methods inherited from interface org.apache.flink.streaming.api.operators.Input

processLatencyMarker, processWatermark

Field Detail

STREAM_GROUP_AGGREGATE_URN

@VisibleForTesting
protected static final String STREAM_GROUP_AGGREGATE_URN

See Also:

Constant Field Values

Constructor Detail

PythonStreamGroupAggregateOperator

public PythonStreamGroupAggregateOperator(org.apache.flink.configuration.Configuration config,
                                          org.apache.flink.table.types.logical.RowType inputType,
                                          org.apache.flink.table.types.logical.RowType outputType,
                                          org.apache.flink.table.functions.python.PythonAggregateFunctionInfo[] aggregateFunctions,
                                          org.apache.flink.table.planner.typeutils.DataViewUtils.DataViewSpec[][] dataViewSpecs,
                                          int[] grouping,
                                          int indexOfCountStar,
                                          boolean countStarInserted,
                                          boolean generateUpdateBefore,
                                          long minRetentionTime,
                                          long maxRetentionTime)

Method Detail

getUserDefinedFunctionsProto

public FlinkFnApi.UserDefinedAggregateFunctions getUserDefinedFunctionsProto()

Gets the proto representation of the Python user-defined aggregate functions to be executed.

Overrides:

getUserDefinedFunctionsProto in class AbstractPythonStreamGroupAggregateOperator

getFunctionUrn

public String getFunctionUrn()

Specified by:

getFunctionUrn in class AbstractPythonStreamAggregateOperator