Package | Description |
---|---|
org.apache.flink.streaming.api.functions.sink.filesystem | |
org.apache.flink.streaming.api.operators | |
org.apache.flink.streaming.api.operators.async | |
org.apache.flink.streaming.api.operators.sorted.state | |
org.apache.flink.streaming.api.operators.source | |
org.apache.flink.streaming.runtime.tasks |
This package contains classes that realize streaming tasks.
|
Constructor and Description |
---|
StreamingFileSinkHelper(Buckets<IN,?> buckets,
boolean isRestored,
org.apache.flink.api.common.state.OperatorStateStore stateStore,
ProcessingTimeService procTimeService,
long bucketCheckInterval) |
Modifier and Type | Field and Description |
---|---|
protected ProcessingTimeService |
AbstractStreamOperatorFactory.processingTimeService |
protected ProcessingTimeService |
AbstractStreamOperator.processingTimeService |
protected ProcessingTimeService |
AbstractStreamOperatorV2.processingTimeService |
Modifier and Type | Method and Description |
---|---|
ProcessingTimeService |
StreamOperatorParameters.getProcessingTimeService() |
ProcessingTimeService |
AbstractStreamOperator.getProcessingTimeService()
Returns the
ProcessingTimeService responsible for getting the current processing time
and registering timers. |
ProcessingTimeService |
StreamingRuntimeContext.getProcessingTimeService() |
ProcessingTimeService |
AbstractStreamOperatorV2.getProcessingTimeService()
Returns the
ProcessingTimeService responsible for getting the current processing time
and registering timers. |
Modifier and Type | Method and Description |
---|---|
static <OUT,OP extends StreamOperator<OUT>> |
StreamOperatorFactoryUtil.createOperator(StreamOperatorFactory<OUT> operatorFactory,
StreamTask<OUT,?> containingTask,
StreamConfig configuration,
Output<StreamRecord<OUT>> output,
org.apache.flink.runtime.operators.coordination.OperatorEventDispatcher operatorEventDispatcher)
Creates a new operator using a factory and makes sure that all special factory traits are
properly handled.
|
Modifier and Type | Method and Description |
---|---|
static <K> InternalTimeServiceManagerImpl<K> |
InternalTimeServiceManagerImpl.create(org.apache.flink.runtime.state.CheckpointableKeyedStateBackend<K> keyedStateBackend,
ClassLoader userClassloader,
KeyContext keyContext,
ProcessingTimeService processingTimeService,
Iterable<org.apache.flink.runtime.state.KeyGroupStatePartitionStreamProvider> rawKeyedStates)
A factory method for creating the
InternalTimeServiceManagerImpl . |
<K> InternalTimeServiceManager<K> |
InternalTimeServiceManager.Provider.create(org.apache.flink.runtime.state.CheckpointableKeyedStateBackend<K> keyedStatedBackend,
ClassLoader userClassloader,
KeyContext keyContext,
ProcessingTimeService processingTimeService,
Iterable<org.apache.flink.runtime.state.KeyGroupStatePartitionStreamProvider> rawKeyedStates) |
static <OUT> SourceFunction.SourceContext<OUT> |
StreamSourceContexts.getSourceContext(TimeCharacteristic timeCharacteristic,
ProcessingTimeService processingTimeService,
Object checkpointLock,
Output<StreamRecord<OUT>> output,
long watermarkInterval,
long idleTimeout,
boolean emitProgressiveWatermarks)
Depending on the
TimeCharacteristic , this method will return the adequate SourceFunction.SourceContext . |
void |
AbstractStreamOperatorFactory.setProcessingTimeService(ProcessingTimeService processingTimeService) |
void |
AbstractStreamOperator.setProcessingTimeService(ProcessingTimeService processingTimeService)
Deprecated.
The
ProcessingTimeService instance should be passed by the operator
constructor and this method will be removed along with SetupableStreamOperator . |
StreamOperatorStateContext |
StreamTaskStateInitializerImpl.streamOperatorStateContext(org.apache.flink.runtime.jobgraph.OperatorID operatorID,
String operatorClassName,
ProcessingTimeService processingTimeService,
KeyContext keyContext,
org.apache.flink.api.common.typeutils.TypeSerializer<?> keySerializer,
org.apache.flink.core.fs.CloseableRegistry streamTaskCloseableRegistry,
org.apache.flink.metrics.MetricGroup metricGroup,
double managedMemoryFraction,
boolean isUsingCustomRawKeyedState) |
StreamOperatorStateContext |
StreamTaskStateInitializer.streamOperatorStateContext(org.apache.flink.runtime.jobgraph.OperatorID operatorID,
String operatorClassName,
ProcessingTimeService processingTimeService,
KeyContext keyContext,
org.apache.flink.api.common.typeutils.TypeSerializer<?> keySerializer,
org.apache.flink.core.fs.CloseableRegistry streamTaskCloseableRegistry,
org.apache.flink.metrics.MetricGroup metricGroup,
double managedMemoryFraction,
boolean isUsingCustomRawKeyedState)
Returns the
StreamOperatorStateContext for an AbstractStreamOperator that
runs in the stream task that owns this manager. |
Constructor and Description |
---|
SourceOperator(org.apache.flink.util.function.FunctionWithException<org.apache.flink.api.connector.source.SourceReaderContext,org.apache.flink.api.connector.source.SourceReader<OUT,SplitT>,Exception> readerFactory,
org.apache.flink.runtime.operators.coordination.OperatorEventGateway operatorEventGateway,
org.apache.flink.core.io.SimpleVersionedSerializer<SplitT> splitSerializer,
org.apache.flink.api.common.eventtime.WatermarkStrategy<OUT> watermarkStrategy,
ProcessingTimeService timeService,
org.apache.flink.configuration.Configuration configuration,
String localHostname,
boolean emitProgressiveWatermarks,
StreamTask.CanEmitBatchOfRecordsChecker canEmitBatchOfRecords) |
StreamingRuntimeContext(org.apache.flink.runtime.execution.Environment env,
Map<String,org.apache.flink.api.common.accumulators.Accumulator<?,?>> accumulators,
org.apache.flink.metrics.groups.OperatorMetricGroup operatorMetricGroup,
org.apache.flink.runtime.jobgraph.OperatorID operatorID,
ProcessingTimeService processingTimeService,
org.apache.flink.api.common.state.KeyedStateStore keyedStateStore,
org.apache.flink.runtime.externalresource.ExternalResourceInfoProvider externalResourceInfoProvider) |
Constructor and Description |
---|
StreamOperatorParameters(StreamTask<?,?> containingTask,
StreamConfig config,
Output<StreamRecord<OUT>> output,
java.util.function.Supplier<ProcessingTimeService> processingTimeServiceFactory,
org.apache.flink.runtime.operators.coordination.OperatorEventDispatcher operatorEventDispatcher) |
Constructor and Description |
---|
AsyncWaitOperator(AsyncFunction<IN,OUT> asyncFunction,
long timeout,
int capacity,
AsyncDataStream.OutputMode outputMode,
AsyncRetryStrategy<OUT> asyncRetryStrategy,
ProcessingTimeService processingTimeService,
org.apache.flink.api.common.operators.MailboxExecutor mailboxExecutor) |
Modifier and Type | Method and Description |
---|---|
static <K> InternalTimeServiceManager<K> |
BatchExecutionInternalTimeServiceManager.create(org.apache.flink.runtime.state.CheckpointableKeyedStateBackend<K> keyedStatedBackend,
ClassLoader userClassloader,
KeyContext keyContext,
ProcessingTimeService processingTimeService,
Iterable<org.apache.flink.runtime.state.KeyGroupStatePartitionStreamProvider> rawKeyedStates) |
Constructor and Description |
---|
BatchExecutionInternalTimeServiceManager(ProcessingTimeService processingTimeService) |
Modifier and Type | Method and Description |
---|---|
static <E> TimestampsAndWatermarks<E> |
TimestampsAndWatermarks.createProgressiveEventTimeLogic(org.apache.flink.api.common.eventtime.WatermarkStrategy<E> watermarkStrategy,
org.apache.flink.metrics.MetricGroup metrics,
ProcessingTimeService timeService,
long periodicWatermarkIntervalMillis) |
Constructor and Description |
---|
ProgressiveTimestampsAndWatermarks(org.apache.flink.api.common.eventtime.TimestampAssigner<T> timestampAssigner,
org.apache.flink.api.common.eventtime.WatermarkGeneratorSupplier<T> watermarksFactory,
org.apache.flink.api.common.eventtime.WatermarkGeneratorSupplier.Context watermarksContext,
ProcessingTimeService timeService,
java.time.Duration periodicWatermarkInterval) |
Modifier and Type | Interface and Description |
---|---|
interface |
TimerService
A common timer service interface with life cycle methods.
|
Modifier and Type | Class and Description |
---|---|
class |
SystemProcessingTimeService
A
TimerService which assigns as current processing time the result of calling System.currentTimeMillis() and registers timers using a ScheduledThreadPoolExecutor . |
class |
TestProcessingTimeService
This is a
TimerService and ProcessingTimeService used strictly for testing
the processing time functionality. |
Modifier and Type | Method and Description |
---|---|
ProcessingTimeService |
ProcessingTimeServiceFactory.createProcessingTimeService(org.apache.flink.api.common.operators.MailboxExecutor mailboxExecutor)
Creates a new processing time service with the mailbox executor.
|
Modifier and Type | Method and Description |
---|---|
void |
ProcessingTimeServiceAware.setProcessingTimeService(ProcessingTimeService processingTimeService) |
Copyright © 2014–2023 The Apache Software Foundation. All rights reserved.