org.apache.flink.streaming.runtime.tasks

Class SourceStreamTask<OUT,SRC extends SourceFunction<OUT>,OP extends StreamSource<OUT,SRC>>

java.lang.Object

org.apache.flink.runtime.jobgraph.tasks.AbstractInvokable

org.apache.flink.streaming.runtime.tasks.StreamTask<OUT,OP>

org.apache.flink.streaming.runtime.tasks.SourceStreamTask<OUT,SRC,OP>

Type Parameters:

OUT - Type of the output elements of this source.

SRC - Type of the source function for the stream source operator

OP - Type of the stream source operator

All Implemented Interfaces:

AsyncExceptionHandler

@Internal
public class SourceStreamTask<OUT,SRC extends SourceFunction<OUT>,OP extends StreamSource<OUT,SRC>>
extends StreamTask<OUT,OP>

StreamTask for executing a StreamSource.

One important aspect of this is that the checkpointing and the emission of elements must never occur at the same time. The execution must be serial. This is achieved by having the contract with the SourceFunction that it must only modify its state or emit elements in a synchronized block that locks on the lock Object. Also, the modification of the state and the emission of elements must happen in the same block of code that is protected by the synchronized block.

Nested Class Summary

Nested classes/interfaces inherited from class org.apache.flink.streaming.runtime.tasks.StreamTask

StreamTask.ActionContext, StreamTask.AsyncCheckpointRunnable

Field Summary

Fields inherited from class org.apache.flink.streaming.runtime.tasks.StreamTask

configuration, headOperator, inputProcessor, mailbox, operatorChain, stateBackend, timerService, TRIGGER_THREAD_GROUP

Constructor Summary

Constructors

Constructor and Description
SourceStreamTask(org.apache.flink.runtime.execution.Environment env)

Method Summary

Modifier and Type	Method and Description
protected void	advanceToEndOfEventTime() Emits the MAX_WATERMARK so that all registered timers are fired.
protected void	cancelTask()
protected void	cleanup()
protected void	finishTask() Instructs the task to go through its normal termination routine, i.e.
Optional<Thread>	getExecutingThread()
protected void	init()
protected void	processInput(StreamTask.ActionContext context) This method implements the default action of the task (e.g.
boolean	triggerCheckpoint(org.apache.flink.runtime.checkpoint.CheckpointMetaData checkpointMetaData, org.apache.flink.runtime.checkpoint.CheckpointOptions checkpointOptions, boolean advanceToEndOfEventTime)

Methods inherited from class org.apache.flink.streaming.runtime.tasks.StreamTask

abortCheckpointOnBarrier, cancel, createCheckpointExceptionHandlerFactory, createRecordWriters, createStreamTaskStateInitializer, finalize, getAccumulatorMap, getAsyncOperationsThreadPool, getCancelables, getCheckpointLock, getCheckpointStorage, getConfiguration, getName, getProcessingTimeService, getStreamStatusMaintainer, handleAsyncException, invoke, isCanceled, isRunning, notifyCheckpointComplete, toString, triggerCheckpointOnBarrier

Methods inherited from class org.apache.flink.runtime.jobgraph.tasks.AbstractInvokable

getCurrentNumberOfSubtasks, getEnvironment, getExecutionConfig, getIndexInSubtaskGroup, getJobConfiguration, getTaskConfiguration, getUserCodeClassLoader, setShouldInterruptOnCancel, shouldInterruptOnCancel

Methods inherited from class java.lang.Object

clone, equals, getClass, hashCode, notify, notifyAll, wait, wait, wait

Constructor Detail

SourceStreamTask

public SourceStreamTask(org.apache.flink.runtime.execution.Environment env)

Method Detail

init

protected void init()

Specified by:

init in class StreamTask<OUT,OP extends StreamSource<OUT,SRC>>

advanceToEndOfEventTime

protected void advanceToEndOfEventTime()
                                throws Exception

Description copied from class: StreamTask

Emits the MAX_WATERMARK so that all registered timers are fired.

This is used by the source task when the job is TERMINATED. In the case, we want all the timers registered throughout the pipeline to fire and the related state (e.g. windows) to be flushed.

For tasks other than the source task, this method does nothing.

Overrides:

advanceToEndOfEventTime in class StreamTask<OUT,OP extends StreamSource<OUT,SRC>>

Throws:

Exception

cleanup

protected void cleanup()

Overrides:

cleanup in class StreamTask<OUT,OP extends StreamSource<OUT,SRC>>

processInput

protected void processInput(StreamTask.ActionContext context)
                     throws Exception

Description copied from class: StreamTask

This method implements the default action of the task (e.g. processing one event from the input). Implementations should (in general) be non-blocking.

Overrides:

processInput in class StreamTask<OUT,OP extends StreamSource<OUT,SRC>>

Parameters:

context - context object for collaborative interaction between the action and the stream task.

Throws:

Exception - on any problems in the action.

cancelTask

protected void cancelTask()

Overrides:

cancelTask in class StreamTask<OUT,OP extends StreamSource<OUT,SRC>>

finishTask

protected void finishTask()
                   throws Exception

Description copied from class: StreamTask

Instructs the task to go through its normal termination routine, i.e. exit the run-loop and call StreamOperator.close() and StreamOperator.dispose() on its operators.

This is used by the source task to get out of the run-loop when the job is stoppped with a savepoint.

For tasks other than the source task, this method does nothing.

Overrides:

finishTask in class StreamTask<OUT,OP extends StreamSource<OUT,SRC>>

Throws:

Exception

getExecutingThread

public Optional<Thread> getExecutingThread()

Overrides:

getExecutingThread in class org.apache.flink.runtime.jobgraph.tasks.AbstractInvokable

triggerCheckpoint

public boolean triggerCheckpoint(org.apache.flink.runtime.checkpoint.CheckpointMetaData checkpointMetaData,
                                 org.apache.flink.runtime.checkpoint.CheckpointOptions checkpointOptions,
                                 boolean advanceToEndOfEventTime)
                          throws Exception

Overrides:

triggerCheckpoint in class StreamTask<OUT,OP extends StreamSource<OUT,SRC>>

Throws:

Exception