org.apache.flink.streaming.runtime.io

类 StreamTaskSourceInput<T>

java.lang.Object

org.apache.flink.streaming.runtime.io.StreamTaskSourceInput<T>

所有已实现的接口:

Closeable, AutoCloseable, org.apache.flink.runtime.io.AvailabilityProvider, org.apache.flink.runtime.io.network.partition.consumer.CheckpointableInput, PushingAsyncDataInput<T>, StreamTaskInput<T>

直接已知子类:

StreamTaskExternallyInducedSourceInput

@Internal
public class StreamTaskSourceInput<T>
extends Object
implements StreamTaskInput<T>, org.apache.flink.runtime.io.network.partition.consumer.CheckpointableInput

Implementation of StreamTaskInput that reads data from the SourceOperator and returns the InputStatus to indicate whether the source state is available, unavailable or finished.

嵌套类概要

从接口继承的嵌套类/接口 org.apache.flink.streaming.runtime.io.PushingAsyncDataInput

PushingAsyncDataInput.DataOutput<T>

从接口继承的嵌套类/接口 org.apache.flink.runtime.io.AvailabilityProvider

org.apache.flink.runtime.io.AvailabilityProvider.AvailabilityHelper

字段概要

从接口继承的字段 org.apache.flink.streaming.runtime.io.StreamTaskInput

UNSPECIFIED

从接口继承的字段 org.apache.flink.runtime.io.AvailabilityProvider

AVAILABLE

构造器概要

构造器

构造器和说明
StreamTaskSourceInput(SourceOperator<T,?> operator, int inputGateIndex, int inputIndex)

方法概要

限定符和类型	方法和说明
void	blockConsumption(org.apache.flink.runtime.checkpoint.channel.InputChannelInfo channelInfo)
void	checkpointStarted(org.apache.flink.runtime.io.network.api.CheckpointBarrier barrier) This method is used with unaligned checkpoints to mark the arrival of a first CheckpointBarrier.
void	checkpointStopped(long cancelledCheckpointId)
void	close()
org.apache.flink.core.io.InputStatus	emitNext(PushingAsyncDataInput.DataOutput<T> output) Pushes the next element to the output from current data input, and returns the input status to indicate whether there are more available data in current input.
CompletableFuture<?>	getAvailableFuture()
List<org.apache.flink.runtime.checkpoint.channel.InputChannelInfo>	getChannelInfos()
int	getInputGateIndex()
int	getInputIndex() Returns the input index of this input.
int	getNumberOfInputChannels()
org.apache.flink.runtime.jobgraph.OperatorID	getOperatorID()
CompletableFuture<Void>	prepareSnapshot(org.apache.flink.runtime.checkpoint.channel.ChannelStateWriter channelStateWriter, long checkpointId) Prepares to spill the in-flight input buffers as checkpoint snapshot.
void	resumeConsumption(org.apache.flink.runtime.checkpoint.channel.InputChannelInfo channelInfo)

从类继承的方法 java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

从接口继承的方法 org.apache.flink.runtime.io.AvailabilityProvider

and, isApproximatelyAvailable, isAvailable, or

构造器详细资料

StreamTaskSourceInput

public StreamTaskSourceInput(SourceOperator<T,?> operator,
                             int inputGateIndex,
                             int inputIndex)

方法详细资料

emitNext

public org.apache.flink.core.io.InputStatus emitNext(PushingAsyncDataInput.DataOutput<T> output)
                                              throws Exception

从接口复制的说明: PushingAsyncDataInput

Pushes the next element to the output from current data input, and returns the input status to indicate whether there are more available data in current input.

This method should be non blocking.

指定者:

emitNext 在接口中 PushingAsyncDataInput<T>

抛出:

Exception

getAvailableFuture

public CompletableFuture<?> getAvailableFuture()

指定者:

getAvailableFuture 在接口中 org.apache.flink.runtime.io.AvailabilityProvider

blockConsumption

public void blockConsumption(org.apache.flink.runtime.checkpoint.channel.InputChannelInfo channelInfo)

指定者:

blockConsumption 在接口中 org.apache.flink.runtime.io.network.partition.consumer.CheckpointableInput

resumeConsumption

public void resumeConsumption(org.apache.flink.runtime.checkpoint.channel.InputChannelInfo channelInfo)

指定者:

resumeConsumption 在接口中 org.apache.flink.runtime.io.network.partition.consumer.CheckpointableInput

getChannelInfos

public List<org.apache.flink.runtime.checkpoint.channel.InputChannelInfo> getChannelInfos()

指定者:

getChannelInfos 在接口中 org.apache.flink.runtime.io.network.partition.consumer.CheckpointableInput

getNumberOfInputChannels

public int getNumberOfInputChannels()

指定者:

getNumberOfInputChannels 在接口中 org.apache.flink.runtime.io.network.partition.consumer.CheckpointableInput

checkpointStarted

public void checkpointStarted(org.apache.flink.runtime.io.network.api.CheckpointBarrier barrier)

This method is used with unaligned checkpoints to mark the arrival of a first CheckpointBarrier. For chained sources, there is no CheckpointBarrier per se flowing through the job graph. We can assume that an imaginary CheckpointBarrier was produced by the source, at any point of time of our choosing.

We are choosing to interpret it, that CheckpointBarrier for sources was received immediately as soon as we receive either checkpoint start RPC, or CheckpointBarrier from a network input. So that we can checkpoint state of the source and all of the other operators at the same time.

Also we are choosing to block the source, as a best effort optimisation as: - either there is no backpressure and the checkpoint "alignment" will happen very quickly anyway - or there is a backpressure, and it's better to prioritize processing data from the network to speed up checkpointing. From the cluster resource utilisation perspective, by blocking chained source doesn't block any resources from being used, as this task running the source has a backlog of buffered input data waiting to be processed.

However from the correctness point of view, checkpointStarted(CheckpointBarrier) and checkpointStopped(long) methods could be empty no-op.

指定者:

checkpointStarted 在接口中 org.apache.flink.runtime.io.network.partition.consumer.CheckpointableInput

checkpointStopped

public void checkpointStopped(long cancelledCheckpointId)

指定者:

checkpointStopped 在接口中 org.apache.flink.runtime.io.network.partition.consumer.CheckpointableInput

getInputGateIndex

public int getInputGateIndex()

指定者:

getInputGateIndex 在接口中 org.apache.flink.runtime.io.network.partition.consumer.CheckpointableInput

getInputIndex

public int getInputIndex()

从接口复制的说明: StreamTaskInput

Returns the input index of this input.

指定者:

getInputIndex 在接口中 StreamTaskInput<T>

close

public void close()

指定者:

close 在接口中 Closeable

指定者:

close 在接口中 AutoCloseable

prepareSnapshot

public CompletableFuture<Void> prepareSnapshot(org.apache.flink.runtime.checkpoint.channel.ChannelStateWriter channelStateWriter,
                                               long checkpointId)

从接口复制的说明: StreamTaskInput

Prepares to spill the in-flight input buffers as checkpoint snapshot.

指定者:

prepareSnapshot 在接口中 StreamTaskInput<T>

getOperatorID

public org.apache.flink.runtime.jobgraph.OperatorID getOperatorID()