org.apache.flink.streaming.runtime.io

Class AbstractStreamTaskNetworkInput<T,R extends org.apache.flink.runtime.io.network.api.serialization.RecordDeserializer<org.apache.flink.runtime.plugable.DeserializationDelegate<StreamElement>>>

java.lang.Object

org.apache.flink.streaming.runtime.io.AbstractStreamTaskNetworkInput<T,R>

All Implemented Interfaces:

Closeable, AutoCloseable, org.apache.flink.runtime.io.AvailabilityProvider, PushingAsyncDataInput<T>, StreamTaskInput<T>

Direct Known Subclasses:

RescalingStreamTaskNetworkInput, StreamTaskNetworkInput

public abstract class AbstractStreamTaskNetworkInput<T,R extends org.apache.flink.runtime.io.network.api.serialization.RecordDeserializer<org.apache.flink.runtime.plugable.DeserializationDelegate<StreamElement>>>
extends Object
implements StreamTaskInput<T>

Base class for network-based StreamTaskInput where each channel has a designated RecordDeserializer for spanning records. Specific implementation bind it to a specific RecordDeserializer.

Nested Class Summary

Nested classes/interfaces inherited from interface org.apache.flink.streaming.runtime.io.PushingAsyncDataInput

PushingAsyncDataInput.DataOutput<T>

Nested classes/interfaces inherited from interface org.apache.flink.runtime.io.AvailabilityProvider

org.apache.flink.runtime.io.AvailabilityProvider.AvailabilityHelper

Field Summary

Fields

Modifier and Type	Field and Description
protected StreamTask.CanEmitBatchOfRecordsChecker	canEmitBatchOfRecords
protected CheckpointedInputGate	checkpointedInputGate
protected org.apache.flink.runtime.plugable.DeserializationDelegate<StreamElement>	deserializationDelegate
protected Map<org.apache.flink.runtime.checkpoint.channel.InputChannelInfo,Integer>	flattenedChannelIndices
protected int	inputIndex
protected org.apache.flink.api.common.typeutils.TypeSerializer<T>	inputSerializer
protected Map<org.apache.flink.runtime.checkpoint.channel.InputChannelInfo,R>	recordDeserializers
protected StatusWatermarkValve	statusWatermarkValve Valve that controls how watermarks and watermark statuses are forwarded.

Fields inherited from interface org.apache.flink.streaming.runtime.io.StreamTaskInput

UNSPECIFIED

Fields inherited from interface org.apache.flink.runtime.io.AvailabilityProvider

AVAILABLE

Constructor Summary

Constructors

Constructor and Description
AbstractStreamTaskNetworkInput(CheckpointedInputGate checkpointedInputGate, org.apache.flink.api.common.typeutils.TypeSerializer<T> inputSerializer, StatusWatermarkValve statusWatermarkValve, int inputIndex, Map<org.apache.flink.runtime.checkpoint.channel.InputChannelInfo,R> recordDeserializers, StreamTask.CanEmitBatchOfRecordsChecker canEmitBatchOfRecords)

Method Summary

Modifier and Type	Method and Description
void	close()
DataInputStatus	emitNext(PushingAsyncDataInput.DataOutput<T> output) Pushes elements to the output from current data input, and returns the input status to indicate whether there are more available data in current input.
protected R	getActiveSerializer(org.apache.flink.runtime.checkpoint.channel.InputChannelInfo channelInfo)
CompletableFuture<?>	getAvailableFuture()
int	getInputIndex() Returns the input index of this input.
protected void	processBuffer(org.apache.flink.runtime.io.network.partition.consumer.BufferOrEvent bufferOrEvent)
protected DataInputStatus	processEvent(org.apache.flink.runtime.io.network.partition.consumer.BufferOrEvent bufferOrEvent)
protected void	releaseDeserializer(org.apache.flink.runtime.checkpoint.channel.InputChannelInfo channelInfo)

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Methods inherited from interface org.apache.flink.streaming.runtime.io.StreamTaskInput

prepareSnapshot

Methods inherited from interface org.apache.flink.runtime.io.AvailabilityProvider

and, isApproximatelyAvailable, isAvailable, or

Field Detail

checkpointedInputGate

protected final CheckpointedInputGate checkpointedInputGate

deserializationDelegate

protected final org.apache.flink.runtime.plugable.DeserializationDelegate<StreamElement> deserializationDelegate

inputSerializer

protected final org.apache.flink.api.common.typeutils.TypeSerializer<T> inputSerializer

recordDeserializers

protected final Map<org.apache.flink.runtime.checkpoint.channel.InputChannelInfo,R extends org.apache.flink.runtime.io.network.api.serialization.RecordDeserializer<org.apache.flink.runtime.plugable.DeserializationDelegate<StreamElement>>> recordDeserializers

flattenedChannelIndices

protected final Map<org.apache.flink.runtime.checkpoint.channel.InputChannelInfo,Integer> flattenedChannelIndices

statusWatermarkValve

protected final StatusWatermarkValve statusWatermarkValve

Valve that controls how watermarks and watermark statuses are forwarded.

inputIndex

protected final int inputIndex

canEmitBatchOfRecords

protected final StreamTask.CanEmitBatchOfRecordsChecker canEmitBatchOfRecords

Constructor Detail

AbstractStreamTaskNetworkInput

public AbstractStreamTaskNetworkInput(CheckpointedInputGate checkpointedInputGate,
                                      org.apache.flink.api.common.typeutils.TypeSerializer<T> inputSerializer,
                                      StatusWatermarkValve statusWatermarkValve,
                                      int inputIndex,
                                      Map<org.apache.flink.runtime.checkpoint.channel.InputChannelInfo,R> recordDeserializers,
                                      StreamTask.CanEmitBatchOfRecordsChecker canEmitBatchOfRecords)

Method Detail

emitNext

public DataInputStatus emitNext(PushingAsyncDataInput.DataOutput<T> output)
                         throws Exception

Description copied from interface: PushingAsyncDataInput

Pushes elements to the output from current data input, and returns the input status to indicate whether there are more available data in current input.

This method should be non blocking.

Specified by:

emitNext in interface PushingAsyncDataInput<T>

Throws:

Exception

processEvent

protected DataInputStatus processEvent(org.apache.flink.runtime.io.network.partition.consumer.BufferOrEvent bufferOrEvent)

processBuffer

protected void processBuffer(org.apache.flink.runtime.io.network.partition.consumer.BufferOrEvent bufferOrEvent)
                      throws IOException

Throws:

IOException

getActiveSerializer

protected R getActiveSerializer(org.apache.flink.runtime.checkpoint.channel.InputChannelInfo channelInfo)

getInputIndex

public int getInputIndex()

Description copied from interface: StreamTaskInput

Returns the input index of this input.

Specified by:

getInputIndex in interface StreamTaskInput<T>

getAvailableFuture

public CompletableFuture<?> getAvailableFuture()

Specified by:

getAvailableFuture in interface org.apache.flink.runtime.io.AvailabilityProvider

close

public void close()
           throws IOException

Specified by:

close in interface Closeable

Specified by:

close in interface AutoCloseable

Throws:

IOException

releaseDeserializer

protected void releaseDeserializer(org.apache.flink.runtime.checkpoint.channel.InputChannelInfo channelInfo)