org.apache.flink.streaming.runtime.io

Class BarrierTracker

java.lang.Object

org.apache.flink.streaming.runtime.io.BarrierTracker

All Implemented Interfaces:

CheckpointBarrierHandler

@Internal
public class BarrierTracker
extends Object
implements CheckpointBarrierHandler

The BarrierTracker keeps track of what checkpoint barriers have been received from which input channels. Once it has observed all checkpoint barriers for a checkpoint ID, it notifies its listener of a completed checkpoint.

Unlike the BarrierBuffer, the BarrierTracker does not block the input channels that have sent barriers, so it cannot be used to gain "exactly-once" processing guarantees. It can, however, be used to gain "at least once" processing guarantees.

NOTE: This implementation strictly assumes that newer checkpoints have higher checkpoint IDs.

Constructor Summary

Constructors

Constructor and Description
BarrierTracker(InputGate inputGate)

Method Summary

Methods

Modifier and Type	Method and Description
void	cleanup() Cleans up all internally held resources.
long	getAlignmentDurationNanos() Gets the time that the latest alignment took, in nanoseconds.
BufferOrEvent	getNextNonBlocked() Returns the next BufferOrEvent that the operator may consume.
boolean	isEmpty() Checks if the barrier handler has buffered any data internally.
void	registerCheckpointEventHandler(StatefulTask toNotifyOnCheckpoint) Registers the task be notified once all checkpoint barriers have been received for a checkpoint.

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Detail

BarrierTracker

public BarrierTracker(InputGate inputGate)

Method Detail

getNextNonBlocked

public BufferOrEvent getNextNonBlocked()
                                throws Exception

Description copied from interface: CheckpointBarrierHandler

Returns the next BufferOrEvent that the operator may consume. This call blocks until the next BufferOrEvent is available, or until the stream has been determined to be finished.

Specified by:

getNextNonBlocked in interface CheckpointBarrierHandler

Returns:

The next BufferOrEvent, or null, if the stream is finished.

Throws:

IOException - Thrown if the network or local disk I/O fails.

InterruptedException - Thrown if the thread is interrupted while blocking during waiting for the next BufferOrEvent to become available.

Exception - Thrown in case that a checkpoint fails that is started as the result of receiving the last checkpoint barrier

registerCheckpointEventHandler

public void registerCheckpointEventHandler(StatefulTask toNotifyOnCheckpoint)

Description copied from interface: CheckpointBarrierHandler

Registers the task be notified once all checkpoint barriers have been received for a checkpoint.

Specified by:

registerCheckpointEventHandler in interface CheckpointBarrierHandler

Parameters:

toNotifyOnCheckpoint - The task to notify

cleanup

public void cleanup()

Description copied from interface: CheckpointBarrierHandler

Cleans up all internally held resources.

Specified by:

cleanup in interface CheckpointBarrierHandler

isEmpty

public boolean isEmpty()

Description copied from interface: CheckpointBarrierHandler

Checks if the barrier handler has buffered any data internally.

Specified by:

isEmpty in interface CheckpointBarrierHandler

Returns:

True, if no data is buffered internally, false otherwise.

getAlignmentDurationNanos

public long getAlignmentDurationNanos()

Description copied from interface: CheckpointBarrierHandler

Gets the time that the latest alignment took, in nanoseconds. If there is currently an alignment in progress, it will return the time spent in the current alignment so far.

Specified by:

getAlignmentDurationNanos in interface CheckpointBarrierHandler

Returns:

The duration in nanoseconds