flink

Type Members

1. abstract class BaseFlinkJob[OUT <: FlinkEvent] extends LazyLogging

   

2. abstract class DataControlJob[D <: FlinkEvent, C <: FlinkEvent, OUT <: FlinkEvent] extends FlinkJob[DataControlPeriod[D], OUT]

   

   A simple flink job that transforms a data stream and a control stream into an output stream.

   A simple flink job that transforms a data stream and a control stream into an output stream. This uses flink's CEP library to match sequences of data elements that fall between control elements that are alternately active and inactive. As an example, let on represent an active control, off represent an inactive control, and d to represent data elements. Then the following stream d1 d2 on d3 d4 d5 off d6 d7 would output one DataControlPeriod object with a start time of the timestamp of on, and end time of the timestamp of off and the elements d3, d4, d5 as the payload.

   D

   the data type

   C

   the control type

   OUT

   the output stream element type

3. abstract class FilterByControlJob[D <: FlinkEvent, C <: FlinkEvent, OUT <: FlinkEvent] extends FlinkJob[D, OUT]

   

   A simple flink job that interleaves a data stream and a control stream and creates a source of data records that occur during active control periods.

   A simple flink job that interleaves a data stream and a control stream and creates a source of data records that occur during active control periods.

   As an example, let on represent an active control, off represent an inactive control, and d to represent data elements. Then the following stream:

   d1 d2 on d3 d4 d5 off d6 d7

   would output d3 d4 d5.

   D

   the data type

   C

   the control type

   OUT

   the output stream element type

4. abstract class FlinkJob[IN <: FlinkEvent, OUT <: FlinkEvent] extends LazyLogging

   

   An abstract flink job to transform on a stream of events from an algebraic data type (ADT).

   An abstract flink job to transform on a stream of events from an algebraic data type (ADT).

   IN

   The type of input stream elements

   OUT

   The type of output stream elements

5. class IdentityJob[E <: FlinkEvent] extends FlinkJob[E, E]