A pipeline for transforming a single stream.
A pipeline for transforming a single stream. Passes the output of source() through transform() and the result of that into maybeSink(), which may pass it into sink() if we're not testing. Ultimately, returns the output data stream to facilitate testing.
implicit flink job config
data output stream
The output stream will only be passed to sink() if FlinkConfig.mockEdges evaluates to false (ie, you're not testing).
The output stream will only be passed to sink() if FlinkConfig.mockEdges evaluates to false (ie, you're not testing).
the output data stream to pass into sink()
implicit flink job config
Writes the transformed data stream to configured output sinks.
Writes the transformed data stream to configured output sinks. *
a transformed stream from transform()
implicit flink job config
Returns source data stream to pass into transform().
Returns source data stream to pass into transform(). This can be overridden by subclasses.
input data stream
Primary method to transform the source data stream into the output data stream.
Primary method to transform the source data stream into the output data stream. The output of this method is passed into sink(). This method must be overridden by subclasses.
input data stream created by source()
implicit flink job config
output data stream