A little syntactic sugar for writing stream program.
A little syntactic sugar for writing stream program. This is the pipe operator, ala F#.
Assuming
source
This let's us write
def program:DataStream[E] = source |> transform |# sink
instead of
def program:DataStream[E] = { val result:DataStream[E] = transform(source) sink(result) result }
source }}}
def program:DataStream[E] = source |> transform |# sink
instead of
def program:DataStream[E] = { val result:DataStream[E] = transform(source) sink(result) result }
the type of v
Creates an ascending timestamp extractor.
Creates an ascending timestamp extractor.
type of stream element
AscendingTimestampExtractor[E]
Generates a timestamp and watermark assigner for a stream with a given type of element that limits how late an element is allowed to arrive in event time.
Generates a timestamp and watermark assigner for a stream with a given type of element that limits how late an element is allowed to arrive in event time.
the type of stream element
implicitly provided job config
BoundedLatenessGenerator[E]
Configure stream from collection source.
Configure stream from collection source.
stream element type
a source config
implicitly provided job config
DataStream[E]
Configure stream from file source.
Configure stream from file source.
stream element type
a source config
implicitly provided job config
DataStream[E]
Configure stream from kafka source.
Configure stream from kafka source.
stream element type
a source config
implicitly provided job config
DataStream[E]
Configure stream from keyed kafka source.
Configure stream from keyed kafka source.
stream element type
a source config
implicitly provided job config
DataStream[E]
Configure stream from socket source.
Configure stream from socket source.
stream element type
a source config
implicitly provided job config
DataStream[E]
Configure stream source from configuration.
Configure stream source from configuration.
stream element type
the name of the source to get its configuration
DataStream[E]
Returns the actual path to a resource file named filename or filename.gz.
Returns the actual path to a resource file named filename or filename.gz.
the name of file
String
Send stream to a rolling file sink.
Send stream to a rolling file sink.
stream element type
the data stream
a sink configuration
implicit job args
DataStreamSink[E]
Send stream to a socket sink.
Send stream to a socket sink.
stream element type
the data stream
a sink configuration
implicit job args
DataStreamSink[E]
Send stream to a kafka sink.
Send stream to a kafka sink.
stream element type
the data stream
a sink configuration
implicit job args
DataStreamSink[E]
Send stream to a keyed kafka sink.
Send stream to a keyed kafka sink.
stream element type
the data stream
a sink configuration
implicit job args
DataStreamSink[E]
Configure stream sink from configuration.
Configure stream sink from configuration.
stream element type
the data stream to send to sink
a sink name to obtain configuration
implicit flink job args
DataStream[E]
Send stream to a socket sink.
Send stream to a socket sink.
stream element type
the data stream
a sink configuration
implicit job args
DataStreamSink[E]