org.apache.flink.streaming.api.datastream

类 DataStreamUtils

java.lang.Object

org.apache.flink.streaming.api.datastream.DataStreamUtils

@Experimental
public final class DataStreamUtils
extends Object

A collection of utilities for DataStreams.

嵌套类概要

嵌套类

限定符和类型	类和说明
static class	DataStreamUtils.ClientAndIterator<E> A pair of an Iterator to receive results from a streaming application and a JobClient to interact with the program.

方法概要

限定符和类型	方法和说明
static <OUT> Iterator<OUT>	collect(DataStream<OUT> stream) Triggers the distributed execution of the streaming dataflow and returns an iterator over the elements of the given DataStream.
static <OUT> Iterator<OUT>	collect(DataStream<OUT> stream, String executionJobName) Triggers the distributed execution of the streaming dataflow and returns an iterator over the elements of the given DataStream.
static <E> List<E>	collectBoundedStream(DataStream<E> stream, String jobName) Collects contents the given DataStream into a list, assuming that the stream is a bounded stream.
static <E> List<E>	collectRecordsFromUnboundedStream(DataStreamUtils.ClientAndIterator<E> client, int numElements)
static <E> List<E>	collectUnboundedStream(DataStream<E> stream, int numElements, String jobName) Triggers execution of the DataStream application and collects the given number of records from the stream.
static <OUT> DataStreamUtils.ClientAndIterator<OUT>	collectWithClient(DataStream<OUT> stream, String jobExecutionName) Starts the execution of the program and returns an iterator to read the result of the given data stream, plus a JobClient to interact with the application execution.
static <T,K> KeyedStream<T,K>	reinterpretAsKeyedStream(DataStream<T> stream, org.apache.flink.api.java.functions.KeySelector<T,K> keySelector) Reinterprets the given DataStream as a KeyedStream, which extracts keys with the given KeySelector.
static <T,K> KeyedStream<T,K>	reinterpretAsKeyedStream(DataStream<T> stream, org.apache.flink.api.java.functions.KeySelector<T,K> keySelector, org.apache.flink.api.common.typeinfo.TypeInformation<K> typeInfo) Reinterprets the given DataStream as a KeyedStream, which extracts keys with the given KeySelector.

从类继承的方法 java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

方法详细资料

collect

public static <OUT> Iterator<OUT> collect(DataStream<OUT> stream)

Triggers the distributed execution of the streaming dataflow and returns an iterator over the elements of the given DataStream.

The DataStream application is executed in the regular distributed manner on the target environment, and the events from the stream are polled back to this application process and thread through Flink's REST API.

collect

public static <OUT> Iterator<OUT> collect(DataStream<OUT> stream,
                                          String executionJobName)

Triggers the distributed execution of the streaming dataflow and returns an iterator over the elements of the given DataStream.

The DataStream application is executed in the regular distributed manner on the target environment, and the events from the stream are polled back to this application process and thread through Flink's REST API.

collectWithClient

public static <OUT> DataStreamUtils.ClientAndIterator<OUT> collectWithClient(DataStream<OUT> stream,
                                                                             String jobExecutionName)
                                                                      throws Exception

Starts the execution of the program and returns an iterator to read the result of the given data stream, plus a JobClient to interact with the application execution.

抛出:

Exception

collectBoundedStream

public static <E> List<E> collectBoundedStream(DataStream<E> stream,
                                               String jobName)
                                        throws Exception

Collects contents the given DataStream into a list, assuming that the stream is a bounded stream.

This method blocks until the job execution is complete. By the time the method returns, the job will have reached its FINISHED status.

Note that if the stream is unbounded, this method will never return and might fail with an Out-of-Memory Error because it attempts to collect an infinite stream into a list.

抛出:

Exception - Exceptions that occur during the execution are forwarded.

collectUnboundedStream

public static <E> List<E> collectUnboundedStream(DataStream<E> stream,
                                                 int numElements,
                                                 String jobName)
                                          throws Exception

Triggers execution of the DataStream application and collects the given number of records from the stream. After the records are received, the execution is canceled.

抛出:

Exception

collectRecordsFromUnboundedStream

public static <E> List<E> collectRecordsFromUnboundedStream(DataStreamUtils.ClientAndIterator<E> client,
                                                            int numElements)

reinterpretAsKeyedStream

public static <T,K> KeyedStream<T,K> reinterpretAsKeyedStream(DataStream<T> stream,
                                                              org.apache.flink.api.java.functions.KeySelector<T,K> keySelector)

Reinterprets the given DataStream as a KeyedStream, which extracts keys with the given KeySelector.

IMPORTANT: For every partition of the base stream, the keys of events in the base stream must be partitioned exactly in the same way as if it was created through a DataStream.keyBy(KeySelector).

类型参数:

T - Type of events in the data stream.

K - Type of the extracted keys.

参数:

stream - The data stream to reinterpret. For every partition, this stream must be partitioned exactly in the same way as if it was created through a DataStream.keyBy(KeySelector).

keySelector - Function that defines how keys are extracted from the data stream.

返回:

The reinterpretation of the DataStream as a KeyedStream.

reinterpretAsKeyedStream

public static <T,K> KeyedStream<T,K> reinterpretAsKeyedStream(DataStream<T> stream,
                                                              org.apache.flink.api.java.functions.KeySelector<T,K> keySelector,
                                                              org.apache.flink.api.common.typeinfo.TypeInformation<K> typeInfo)

Reinterprets the given DataStream as a KeyedStream, which extracts keys with the given KeySelector.

IMPORTANT: For every partition of the base stream, the keys of events in the base stream must be partitioned exactly in the same way as if it was created through a DataStream.keyBy(KeySelector).

类型参数:

T - Type of events in the data stream.

K - Type of the extracted keys.

参数:

stream - The data stream to reinterpret. For every partition, this stream must be partitioned exactly in the same way as if it was created through a DataStream.keyBy(KeySelector).

keySelector - Function that defines how keys are extracted from the data stream.

typeInfo - Explicit type information about the key type.

返回:

The reinterpretation of the DataStream as a KeyedStream.