org.apache.flink.api.java.operators

Class DataSource<OUT>

java.lang.Object

org.apache.flink.api.java.DataSet<OUT>

org.apache.flink.api.java.operators.DataSource<OUT>

Type Parameters:

OUT - The type of the elements produced by this data source.

public class DataSource<OUT>
extends DataSet<OUT>

An operation that creates a new data set (data source). The operation acts as the data set on which to apply further transformations. It encapsulates additional configuration parameters, to customize the execution.

Constructor Summary

Constructors

Constructor and Description
DataSource(ExecutionEnvironment context, InputFormat<OUT,?> inputFormat, TypeInformation<OUT> type) Creates a new data source.

Method Summary

Methods

Modifier and Type	Method and Description
InputFormat<OUT,?>	getInputFormat() Gets the input format that is executed by this data source.
int	getParallelism() Returns the degree of parallelism of this data source.
DataSource<OUT>	name(String name) Sets the name of the data source operation.
DataSource<OUT>	setParallelism(int dop) Sets the degree of parallelism for this data source.
protected GenericDataSourceBase<OUT,?>	translateToDataFlow()

Methods inherited from class org.apache.flink.api.java.DataSet

aggregate, checkSameExecutionContext, coGroup, cross, crossWithHuge, crossWithTiny, distinct, distinct, distinct, filter, flatMap, getExecutionEnvironment, getType, groupBy, groupBy, iterate, iterateDelta, join, joinWithHuge, joinWithTiny, map, max, min, output, print, printToErr, project, reduce, reduceGroup, runOperation, sum, union, write, write, writeAsCsv, writeAsCsv, writeAsCsv, writeAsText, writeAsText

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Detail

DataSource

public DataSource(ExecutionEnvironment context,
          InputFormat<OUT,?> inputFormat,
          TypeInformation<OUT> type)

Creates a new data source.

Parameters:

context - The environment in which the data source gets executed.

inputFormat - The input format that the data source executes.

type - The type of the elements produced by this input format.

Method Detail

getInputFormat

public InputFormat<OUT,?> getInputFormat()

Gets the input format that is executed by this data source.

Returns:

The input format that is executed by this data source.

name

public DataSource<OUT> name(String name)

Sets the name of the data source operation. The name will be used for logging and other messages. The default name is a textual representation of the input format.

Parameters:

name - The name for the data source.

Returns:

The data source object itself, to allow for function call chaining.

getParallelism

public int getParallelism()

Returns the degree of parallelism of this data source.

Returns:

The degree of parallelism of this data source.

setParallelism

public DataSource<OUT> setParallelism(int dop)

Sets the degree of parallelism for this data source. The degree must be 1 or more.

Parameters:

dop - The degree of parallelism for this data source.

Returns:

This data source with set degree of parallelism.

translateToDataFlow

protected GenericDataSourceBase<OUT,?> translateToDataFlow()