org.apache.flink.api.java.operators

类 DataSource<OUT>

java.lang.Object

org.apache.flink.api.java.DataSet<OUT>

org.apache.flink.api.java.operators.Operator<OUT,DataSource<OUT>>

org.apache.flink.api.java.operators.DataSource<OUT>

类型参数:

OUT - The type of the elements produced by this data source.

@Public
public class DataSource<OUT>
extends Operator<OUT,DataSource<OUT>>

An operation that creates a new data set (data source). The operation acts as the data set on which to apply further transformations. It encapsulates additional configuration parameters, to customize the execution.

字段概要

从类继承的字段 org.apache.flink.api.java.operators.Operator

minResources, name, parallelism, preferredResources

从类继承的字段 org.apache.flink.api.java.DataSet

context

构造器概要

构造器

构造器和说明
DataSource(ExecutionEnvironment context, org.apache.flink.api.common.io.InputFormat<OUT,?> inputFormat, org.apache.flink.api.common.typeinfo.TypeInformation<OUT> type, String dataSourceLocationName) Creates a new data source.

方法概要

限定符和类型	方法和说明
org.apache.flink.api.common.io.InputFormat<OUT,?>	getInputFormat() Gets the input format that is executed by this data source.
org.apache.flink.configuration.Configuration	getParameters()
SplitDataProperties<OUT>	getSplitDataProperties() Returns the SplitDataProperties for the InputSplits of this DataSource for configurations.
protected org.apache.flink.api.common.operators.GenericDataSourceBase<OUT,?>	translateToDataFlow()
DataSource<OUT>	withParameters(org.apache.flink.configuration.Configuration parameters) Pass a configuration to the InputFormat.

从类继承的方法 org.apache.flink.api.java.operators.Operator

getMinResources, getName, getParallelism, getPreferredResources, getResultType, name, setParallelism

从类继承的方法 org.apache.flink.api.java.DataSet

aggregate, checkSameExecutionContext, clean, coGroup, collect, combineGroup, count, cross, crossWithHuge, crossWithTiny, distinct, distinct, distinct, distinct, fillInType, filter, first, flatMap, fullOuterJoin, fullOuterJoin, getExecutionEnvironment, getType, groupBy, groupBy, groupBy, iterate, iterateDelta, join, join, joinWithHuge, joinWithTiny, leftOuterJoin, leftOuterJoin, map, mapPartition, max, maxBy, min, minBy, output, partitionByHash, partitionByHash, partitionByHash, partitionByRange, partitionByRange, partitionByRange, partitionCustom, partitionCustom, partitionCustom, print, print, printOnTaskManager, printToErr, printToErr, project, rebalance, reduce, reduceGroup, rightOuterJoin, rightOuterJoin, runOperation, sortPartition, sortPartition, sortPartition, sum, union, write, write, writeAsCsv, writeAsCsv, writeAsCsv, writeAsCsv, writeAsFormattedText, writeAsFormattedText, writeAsText, writeAsText

从类继承的方法 java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

构造器详细资料

DataSource

public DataSource(ExecutionEnvironment context,
                  org.apache.flink.api.common.io.InputFormat<OUT,?> inputFormat,
                  org.apache.flink.api.common.typeinfo.TypeInformation<OUT> type,
                  String dataSourceLocationName)

Creates a new data source.

参数:

context - The environment in which the data source gets executed.

inputFormat - The input format that the data source executes.

type - The type of the elements produced by this input format.

方法详细资料

getInputFormat

@Internal
public org.apache.flink.api.common.io.InputFormat<OUT,?> getInputFormat()

Gets the input format that is executed by this data source.

返回:

The input format that is executed by this data source.

withParameters

public DataSource<OUT> withParameters(org.apache.flink.configuration.Configuration parameters)

Pass a configuration to the InputFormat.

参数:

parameters - Configuration parameters

getParameters

public org.apache.flink.configuration.Configuration getParameters()

返回:

Configuration for the InputFormat.

getSplitDataProperties

@PublicEvolving
public SplitDataProperties<OUT> getSplitDataProperties()

Returns the SplitDataProperties for the InputSplits of this DataSource for configurations.

SplitDataProperties can help to generate more efficient execution plans.

IMPORTANT: Incorrect configuration of SplitDataProperties can cause wrong results!

返回:

The SplitDataProperties for the InputSplits of this DataSource.

translateToDataFlow

protected org.apache.flink.api.common.operators.GenericDataSourceBase<OUT,?> translateToDataFlow()