org.apache.flink.api.java

Class CollectionEnvironment

java.lang.Object

org.apache.flink.api.java.ExecutionEnvironment

org.apache.flink.api.java.CollectionEnvironment

public class CollectionEnvironment
extends ExecutionEnvironment

Constructor Summary

Constructors

Constructor and Description
CollectionEnvironment()

Method Summary

Methods

Modifier and Type	Method and Description
JobExecutionResult	execute(String jobName) Triggers the program execution.
int	getDegreeOfParallelism() Gets the degree of parallelism with which operation are executed by default.
String	getExecutionPlan() Creates the plan with which the system will execute the program, and returns it as a String using a JSON representation of the execution data flow graph.

Methods inherited from class org.apache.flink.api.java.ExecutionEnvironment

createHadoopInput, createHadoopInput, createInput, createInput, createLocalEnvironment, createLocalEnvironment, createProgramPlan, createProgramPlan, createProgramPlan, createRemoteEnvironment, createRemoteEnvironment, enableLocalExecution, execute, fromCollection, fromCollection, fromCollection, fromCollection, fromElements, fromParallelCollection, fromParallelCollection, generateSequence, getConfig, getExecutionEnvironment, getId, getIdString, getNumberOfExecutionRetries, initializeContextEnvironment, isContextEnvironmentSet, localExecutionIsAllowed, readCsvFile, readFile, readFileOfPrimitives, readFileOfPrimitives, readHadoopFile, readHadoopFile, readHadoopFile, readHadoopFile, readTextFile, readTextFile, readTextFileWithValue, readTextFileWithValue, registerCachedFile, registerCachedFile, registerCachedFilesWithPlan, setConfig, setDefaultLocalParallelism, setDegreeOfParallelism, setNumberOfExecutionRetries

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Detail

CollectionEnvironment

public CollectionEnvironment()

Method Detail

execute

public JobExecutionResult execute(String jobName)
                           throws Exception

Description copied from class: ExecutionEnvironment

Triggers the program execution. The environment will execute all parts of the program that have resulted in a "sink" operation. Sink operations are for example printing results (DataSet.print(), writing results (e.g. DataSet.writeAsText(String), DataSet.write(org.apache.flink.api.common.io.FileOutputFormat, String), or other generic data sinks created with DataSet.output(org.apache.flink.api.common.io.OutputFormat).

The program execution will be logged and displayed with the given job name.

Specified by:

execute in class ExecutionEnvironment

Returns:

The result of the job execution, containing elapsed time and accumulators.

Throws:

Exception - Thrown, if the program executions fails.

getDegreeOfParallelism

public int getDegreeOfParallelism()

Description copied from class: ExecutionEnvironment

Gets the degree of parallelism with which operation are executed by default. Operations can individually override this value to use a specific degree of parallelism via Operator.setParallelism(int). Other operations may need to run with a different degree of parallelism - for example calling DataSet.reduce(org.apache.flink.api.common.functions.ReduceFunction) over the entire set will insert eventually an operation that runs non-parallel (degree of parallelism of one).

Overrides:

getDegreeOfParallelism in class ExecutionEnvironment

Returns:

The degree of parallelism used by operations, unless they override that value. This method returns -1, if the environments default parallelism should be used.

getExecutionPlan

public String getExecutionPlan()
                        throws Exception

Description copied from class: ExecutionEnvironment

Creates the plan with which the system will execute the program, and returns it as a String using a JSON representation of the execution data flow graph. Note that this needs to be called, before the plan is executed.

Specified by:

getExecutionPlan in class ExecutionEnvironment

Returns:

The execution plan of the program, as a JSON String.

Throws:

Exception - Thrown, if the compiler could not be instantiated, or the master could not be contacted to retrieve information relevant to the execution planning.