io.cdap.cdap.api.mapreduce

Interface MapReduceContext

All Superinterfaces:

ClientLocalizationContext, DatasetContext, FeatureFlagsProvider, LineageRecorder, MessagingContext, MetadataReader, MetadataWriter, PluginContext, RuntimeContext, SchedulableProgramContext, SecureStore, ServiceDiscoverer, Transactional, WorkflowInfoProvider

public interface MapReduceContext
extends SchedulableProgramContext, RuntimeContext, DatasetContext, ServiceDiscoverer, Transactional, PluginContext, ClientLocalizationContext, WorkflowInfoProvider, SecureStore, MessagingContext, LineageRecorder, MetadataReader, MetadataWriter

MapReduce job execution context.

Method Summary

Modifier and Type	Method and Description
void	addInput(Input input) Updates the input configuration of this MapReduce job to use the specified Input.
void	addInput(Input input, Class<?> mapperCls) Updates the input configuration of this MapReduce job to use the specified Input.
void	addOutput(Output output) Updates the output configuration of this MapReduce job to use the specified Output.
<T> T	getHadoopJob() Returns the actual Hadoop job.
long	getLogicalStartTime() Returns the logical start time of this MapReduce job.
MapReduceSpecification	getSpecification()
ProgramState	getState() Return the state of the MapReduce program.
void	setMapperResources(Resources resources) Overrides the resources, such as memory and virtual cores, to use for each mapper of this MapReduce job.
void	setReducerResources(Resources resources) Override the resources, such as memory and virtual cores, to use for each reducer of this MapReduce job.

Methods inherited from interface io.cdap.cdap.api.SchedulableProgramContext

getTriggeringScheduleInfo

Methods inherited from interface io.cdap.cdap.api.RuntimeContext

getAdmin, getApplicationSpecification, getClusterName, getDataTracer, getNamespace, getRunId, getRuntimeArguments

Methods inherited from interface io.cdap.cdap.api.data.DatasetContext

discardDataset, getDataset, getDataset, getDataset, getDataset, releaseDataset

Methods inherited from interface io.cdap.cdap.api.ServiceDiscoverer

getServiceURL, getServiceURL, getServiceURL, openConnection

Methods inherited from interface io.cdap.cdap.api.Transactional

execute, execute

Methods inherited from interface io.cdap.cdap.api.plugin.PluginContext

getPluginProperties, getPluginProperties, loadPluginClass, newPluginInstance, newPluginInstance

Methods inherited from interface io.cdap.cdap.api.feature.FeatureFlagsProvider

isFeatureEnabled

Methods inherited from interface io.cdap.cdap.api.ClientLocalizationContext

localize, localize

Methods inherited from interface io.cdap.cdap.api.workflow.WorkflowInfoProvider

getWorkflowInfo, getWorkflowToken

Methods inherited from interface io.cdap.cdap.api.security.store.SecureStore

get, getData, getMetadata, list

Methods inherited from interface io.cdap.cdap.api.messaging.MessagingContext

getDirectMessagePublisher, getMessageFetcher, getMessagePublisher

Methods inherited from interface io.cdap.cdap.api.lineage.field.LineageRecorder

flushLineage, record

Methods inherited from interface io.cdap.cdap.api.metadata.MetadataReader

getMetadata, getMetadata

Methods inherited from interface io.cdap.cdap.api.metadata.MetadataWriter

addProperties, addTags, addTags, removeMetadata, removeProperties, removeProperties, removeTags, removeTags

Method Detail

getSpecification

MapReduceSpecification getSpecification()

Returns:

The specification used to configure this MapReduce job instance.

getLogicalStartTime

long getLogicalStartTime()

Returns the logical start time of this MapReduce job. Logical start time is the time when this MapReduce job is supposed to start if this job is started by the scheduler. Otherwise it would be the current time when the job runs.

Returns:

Time in milliseconds since epoch time (00:00:00 January 1, 1970 UTC).

getHadoopJob

<T> T getHadoopJob()

Returns the actual Hadoop job.

addInput

void addInput(Input input)

Updates the input configuration of this MapReduce job to use the specified Input.

Parameters:

input - the input to be used

Throws:

IllegalStateException - if called after any setInput methods.

addInput

void addInput(Input input,
              Class<?> mapperCls)

Updates the input configuration of this MapReduce job to use the specified Input.

Parameters:

input - the input to be used

mapperCls - the mapper class to be used for the input

Throws:

IllegalStateException - if called after any setInput methods.

addOutput

void addOutput(Output output)

Updates the output configuration of this MapReduce job to use the specified Output.

Parameters:

output - the output to be used

setMapperResources

void setMapperResources(Resources resources)

Overrides the resources, such as memory and virtual cores, to use for each mapper of this MapReduce job.

Parameters:

resources - Resources that each mapper should use.

setReducerResources

void setReducerResources(Resources resources)

Override the resources, such as memory and virtual cores, to use for each reducer of this MapReduce job.

Parameters:

resources - Resources that each reducer should use.

getState

ProgramState getState()

Return the state of the MapReduce program.