io.cdap.cdap.etl.api.batch

Class BatchAutoJoiner

java.lang.Object

io.cdap.cdap.etl.api.batch.MultiInputBatchConfigurable<BatchJoinerContext>

io.cdap.cdap.etl.api.batch.BatchAutoJoiner

All Implemented Interfaces:

AutoJoiner, MultiInputPipelineConfigurable, SubmitterLifecycle<BatchJoinerContext>

@Beta
public abstract class BatchAutoJoiner
extends MultiInputBatchConfigurable<BatchJoinerContext>
implements AutoJoiner, MultiInputPipelineConfigurable

Joins input data, leaving implementation details up to the application.

Field Summary

Fields

Modifier and Type	Field and Description
static String	PLUGIN_TYPE

Constructor Summary

Constructors

Constructor and Description
BatchAutoJoiner()

Method Summary

Modifier and Type	Method and Description
void	configurePipeline(MultiInputPipelineConfigurer multiInputPipelineConfigurer) Configure the pipeline.
void	prepareRun(BatchJoinerContext context) Prepare a pipeline run.

Methods inherited from class io.cdap.cdap.etl.api.batch.MultiInputBatchConfigurable

onRunFinish

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Methods inherited from interface io.cdap.cdap.etl.api.join.AutoJoiner

define

Field Detail

PLUGIN_TYPE

public static final String PLUGIN_TYPE

See Also:

Constant Field Values

Constructor Detail

BatchAutoJoiner

public BatchAutoJoiner()

Method Detail

configurePipeline

public void configurePipeline(MultiInputPipelineConfigurer multiInputPipelineConfigurer)

Configure the pipeline. This is run once when the pipeline is being published. This is where you perform any static logic, like creating required datasets, performing schema validation, setting output schema, and things of that nature.

Specified by:

configurePipeline in interface MultiInputPipelineConfigurable

Overrides:

configurePipeline in class MultiInputBatchConfigurable<BatchJoinerContext>

Parameters:

multiInputPipelineConfigurer - the configurer used to add required datasets and streams

prepareRun

public void prepareRun(BatchJoinerContext context)
                throws Exception

Prepare a pipeline run. This is run every time before a pipeline runs in order to help set up the run. This is where you would set things like the number of partitions to use when joining, and setting the join key class if they are not known at compile time.

Specified by:

prepareRun in interface SubmitterLifecycle<BatchJoinerContext>

Specified by:

prepareRun in class MultiInputBatchConfigurable<BatchJoinerContext>

Parameters:

context - batch execution context

Throws:

Exception