@Beta public interface PipelineConfigurable
Modifier and Type | Method and Description |
---|---|
void |
configurePipeline(PipelineConfigurer pipelineConfigurer)
Configure an ETL pipeline, registering datasets and plugins that the stage needs.
|
void configurePipeline(PipelineConfigurer pipelineConfigurer)
ValidationException
if there are any
invalid config properties, or if the input or output schema is not compatible. Output schema should also be set.
This method is called many times during the lifecycle of a pipeline so it should not generate any side effects.
When the pipeline is being constructed, this is called in order to validate the pipeline and
propagate schema. Any datasets registered at this time will be ignored. Config properties that contain macros
will not have been evaluated yet.
When the pipeline is deployed, this is called in order to validate the pipeline and create any datasets that
are registered. Config properties that contain macros will not have been evaluated yet.pipelineConfigurer
- the configurer used to register required datasets and pluginsValidationException
- if the pipeline stage is invalidCopyright © 2021 Cask Data, Inc. Licensed under the Apache License, Version 2.0.