Package

io.github.setl

workflow

Permalink

package workflow

Visibility
  1. Public
  2. All

Type Members

  1. sealed abstract class External extends Factory[External]

    Permalink
  2. class Pipeline extends Logging with HasRegistry[Stage] with HasDescription with Identifiable with HasBenchmark with HasDiagram

    Permalink

    Pipeline is a complete data transformation workflow.

    Pipeline is a complete data transformation workflow.

    Annotations
    @Evolving()
  3. trait PipelineOptimizer extends AnyRef

    Permalink
  4. class SimplePipelineOptimizer extends PipelineOptimizer with Logging

    Permalink
    Annotations
    @Unstable()
  5. class Stage extends Logging with Identifiable with HasRegistry[Factory[_]] with HasDescription with HasBenchmark with Writable

    Permalink

    A Stage is a collection of independent Factories.

    A Stage is a collection of independent Factories. All the stages of a pipeline will be executed sequentially at runtime. Within a stage, all factories could be executed in parallel or in sequential order.

    Annotations
    @Evolving()

Value Members

  1. object External

    Permalink

    Singleton for external data source

Ungrouped