Package

org.apache.gearpump.streaming.dsl

plan

Permalink

package plan

Visibility
  1. Public
  2. All

Type Members

  1. case class ChainableOp[IN, OUT](fn: FunctionRunner[IN, OUT], userConfig: UserConfig = UserConfig.empty) extends Op with Product with Serializable

    Permalink

    This represents operations that can be chained together (e.g.

    This represents operations that can be chained together (e.g. flatMap, map, filter, reduce) and further chained to another Op to be used

  2. case class DataSinkOp(dataSink: DataSink, parallelism: Int = 1, userConfig: UserConfig = UserConfig.empty, description: String = "sink") extends Op with Product with Serializable

    Permalink

    This represents a DataSink.

  3. case class DataSourceOp(dataSource: DataSource, parallelism: Int = 1, userConfig: UserConfig = UserConfig.empty, description: String = "source") extends Op with Product with Serializable

    Permalink

    This represents a DataSource.

  4. case class GroupByOp[IN, GROUP](groupBy: GroupAlsoByWindow[IN, GROUP], parallelism: Int = 1, description: String = "groupBy", userConfig: UserConfig = UserConfig.empty) extends Op with Product with Serializable

    Permalink

    This represents a Processor with window aggregation

  5. case class MergeOp(description: String, userConfig: UserConfig = UserConfig.empty) extends Op with Product with Serializable

    Permalink

    This represents a Processor transforming merged streams

  6. sealed trait Op extends AnyRef

    Permalink

    This is a vertex on the logical plan.

  7. class OpChainException extends RuntimeException

    Permalink

    Runtime exception thrown on chaining.

  8. trait OpEdge extends AnyRef

    Permalink

    This is an edge on the logical plan.

  9. class Planner extends AnyRef

    Permalink
  10. case class ProcessorOp[T <: Task](processor: Class[T], parallelism: Int, userConfig: UserConfig, description: String) extends Op with Product with Serializable

    Permalink

    This represents a low level Processor.

Value Members

  1. object Direct extends OpEdge with Product with Serializable

    Permalink

    The upstream OP and downstream OP doesn't require network data shuffle.

    The upstream OP and downstream OP doesn't require network data shuffle. e.g. ChainableOp

  2. object Shuffle extends OpEdge with Product with Serializable

    Permalink

    The upstream OP and downstream OP DOES require network data shuffle.

    The upstream OP and downstream OP DOES require network data shuffle. e.g. GroupByOp

  3. package functions

    Permalink

Ungrouped