Package

pl.touk.nussknacker.engine.flink.api

process

Permalink

package process

Visibility
  1. Public
  2. All

Type Members

  1. abstract class AbstractLazyParameterInterpreterFunction extends AbstractRichFunction with LazyParameterInterpreterFunction

    Permalink
  2. abstract class AbstractOneParamLazyParameterFunction[T <: AnyRef] extends AbstractRichFunction with OneParamLazyParameterFunction[T]

    Permalink
  3. case class BasicContextInitializingFunction[Raw](processId: String, taskName: String) extends RichMapFunction[Raw, Context] with ContextInitializingFunction with Product with Serializable

    Permalink

    Maps raw source event to Context where default "input" variable represents the event.

    Maps raw source event to Context where default "input" variable represents the event.

    Raw

    - type of raw event that is generated by flink source function.

    processId

    - id of the process or flink job, used to setup name of created Context

    taskName

    - name of the task within the process or flink job, used to setup name of created Context

  4. class BasicFlinkContextInitializer[Raw] extends FlinkContextInitializer[Raw]

    Permalink

    Basic implementation of context initializer.

    Basic implementation of context initializer. Used when raw event produced by SourceFunction does not need further transformations and should be assigned to default "input" variable directly.

    Raw

    - type of raw event that is generated by flink source function.

  5. abstract class BasicFlinkGenericContextInitializer[Raw, DefinedParameter <: BaseDefinedParameter] extends BasicFlinkContextInitializer[Raw] with FlinkGenericContextInitializer[Raw, DefinedParameter]

    Permalink

    Basic implementation of context initializer for sources based on pl.touk.nussknacker.engine.api.context.transformation.GenericNodeTransformation.

    Basic implementation of context initializer for sources based on pl.touk.nussknacker.engine.api.context.transformation.GenericNodeTransformation. Requires proper definition of outputVariableType.

    Raw

    - type of raw event that is generated by flink source function, see FlinkIntermediateRawSource.

    DefinedParameter

    - type of parameters used in the node, see pl.touk.nussknacker.engine.api.context.transformation.GenericNodeTransformation.

  6. trait BasicFlinkSink extends FlinkSink with ExplicitUidInOperatorsSupport

    Permalink

    This is basic Flink sink, which just uses *output* expression from sink definition

  7. trait BasicFlinkSource[Raw] extends FlinkSource[Raw] with FlinkIntermediateRawSource[Raw]

    Permalink

    Typical source with methods specific for Flink, user has only to define Source function.

    Typical source with methods specific for Flink, user has only to define Source function.

    Raw

    - type of raw event that is generated by flink source function. This is needed to handle e.g. syntax suggestions in UI (in sources with explicite @MethodToInvoke).

  8. abstract class FlinkContextInitializer[Raw] extends Serializable

    Permalink

    FlinkContextInitializer provides definition of a map function that transforms raw event to Context.

    FlinkContextInitializer provides definition of a map function that transforms raw event to Context.

    Raw

    - type of raw event that is generated by flink source function.

  9. trait FlinkCustomJoinTransformation extends AnyRef

    Permalink

    Join functionality is not complete, many things are not implemented yet - validation context passed to both BranchExpression and JoinContextTransformationDef should be taken from incoming branches - cannot test&generate test data from other branches

    Join functionality is not complete, many things are not implemented yet - validation context passed to both BranchExpression and JoinContextTransformationDef should be taken from incoming branches - cannot test&generate test data from other branches

    Additionally, a lot of refactoring should be done - removing tree structures - should CustomNode and Join be sth different in ConfigCreator

    Some important TODOs are marked with TODO JOIN

  10. case class FlinkCustomNodeContext(jobData: JobData, nodeId: String, timeout: FiniteDuration, lazyParameterHelper: FlinkLazyParameterFunctionHelper, signalSenderProvider: FlinkProcessSignalSenderProvider, exceptionHandlerPreparer: (RuntimeContext) ⇒ FlinkEspExceptionHandler, globalParameters: Option[NkGlobalParameters], validationContext: Either[ValidationContext, Map[String, ValidationContext]], typeInformationDetection: TypeInformationDetection, runMode: RunMode) extends Product with Serializable

    Permalink
  11. trait FlinkCustomStreamTransformation extends AnyRef

    Permalink
  12. trait FlinkGenericContextInitializer[Raw, DefinedParameter <: BaseDefinedParameter] extends AnyRef

    Permalink

    Context initializer for sources based on pl.touk.nussknacker.engine.api.context.transformation.GenericNodeTransformation.

    Context initializer for sources based on pl.touk.nussknacker.engine.api.context.transformation.GenericNodeTransformation.

    Raw

    - type of raw event that is generated by flink source function, see FlinkIntermediateRawSource.

    DefinedParameter

    - type of parameters used in the node, see pl.touk.nussknacker.engine.api.context.transformation.GenericNodeTransformation.

  13. trait FlinkIntermediateRawSource[Raw] extends ExplicitUidInOperatorsSupport

    Permalink

    Source with typical source stream trasformations:

    Source with typical source stream trasformations:

    1. adds source using provided SourceFunction (here raw source produces raw data) 2. sets UID 3. assigns timestamp and watermarks 4. initializes Context that is streamed within output DataStream (here raw data are mapped to Context) It separates raw event data produced by SourceFunction and data released to the stream as Context variables. By default it uses basic "single input value" implementation of initializer, see BasicFlinkContextInitializer.
    Raw

    - type of raw event that is generated by flink source function.

  14. class FlinkLazyParameterFunctionHelper extends Serializable

    Permalink
  15. class FlinkProcessSignalSenderProvider extends AnyRef

    Permalink
  16. trait FlinkSink extends Sink

    Permalink

    Implementations of this trait can use LazyParameters and e.g.

    Implementations of this trait can use LazyParameters and e.g. ignore output (requiresOutput = false in SinkFactory)

  17. trait FlinkSource[T] extends Source[T]

    Permalink

    Source with methods specific for Flink

    Source with methods specific for Flink

    T

    - type of the event that is generated by flink source function. This is needed to handle e.g. syntax suggestions in UI (in sources with explicite @MethodToInvoke).

  18. abstract class FlinkSourceFactory[T] extends SourceFactory[T] with Serializable

    Permalink
  19. trait FlinkSourceTestSupport[Raw] extends FlinkIntermediateRawSource[Raw] with SourceTestSupport[Raw]

    Permalink

    Support for test mechanism for typical flink sources.

    Support for test mechanism for typical flink sources.

    Raw

    - type of raw event that is generated by flink source function. This is needed to handle e.g. syntax suggestions in UI (in sources with explicite @MethodToInvoke).

  20. class LazyParameterFilterFunction extends AbstractOneParamLazyParameterFunction[Boolean] with FilterFunction[Context]

    Permalink
  21. trait LazyParameterInterpreterFunction extends AnyRef

    Permalink
  22. class LazyParameterMapFunction[T <: AnyRef] extends AbstractOneParamLazyParameterFunction[T] with MapFunction[Context, ValueWithContext[T]]

    Permalink
  23. trait OneParamLazyParameterFunction[T <: AnyRef] extends LazyParameterInterpreterFunction

    Permalink
  24. case class SignalSenderKey(id: String, klass: Class[_]) extends Product with Serializable

    Permalink

Value Members

  1. object FlinkCustomStreamTransformation

    Permalink
  2. object FlinkSourceFactory extends Serializable

    Permalink

Ungrouped