TaskWrapper
Related Doc:
package task
task class
context class
user config
The actorRef of AppMaster
The actorRef of AppMaster
application master's actor reference
logger is environment dependant, it should be provided by containing environment.
logger is environment dependant, it should be provided by containing environment.
Method called for each message received.
Method called for each message received.
message send by upstream tasks
Method called with the task is initialized.
Method called with the task is initialized.
startTime that can be used to decide from when a source producer task should replay the data source, or from when a processor task should recover its checkpoint data in to in-memory state.
Method called when task is under clean up.
Method called when task is under clean up. This can be used to cleanup resource when the application finished.
This can be used to output messages to downstream tasks.
This can be used to output messages to downstream tasks. The data shuffling rule can be decided by Partitioner.
message to output
Use with caution, output unmanaged message to target tasks
Use with caution, output unmanaged message to target tasks
message to output
the tasks to output to
The task parallelism
The task parallelism
For example, we can create 3 source tasks, and 3 sink tasks, the task parallelism is 3 for each.
This can be useful when reading from partitioned data source. For example, for kafka, there may be 10 partitions, if we have parallelism of 2 for this task, then each task will be responsible to read data from 5 partitions.
the parallelism level
handler for unmanaged message
akka.actor.ActorRefProvider.scheduleOnce
akka.actor.ActorRefProvider.scheduleOnce
the initial delay
the function to execute after initial delay
the executable
Please don't use this if possible.
For managed message(type of Message), the sender only serve as a unique Id, It's address is not something meaningful, you should not use this directly
For managed message(type of Message), the sender only serve as a unique Id, It's address is not something meaningful, you should not use this directly
For unmanaged message, the sender represent the sender ActorRef
sender
Please don't use this if possible
Please don't use this if possible
the actor system
retrieve upstream min clock from TaskActor
retrieve upstream min clock from TaskActor
the min clock
This provides TaskContext for user defined tasks