- Companion:
- object
Value members
Abstract methods
Pipe to checkpoint records in Kinesis, marking them as processed Groups records by shard id, so that each shard is subject to its own clustering of records After accumulating maxBatchSize or reaching maxBatchWait for a respective shard, the latest record is checkpointed By design, all records prior to the checkpointed record are also checkpointed in Kinesis
Pipe to checkpoint records in Kinesis, marking them as processed Groups records by shard id, so that each shard is subject to its own clustering of records After accumulating maxBatchSize or reaching maxBatchWait for a respective shard, the latest record is checkpointed By design, all records prior to the checkpointed record are also checkpointed in Kinesis
- Type parameters:
- F
effect type of the fs2 stream
- Value parameters:
- checkpointSettings
configure maxBatchSize and maxBatchWait time before triggering a checkpoint
- Returns:
a stream of Record types representing checkpointed messages
Initialize a worker and start streaming records from a DynamoDB stream On stream finish (due to error or other), worker will be shutdown
Initialize a worker and start streaming records from a DynamoDB stream On stream finish (due to error or other), worker will be shutdown
- Type parameters:
- F
effect type of the fs2 stream
- Value parameters:
- appName
name of the DynamoDB application. Used by KCL when resharding
- streamName
name of the DynamoDB stream to consume from
- Returns:
an infinite fs2 Stream that emits Kinesis Records
Initialize a worker and start streaming records from a DynamoDB stream On stream finish (due to error or other), worker will be shutdown
Initialize a worker and start streaming records from a DynamoDB stream On stream finish (due to error or other), worker will be shutdown
- Type parameters:
- F
effect type of the fs2 stream
- Value parameters:
- consumerConfig
configuration parameters for the KCL
- Returns:
an infinite fs2 Stream that emits DynamoDB Records