GenericKinesis
Attributes
- Graph
- Supertypes
Members list
Value members
Concrete methods
Pipe to checkpoint records in Kinesis, marking them as processed Groups records by shard id, so that each shard is subject to its own clustering of records After accumulating maxBatchSize or reaching maxBatchWait for a respective shard, the latest record is checkpointed By design, all records prior to the checkpointed record are also checkpointed in Kinesis
Pipe to checkpoint records in Kinesis, marking them as processed Groups records by shard id, so that each shard is subject to its own clustering of records After accumulating maxBatchSize or reaching maxBatchWait for a respective shard, the latest record is checkpointed By design, all records prior to the checkpointed record are also checkpointed in Kinesis
Attributes
- checkpointSettings
configure maxBatchSize and maxBatchWait time before triggering a checkpoint
- Returns:
a stream of Record types representing checkpointed messages
Inherited methods
Initialize a worker and start streaming records from a DynamoDB stream On stream finish (due to error or other), worker will be shutdown
Initialize a worker and start streaming records from a DynamoDB stream On stream finish (due to error or other), worker will be shutdown
Attributes
- workerConfiguration
configuration parameters for the KCL
- Returns:
an infinite fs2 Stream that emits DynamoDB Records
- Inherited from:
- DynamoDB
Initialize a worker and start streaming records from a DynamoDB stream On stream finish (due to error or other), worker will be shutdown
Initialize a worker and start streaming records from a DynamoDB stream On stream finish (due to error or other), worker will be shutdown
Attributes
- appName
name of the DynamoDB application. Used by KCL when resharding
- streamName
name of the DynamoDB stream to consume from
- Returns:
an infinite fs2 Stream that emits Kinesis Records
- Inherited from:
- DynamoDB