GenericKinesis
Attributes
- Graph
-
- Supertypes
Members list
Value members
Concrete methods
Pipe to checkpoint records in Kinesis, marking them as processed Groups records by shard id, so that each shard is subject to its own clustering of records After accumulating maxBatchSize or reaching maxBatchWait for a respective shard, the latest record is checkpointed By design, all records prior to the checkpointed record are also checkpointed in Kinesis
Pipe to checkpoint records in Kinesis, marking them as processed Groups records by shard id, so that each shard is subject to its own clustering of records After accumulating maxBatchSize or reaching maxBatchWait for a respective shard, the latest record is checkpointed By design, all records prior to the checkpointed record are also checkpointed in Kinesis
Value parameters
- checkpointSettings
-
configure maxBatchSize and maxBatchWait time before triggering a checkpoint
Attributes
- Returns
-
a stream of Record types representing checkpointed messages
Inherited methods
Initialize a worker and start streaming records from a DynamoDB stream On stream finish (due to error or other), worker will be shutdown
Initialize a worker and start streaming records from a DynamoDB stream On stream finish (due to error or other), worker will be shutdown
Value parameters
- workerConfiguration
-
configuration parameters for the KCL
Attributes
- Returns
-
an infinite fs2 Stream that emits DynamoDB Records
- Inherited from:
- DynamoDB
Initialize a worker and start streaming records from a DynamoDB stream On stream finish (due to error or other), worker will be shutdown
Initialize a worker and start streaming records from a DynamoDB stream On stream finish (due to error or other), worker will be shutdown
Value parameters
- appName
-
name of the DynamoDB application. Used by KCL when resharding
- streamName
-
name of the DynamoDB stream to consume from
Attributes
- Returns
-
an infinite fs2 Stream that emits Kinesis Records
- Inherited from:
- DynamoDB