fs2.aws.dynamodb

Type members

Classlikes

case class CommittableRecord(shardId: String, recordProcessorStartingSequenceNumber: ExtendedSequenceNumber, millisBehindLatest: Long, record: RecordAdapter, recordProcessor: RecordProcessor, checkpointer: IRecordProcessorCheckpointer, inFlightRecordsPhaser: Phaser)

A message type from Kinesis which has not yet been commited or checkpointed.

A message type from Kinesis which has not yet been commited or checkpointed.

Value parameters:
checkpointer

reference to the checkpointer used to commit this record

millisBehindLatest

ms behind the latest record, used to detect if the consumer is lagging the producer

record

the original record document from Kinesis

recordProcessor

reference to the record processor that is responsible for processing this message

shardId

the unique identifier for the shard from which this record originated

Constructor:

create a new commitable record with a name and age.

Companion:
object
Companion:
class
trait DynamoDB[F[_]]
Companion:
object
object DynamoDB
Companion:
class

Settings for configuring the Kinesis checkpointer pipe

Settings for configuring the Kinesis checkpointer pipe

Value parameters:
maxBatchSize

the maximum number of records to aggregate before checkpointing the cluster of records. Passing 1 means checkpoint on every record

maxBatchWait

the maximum amount of time to wait before checkpointing the cluster of records

Companion:
object

Settings for configuring the Kinesis consumer stream

Settings for configuring the Kinesis consumer stream

Value parameters:
bufferSize

size of the internal buffer used when reading messages from Kinesis

Companion:
object
class RecordProcessor(cb: CommittableRecord => Unit) extends IRecordProcessor

Concrete implementation of the AWS RecordProcessor interface. Wraps incoming records into CommitableRecord types to allow for downstream checkpointing

Concrete implementation of the AWS RecordProcessor interface. Wraps incoming records into CommitableRecord types to allow for downstream checkpointing

Value parameters:
cb

callback function to run on record receive, passing the new CommittableRecord

Constructor:

create a new instance with a callback function to perform on record receive

trait StreamScan[F[_]]
Companion:
object
object StreamScan
Companion:
class