com.snowplowanalytics.manifest.dynamodb
Default handler, adding Processing
for acquire and Processed
for release
Default handler, adding Processing
for acquire and Processed
for release
Helper to mark Item
as Failed
(put Failed
)
Helper to mark Item
as Failed
(put Failed
)
Get state of single item, with validating state of Item
Get state of single item, with validating state of Item
Get full manifest with items grouped by their id, without validating state of Item
Get full manifest with items grouped by their id, without validating state of Item
Get full manifest
Get full manifest
Turn raw Record
elements into DynamoDB DbItem
.
Turn raw Record
elements into DynamoDB DbItem
.
Can be overloaded by subclasses
Apply Process
function to all unprocessed events
For each item, lock will be held.
Apply Process
function to all unprocessed events
For each item, lock will be held. If any of items already holding a lock,
function breaks immediately
Acquire lock, apply processing function and write its result back to manifest
Acquire lock, apply processing function and write its result back to manifest
Similar to processItem
, but works without existing Item
,
instead it creates new one itself or queries it by known id
Should be used when app
is both adding item to manifest
and processes it straight afterwards
Similar to processItem
, but works without existing Item
,
instead it creates new one itself or queries it by known id
Should be used when app
is both adding item to manifest
and processes it straight afterwards
new item id, which should be either fetched or created
application doing discovering and processing
optional payload that will be added as part of Processing
,
can be e.g. notification that app
started to process it
with some special configuration (cross-batch dedupe enabled)
Process that does not expect existing item
Add an atomic record to manifest
Add an atomic record to manifest
Helper to release lock (put Processed
)
Helper to release lock (put Processed
)
Short-hand to get all unprocessed items
Short-hand to get all unprocessed items
AWS DynamoDB implementation of processing manifests