static details about the table, with custom metadata
list of region details
object that actually interacts with the physical storage
parent folder which contains folders with table names
function that generates region ids
Returns regions ids for all active regions.
Include all records between the given timestamps.
Include all records between the given timestamps.
if no data in storage layer, return None
Appends a new set of records to the audit table.
Appends a new set of records to the audit table.
Fails when is called second time on same instance.
records to append
column that returns java.sql.Timestamp that will be used for de-duplication on the primary keys
timestamp of when the append has happened. It will not be used for de-duplications
(new state of the AuditTable, count of appended records) or error
parent folder which contains folders with table names
Compacts all hot regions into one cold.
Compacts all hot regions into one cold.
Request optimisation of the storage layer.
Request optimisation of the storage layer.
Fails when is called second time on same instance.
timestamp of when the compaction is requested, will not be used for any filtering of the data
Maximum age of old region files kept in the .Trash folder after a compaction has happened.
new state of the AuditTable
Merges all regions below specific fresh cold into one cold region.
Merges all regions below specific fresh cold into one cold region.
Returns latest timestamp of records stored in the audit table.
Returns latest timestamp of records stored in the audit table.
Initializes audit table in the storage layer.
Initializes audit table in the storage layer. It will also persist all of the metadata (name, primary keys, custom meta) to the storage layer.
new state of the table or error
Each function that modifies the state of the storage layer must call this function in the first line.
Each function that modifies the state of the storage layer must call this function in the first line. As audit's table state can be modified only once.
Custom attributes assigned by the client application during table creation.
Custom attributes assigned by the client application during table creation.
function that generates region ids
list of region details
list of region details
Generates snapshot that contains only the latest records for the given timestamp.
Generates snapshot that contains only the latest records for the given timestamp. De-duplication happens on the primary keys.
use records that are closest to this timestamp
if no data in storage layer, return None
object that actually interacts with the physical storage
static details about the table, with custom metadata
Name of the table.
Name of the table.
Not thread safe.
Not thread safe. Protection against using mutator functions more than one time.
Implementation of the AuditTable which is backed up by append only block storage like HDFS.
Created by Alexei Perelighin on 2018/03/03