Creates the configured table, if the table already exists, does nothing
Retrieves a single schema using its ID from the storage.
Retrieves a single schema using its ID from the storage.
the ID of the schema
an option that is empty if no schema was found for the ID or defined if a schema was found
Loads all schemas found on the storage.
Loads all schemas found on the storage. This method can be invoked multiple times: to initialize the initial values or to update the existing ones with the new data found on the storage.
a sequence of all the pairs (ID, schema) found on the storage
Inserts all the schema passed as parameters in the storage.
Inserts all the schema passed as parameters in the storage. This method is called when new schemas should be registered in the storage (the test if a schema is already in the storage should be performed before the invocation of this method, e.g. by checking them against the pre-loaded cache).
a sequence of pairs (ID, schema) Schema entities to insert in the storage.
Retrieves the latest schema for a given string identifier (not to be confused with the fingerprint id).
Retrieves the latest schema for a given string identifier (not to be confused with the fingerprint id). This API might not be implemented by all connectors, which should return None
a message indicating the user what he/she should do to create the table him/herself
Returns whether or not the configured table exists
Extracts the schema ID from the avro single-object encoded ByteBuffer, the ByteBuffer position will be after the header when this method returns
Extracts the schema ID from the avro single-object encoded ByteBuffer, the ByteBuffer position will be after the header when this method returns
avro single-object encoded byte array
the endianness that will be used to read fingerprint bytes, it won't affect how avro payload is read, that is up to the darwin user
the schema ID extracted from the input data
Extracts the schema ID from the avro single-object encoded at the head of this input stream.
Extracts the schema ID from the avro single-object encoded at the head of this input stream. The input stream will have 10 bytes consumed if the first two bytes correspond to the single object encoded header, or zero bytes consumed if the InputStream supports marking; if it doesn't, the first bytes (up to 2) will be consumed and returned in the Left part of the Either.
avro single-object encoded input stream
the endianness that will be used to read fingerprint bytes, it won't affect how avro payload is read, that is up to the darwin user
the schema ID extracted from the input data
Extracts the schema ID from the avro single-object encoded byte array
Extracts the schema ID from the avro single-object encoded byte array
avro single-object encoded byte array
the endianness that will be used to read fingerprint bytes, it won't affect how avro payload is read, that is up to the darwin user
the schema ID extracted from the input data
Extracts the schema from the avro single-object encoded in the input array.
Extracts the schema from the avro single-object encoded in the input array.
avro single-object encoded array
the schema ID extracted from the input data
Extracts the schema from the avro single-object encoded at the head of this input stream.
Extracts the schema from the avro single-object encoded at the head of this input stream. The input stream will have 10 bytes consumed if the first two bytes correspond to the single object encoded header, or zero bytes consumed if the InputStream supports marking; if it doesn't, the first bytes (up to 2) will be consumed and returned in the Left part of the Either
avro single-object encoded input stream
the schema ID extracted from the input data
Generate a fingerprint for a schema, the default implementation is SchemaNormalization.
Generate a fingerprint for a schema, the default implementation is SchemaNormalization.parsingFingerprint64
the schema to fingerprint
the schema id
Writes to the given OutputStream the Single Object Encoding header then calls the avroWriter function to possibly add data to the stream and finally returns the OutputStream
Writes to the given OutputStream the Single Object Encoding header then calls the avroWriter function to possibly add data to the stream and finally returns the OutputStream
the stream to write to
id of the schema used to encode the payload
function that will be called to add user generated avro to the stream
the input OutputStream
Writes to the given OutputStream the Single Object Encoding header then the avroValue and returns the OutputStream
Writes to the given OutputStream the Single Object Encoding header then the avroValue and returns the OutputStream
the stream to write to
the value to be written to the stream
id of the schema used to encode the payload
the input OutputStream
Create an array that creates a Single-Object encoded byte array.
Create an array that creates a Single-Object encoded byte array. By specifications the encoded array is obtained concatenating the V1_HEADER, the schema id and the avro-encoded payload.
avro-serialized payload
the schema used to encode the payload
a Single-Object encoded byte array
Extracts the Schema from the ByteBuffer after the method call the ByteBuffer position will be right after the header.
Extracts the Schema from the ByteBuffer after the method call the ByteBuffer position will be right after the header.
a ByteBuffer of a Single-Object encoded payload
the avro Schema
Extracts a Tuple2 that contains the Schema and the Avro-encoded payload
Extracts a Tuple2 that contains the Schema and the Avro-encoded payload
a byte array of a Single-Object encoded payload
a pair containing the Schema and the payload of the input array
Extracts a SchemaPayloadPair that contains the Schema and the Avro-encoded payload
Extracts a SchemaPayloadPair that contains the Schema and the Avro-encoded payload
a byte array of a Single-Object encoded payload
a SchemaPayloadPair containing the Schema and the payload of the input array
Writes to the given OutputStream the Single Object Encoding header and returns the OutputStream
Writes to the given OutputStream the Single Object Encoding header and returns the OutputStream
the input OutputStream
Generic abstraction of a component capable of reading and writing Schema entities in an external storage. The external storage should keep at least the ID (Long) and the schema (Schema) for each entry.