A RowWriter writes Row
s to some storage area.
A RowWriter writes Row
s to some storage area.
It does not need to be thread safe, callers must guarantee that only a single thread will invoke a particular writer at a time.
RowWriter
s can be implemented as lazy if required, so that file handles, etc, are not
opened until the first record is written.
A Source is a provider of data.
A Source is a provider of data.
A source implementation must provide two methods:
1: schema() which returns an eel schema for the data source.
2: parts() which returns zero or more Part instances representing the data.
A part instance is a subset of the data in a Source, and allows for concurrent reading of that data. For example a part could be a single file in a multi-file source, or a partition in a partitioned source.
A sink which just swallows any incoming data.
A sink which just swallows any incoming data. Useful to test throughput speeds of sources.