Sinks can optionally have a method to close it when saving is done or in case of an error.
Sinks can optionally have a method to close it when saving is done or in case of an error.
Sinks can optionally have a method to connect to it.
Sinks can optionally have a method to connect to it.
Sends the given data frame to the sink.
Sends the given data frame to the sink.
the dataframe containing data to send to the sink (with all transformations and filters applied).
the name of the table from which the data is coming from.
the metastore reader to read other tables from.
the information date to use when reading the table from the metastore.
arbitrary extra options to use for the table (e.g. topic name, etc.)
The number of records written if successful, throw an exception otherwise.
A sink is an entity where jobs can write to and it won't be under metastore control (e.g. Kafka).
Special Sink jobs are used to write tables from metastore to a sink.