| Class | Description |
|---|---|
| EsCommitProtocol |
Defines job-side and task-side logic for committing batches of writes
to Elasticsearch for Spark Structured Streaming
|
| EsSinkMetadataLog |
Provides logic for managing batch ID committing as well as cleaning up
state between batch executions for the
EsSparkSqlStreamingSink |
| EsSinkMetadataLog$ |
Companion object for
EsSinkMetadataLog. |
| EsSinkStatus |
An envelope of metadata that is stored in the commit log.
|
| EsSinkStatus$ | |
| EsSparkSqlStreamingSink |
Sink for writing Spark Structured Streaming Queries to an Elasticsearch cluster.
|
| EsStreamQueryWriter |
Takes in iterator of InternalRow objects from a partition of data, writes it to Elasticsearch, and manages
the streaming commit protocol.
|
| JobState | |
| JobState$ | |
| NullMetadataLog<T> |
A null object style metadata log that discards incoming data, and otherwise
acts like an empty log.
|
| SparkSqlStreamingConfigs |
Configurations specifically used for Spark Structured Streaming
|
| SparkSqlStreamingConfigs$ |
Configurations specifically used for Spark Structured Streaming
|
| StructuredStreamingVersionLock |
Spark Structured Streaming just recently left "Experimental" mode in Spark 2.2.0.
|
| StructuredStreamingVersionLock$ |
Spark Structured Streaming just recently left "Experimental" mode in Spark 2.2.0.
|
| TaskCommit | |
| TaskCommit$ | |
| TaskState | |
| TaskState$ |