org.apache.spark.sql.execution.streaming
StreamExecution
Related Doc:
package streaming
Blocks the current thread until processing for data from the given source has reached at
least the given Offset.
Blocks the current thread until processing for data from the given source has reached at
least the given Offset. This method is indented for use primarily when writing tests.
Waits for the termination of this query, either by query.stop() or by an exception.
Waits for the termination of this query, either by query.stop() or by an exception.
If the query has terminated with an exception, then the exception will be thrown.
Otherwise, it returns whether the query has terminated or not within the timeoutMs
milliseconds.
If the query has terminated, then all subsequent calls to this method will either return
true immediately (if the query was terminated by stop()), or throw the exception
immediately (if the query has terminated with exception).
2.0.0
ContinuousQueryException, if this query has terminated with an exception
Waits for the termination of this query, either by query.stop() or by an exception.
Waits for the termination of this query, either by query.stop() or by an exception.
If the query has terminated with an exception, then the exception will be thrown.
If the query has terminated, then all subsequent calls to this method will either return
immediately (if the query was terminated by stop()), or throw the exception
immediately (if the query has terminated with exception).
2.0.0
ContinuousQueryException, if this query has terminated with an exception.
Returns the ContinuousQueryException if the query was terminated by an exception.
Returns the ContinuousQueryException if the query was terminated by an exception.
Whether the query is currently active or not
Whether the query is currently active or not
Returns the name of the query.
Returns the name of the query.
2.0.0
Blocks until all available data in the source has been processed an committed to the sink.
Blocks until all available data in the source has been processed an committed to the sink.
This method is intended for testing. Note that in the case of continually arriving data, this
method may block forever. Additionally, this method is only guaranteed to block until data that
has been synchronously appended data to a org.apache.spark.sql.execution.streaming.Source
prior to invocation. (i.e. getOffset must immediately reflect the addition).
Returns current status of the sink.
Returns current status of the sink.
Returns current status of all the sources.
Returns current status of all the sources.
Returns the SparkSession associated with this.
Returns the SparkSession associated with this.
2.0.0
Signals to the thread executing micro-batches that it should stop running after the next batch.
Signals to the thread executing micro-batches that it should stop running after the next batch. This method blocks until the thread stops running.
Manages the execution of a streaming Spark SQL query that is occurring in a separate thread. Unlike a standard query, a streaming query executes repeatedly each time new data arrives at any Source present in the query plan. Whenever new data arrives, a QueryExecution is created and the results are committed transactionally to the given Sink.