org.apache.spark.sql.execution.streaming
StreamingQueryListenerBus
Related Doc:
package streaming
Dispatch events to registered StreamingQueryListeners.
Dispatch events to registered StreamingQueryListeners. Only the events associated queries started in the same SparkSession as this ListenerBus will be dispatched to the listeners.
Post a StreamingQueryListener event to the added StreamingQueryListeners.
Post a StreamingQueryListener event to the added StreamingQueryListeners. Note that only the QueryStarted event is posted to the listener synchronously. Other events are dispatched to Spark listener bus. This method is guaranteed to be called by queries in the same SparkSession as this listener.
Override the parent postToAll to remove the query id from activeQueryRunIds after all
the listeners process QueryTerminatedEvent.
Override the parent postToAll to remove the query id from activeQueryRunIds after all
the listeners process QueryTerminatedEvent. (SPARK-19594)
A bus to forward events to StreamingQueryListeners. This one will send received StreamingQueryListener.Events to the Spark listener bus. It also registers itself with Spark listener bus, so that it can receive StreamingQueryListener.Events and dispatch them to StreamingQueryListeners.
Note that each bus and its registered listeners are associated with a single SparkSession and StreamingQueryManager. So this bus will dispatch events to registered listeners for only those queries that were started in the associated SparkSession.