streaming

Type Members

1. final class DataStreamReader extends Logging

   Interface used to load a streaming Dataset from external storage systems (e.

2. final class DataStreamWriter[T] extends AnyRef

   Interface used to write a streaming Dataset to external storage systems (e.

3. trait GroupState[S] extends LogicalGroupState[S]

   :: Experimental ::

4. class SinkProgress extends Serializable

   Information about progress made for a sink in the execution of a StreamingQuery during a trigger.

5. class SourceProgress extends Serializable

   Information about progress made for a source in the execution of a StreamingQuery during a trigger.

6. class StateOperatorProgress extends Serializable

   Information about updates made to stateful operators in a StreamingQuery during a trigger.

7. trait StreamingQuery extends AnyRef

   A handle to a query that is executing continuously in the background as new data arrives.

8. class StreamingQueryException extends Exception

   Exception that stopped a StreamingQuery.

9. abstract class StreamingQueryListener extends AnyRef

   Interface for listening to events related to StreamingQueries.

10. class StreamingQueryManager extends Logging

    A class to manage all the StreamingQuery active in a SparkSession.

11. class StreamingQueryProgress extends Serializable

    Information about progress made in the execution of a StreamingQuery during a trigger.

12. class StreamingQueryStatus extends Serializable

    Reports information about the instantaneous status of a streaming query.

13. class Trigger extends AnyRef

14. case class ProcessingTime(intervalMs: Long) extends Trigger with Product with Serializable

    A trigger that runs a query periodically based on the processing time.