location for checkpoints of streaming query to keep state
additional option to apply when reading streaming source. This overwrites options set by the DataObjects.
additional option to apply when writing to streaming sink. This overwrites options set by the DataObjects.
location for checkpoints of streaming query to keep state
additional option to apply when reading streaming source.
additional option to apply when reading streaming source. This overwrites options set by the DataObjects.
additional option to apply when writing to streaming sink.
additional option to apply when writing to streaming sink. This overwrites options set by the DataObjects.
Spark streaming execution mode uses Spark Structured Streaming to incrementally execute data loads (trigger=Trigger.Once) and keep track of processed data. This mode needs a DataObject implementing CanCreateStreamingDataFrame and works only with SparkSubFeeds.
location for checkpoints of streaming query to keep state
additional option to apply when reading streaming source. This overwrites options set by the DataObjects.
additional option to apply when writing to streaming sink. This overwrites options set by the DataObjects.