org.apache.spark.sql.execution.streaming
Return the latest offset in the source
Returns the data that is between the offsets (start
, end
].
Returns the data that is between the offsets (start
, end
].
Returns the maximum available offset for this source.
Returns the maximum available offset for this source.
Returns the schema of the data from this source
Returns the schema of the data from this source
A mapping from a file that we have processed to some timestamp it was last modified.
Stop this source and free any resources it has allocated.
Stop this source and free any resources it has allocated.
For test only.
For test only. Run func
with the internal lock to make sure when func
is running,
the current offset won't be changed and no new batch will be emitted.
A very simple source that reads files from the given directory as they appear.