org.apache.spark.sql.execution.datasources
as set of options to control partition discovery
an optional partition schema that will be use to provide types for the discovered partitions
Returns the specification of the partitions inferred from the data.
Returns the specification of the partitions inferred from the data.
Returns the list of input paths from which the catalog will get files.
Returns the list of input paths from which the catalog will get files.
Refresh the file listing
Refresh the file listing
Returns all the valid files.
Returns all the valid files.
Returns all valid files grouped into partitions when the data is partitioned.
Returns all valid files grouped into partitions when the data is partitioned. If the data is unpartitioned, this will return a single partition with no partition values.
The filters used to prune which partitions are returned. These filters must
only refer to partition columns and this method will only return files
where these predicates are guaranteed to evaluate to true
. Thus, these
filters will not need to be evaluated again on the returned data.
An abstract class that represents FileCatalogs that are aware of partitioned tables. It provides the necessary methods to parse partition data based on a set of files.