org.apache.spark.sql.catalyst.catalog
Alter one or many table partitions whose specs that match those specified in parts
,
assuming the partitions exist.
Alter one or many table partitions whose specs that match those specified in parts
,
assuming the partitions exist.
If no database is specified, assume the table is in the current database.
Note: If the underlying implementation does not support altering a certain field, this becomes a no-op.
Alter the metadata of an existing metastore table identified by tableDefinition
.
Alter the metadata of an existing metastore table identified by tableDefinition
.
If no database is specified in tableDefinition
, assume the table is in the
current database.
Note: If the underlying implementation does not support altering a certain field, this becomes a no-op.
Drop all existing temporary tables.
Drop all existing temporary tables. For testing only.
Create a metastore function in the database specified in funcDefinition
.
Create a metastore function in the database specified in funcDefinition
.
If no such database is specified, create it in the current database.
Create partitions in an existing table, assuming it exists.
Create partitions in an existing table, assuming it exists. If no database is specified, assume the table is in the current database.
Create a metastore table in the database specified in tableDefinition
.
Create a metastore table in the database specified in tableDefinition
.
If no such database is specified, create it in the current database.
Create a temporary function.
Create a temporary function.
This assumes no database is specified in funcDefinition
.
Create a temporary table.
Drop a metastore function.
Drop a metastore function. If no database is specified, assume the function is in the current database.
Drop partitions from a table, assuming they exist.
Drop partitions from a table, assuming they exist. If no database is specified, assume the table is in the current database.
Drop a table.
Drop a table.
If a database is specified in name
, this will drop the table from that database.
If no database is specified, this will first attempt to drop a temporary table with
the same name, then, if that does not exist, drop the table from the current database.
Drop a temporary function.
Drop a temporary view.
Format database name, taking into account case sensitivity.
Format database name, taking into account case sensitivity.
Format table name, taking into account case sensitivity.
Format table name, taking into account case sensitivity.
Check if the specified function exists.
Get the path for creating a non-default database when database location is not provided by users.
Retrieve the metadata of a metastore function.
Retrieve the metadata of a metastore function.
If a database is specified in name
, this will return the function in that database.
If no database is specified, this will return the function in the current database.
Retrieve the metadata of a table partition, assuming it exists.
Retrieve the metadata of a table partition, assuming it exists. If no database is specified, assume the table is in the current database.
Retrieve the metadata of an existing permanent table/view.
Retrieve the metadata of an existing permanent table/view. If no database is specified, assume the table/view is in the current database. If the specified table/view is not found in the database then a NoSuchTableException is thrown.
Retrieve the metadata of an existing metastore table.
Retrieve the metadata of an existing metastore table. If no database is specified, assume the table is in the current database. If the specified table is not found in the database then return None if it doesn't exist.
Return a temporary view exactly as it was stored.
Retrieve the metadata of an existing temporary view or permanent table/view.
Retrieve the metadata of an existing temporary view or permanent table/view.
If a database is specified in name
, this will return the metadata of table/view in that
database.
If no database is specified, this will first attempt to get the metadata of a temporary view
with the same name, then, if that does not exist, return the metadata of table/view in the
current database.
Return whether a table with the specified name is a temporary table.
Return whether a table with the specified name is a temporary table.
Note: The temporary table cache is checked only when database is not explicitly specified.
List all matching functions in the specified database, including temporary functions.
List all matching functions in the specified database, including temporary functions. This returns the function identifier and the scope in which it was defined (system or user defined).
List all functions in the specified database, including temporary functions.
List all functions in the specified database, including temporary functions. This returns the function identifier and the scope in which it was defined (system or user defined).
List the metadata of all partitions that belong to the specified table, assuming it exists.
List the metadata of all partitions that belong to the specified table, assuming it exists.
A partial partition spec may optionally be provided to filter the partitions returned. For instance, if there exist partitions (a='1', b='2'), (a='1', b='3') and (a='2', b='4'), then a partial spec of (a='1') will return the first two only.
List all matching tables in the specified database, including temporary tables.
List all tables in the specified database, including temporary tables.
Loads resources such as JARs and Files for a function.
Loads resources such as JARs and Files for a function. Every resource is represented by a tuple (resource type, resource uri).
Load files stored in given path into the partition of an existing metastore table.
Load files stored in given path into the partition of an existing metastore table. If no database is specified, assume the table is in the current database. If the specified table is not found in the database then a NoSuchTableException is thrown.
Load files stored in given path into an existing metastore table.
Load files stored in given path into an existing metastore table. If no database is specified, assume the table is in the current database. If the specified table is not found in the database then a NoSuchTableException is thrown.
Return an Expression that represents the specified function, assuming it exists.
Return an Expression that represents the specified function, assuming it exists.
For a temporary function or a permanent function that has been loaded, this method will simply lookup the function through the FunctionRegistry and create an expression based on the builder.
For a permanent function that has not been loaded, we will first fetch its metadata
from the underlying external catalog. Then, we will load all resources associated
with this function (i.e. jars and files). Finally, we create a function builder
based on the function class and put the builder into the FunctionRegistry.
The name of this function in the FunctionRegistry will be databaseName.functionName
.
Look up the ExpressionInfo associated with the specified function, assuming it exists.
Return a LogicalPlan that represents the given table.
Return a LogicalPlan that represents the given table.
If a database is specified in name
, this will return the table from that database.
If no database is specified, this will first attempt to return a temporary table with
the same name, then, if that does not exist, return the table from the current database.
Construct a FunctionBuilder based on the provided class that represents a function.
Construct a FunctionBuilder based on the provided class that represents a function.
This performs reflection to decide what type of Expression to return in the builder.
Refresh the cache entry for a metastore table, if any.
Override the specs of one or many existing table partitions, assuming they exist.
Override the specs of one or many existing table partitions, assuming they exist.
This assumes index i of specs
corresponds to index i of newSpecs
.
If no database is specified, assume the table is in the current database.
Rename a table.
Rename a table.
If a database is specified in oldName
, this will rename the table in that database.
If no database is specified, this will first attempt to rename a temporary table with
the same name, then, if that does not exist, rename the table in the current database.
This assumes the database specified in oldName
matches the one specified in newName
.
Drop all existing databases (except "default"), tables, partitions and functions, and set the current database to "default".
Drop all existing databases (except "default"), tables, partitions and functions, and set the current database to "default".
This is mainly used for tests.
Return whether a table/view with the specified name exists.
Return whether a table/view with the specified name exists. If no database is specified, check with current database.
List of temporary tables, mapping from table name to their logical plan.
List of temporary tables, mapping from table name to their logical plan.
An internal catalog that is used by a Spark Session. This internal catalog serves as a proxy to the underlying metastore (e.g. Hive Metastore) and it also manages temporary tables and functions of the Spark Session that it belongs to.
This class must be thread-safe.