Logical query plan analyzer for resolving unresolved attributes and relations.
Logical query plan analyzer for resolving unresolved attributes and relations.
Note: this depends on the conf and catalog fields.
Build the SessionState.
Build the SessionState.
Catalog for managing table and database states.
Catalog for managing table and database states. If there is a pre-existing catalog, the state of that catalog (temp tables & current database) will be copied into the new catalog.
Note: this depends on the conf, functionRegistry and sqlParser fields.
SQL-specific key-value configurations.
SQL-specific key-value configurations.
These either get cloned from a pre-existing instance or newly created. The conf is always merged with its SparkConf.
Function used to make clones of the session state.
Function used to make clones of the session state.
Create a query execution object.
Create a query execution object.
Custom check rules to add to the Analyzer.
Custom check rules to add to the Analyzer. Prefer overriding this instead of creating your own Analyzer.
Note that this may NOT depend on the analyzer function.
Custom operator optimization rules to add to the Optimizer.
Custom operator optimization rules to add to the Optimizer. Prefer overriding this instead of creating your own Optimizer.
Note that this may NOT depend on the optimizer function.
Custom strategies to add to the planner.
Custom strategies to add to the planner. Prefer overriding this instead of creating your own Planner.
Note that this may NOT depend on the planner function.
Custom post resolution rules to add to the Analyzer.
Custom post resolution rules to add to the Analyzer. Prefer overriding this instead of creating your own Analyzer.
Note that this may NOT depend on the analyzer function.
Custom resolution rules to add to the Analyzer.
Custom resolution rules to add to the Analyzer. Prefer overriding this instead of creating your own Analyzer.
Note that this may NOT depend on the analyzer function.
Experimental methods that can be used to define custom optimization rules and custom planning strategies.
Experimental methods that can be used to define custom optimization rules and custom planning strategies.
This either gets cloned from a pre-existing version or newly created.
Session extensions defined in the SparkSession.
Session extensions defined in the SparkSession.
Internal catalog managing functions registered by the user.
Internal catalog managing functions registered by the user.
This either gets cloned from a pre-existing version or cloned from the built-in registry.
An interface to register custom org.apache.spark.sql.util.QueryExecutionListeners that listen for execution metrics.
An interface to register custom org.apache.spark.sql.util.QueryExecutionListeners that listen for execution metrics.
This gets cloned from parent if available, otherwise is a new instance is created.
Extract entries from SparkConf and put them in the SQLConf
Extract entries from SparkConf and put them in the SQLConf
Function that produces a new instance of the SessionStateBuilder.
Function that produces a new instance of the SessionStateBuilder. This is used by the SessionState's clone functionality. Make sure to override this when implementing your own SessionStateBuilder.
Logical query plan optimizer.
Logical query plan optimizer.
Note: this depends on the conf, catalog and experimentalMethods fields.
Planner that converts optimized logical plans to physical plans.
Planner that converts optimized logical plans to physical plans.
Note: this depends on the conf and experimentalMethods fields.
ResourceLoader that is used to load function resources and jars.
ResourceLoader that is used to load function resources and jars.
Parser that extracts expressions, plans, table identifiers etc.
Parser that extracts expressions, plans, table identifiers etc. from SQL texts.
Note: this depends on the conf field.
Interface to start and stop streaming queries.
Interface to start and stop streaming queries.
Interface exposed to the user for registering user-defined functions.
Interface exposed to the user for registering user-defined functions.
Note 1: The user-defined functions must be deterministic.
Note 2: This depends on the functionRegistry field.
Concrete implementation of a SessionStateBuilder.