class SessionStateBuilder extends BaseSessionStateBuilder
- Alphabetic
- By Inheritance
- SessionStateBuilder
- BaseSessionStateBuilder
- AnyRef
- Any
- Hide All
- Show All
- Public
- Protected
Instance Constructors
- new SessionStateBuilder(session: classic.SparkSession, parentState: Option[SessionState])
Type Members
- type NewBuilder = (classic.SparkSession, Option[SessionState]) => BaseSessionStateBuilder
- Definition Classes
- BaseSessionStateBuilder
Value Members
- final def !=(arg0: Any): Boolean
- Definition Classes
- AnyRef → Any
- final def ##: Int
- Definition Classes
- AnyRef → Any
- final def ==(arg0: Any): Boolean
- Definition Classes
- AnyRef → Any
- def adaptiveRulesHolder: AdaptiveRulesHolder
- Attributes
- protected
- Definition Classes
- BaseSessionStateBuilder
- def analyzer: Analyzer
Logical query plan analyzer for resolving unresolved attributes and relations.
Logical query plan analyzer for resolving unresolved attributes and relations.
Note: this depends on the
confandcatalogfields.- Attributes
- protected
- Definition Classes
- BaseSessionStateBuilder
- def artifactManager: ArtifactManager
Resource manager that handles the storage of artifacts as well as preparing the artifacts for use.
Resource manager that handles the storage of artifacts as well as preparing the artifacts for use.
- Attributes
- protected
- Definition Classes
- BaseSessionStateBuilder
- final def asInstanceOf[T0]: T0
- Definition Classes
- Any
- def build(): SessionState
Build the SessionState.
Build the SessionState.
- Definition Classes
- BaseSessionStateBuilder
- lazy val catalog: SessionCatalog
Catalog for managing table and database states.
Catalog for managing table and database states. If there is a pre-existing catalog, the state of that catalog (temp tables & current database) will be copied into the new catalog.
Note: this depends on the
conf,functionRegistryandsqlParserfields.- Attributes
- protected
- Definition Classes
- BaseSessionStateBuilder
- lazy val catalogManager: CatalogManager
- Attributes
- protected
- Definition Classes
- BaseSessionStateBuilder
- def clone(): AnyRef
- Attributes
- protected[lang]
- Definition Classes
- AnyRef
- Annotations
- @throws(classOf[java.lang.CloneNotSupportedException]) @IntrinsicCandidate() @native()
- def columnarRules: Seq[ColumnarRule]
- Attributes
- protected
- Definition Classes
- BaseSessionStateBuilder
- lazy val conf: SQLConf
SQL-specific key-value configurations.
SQL-specific key-value configurations.
These either get cloned from a pre-existing instance or newly created. The conf is merged with its SparkConf only when there is no parent session.
- Attributes
- protected
- Definition Classes
- BaseSessionStateBuilder
- def createClone: (classic.SparkSession, SessionState) => SessionState
Function used to make clones of the session state.
Function used to make clones of the session state.
- Attributes
- protected
- Definition Classes
- BaseSessionStateBuilder
- def createQueryExecution: (LogicalPlan, execution.CommandExecutionMode.Value) => QueryExecution
Create a query execution object.
Create a query execution object.
- Attributes
- protected
- Definition Classes
- BaseSessionStateBuilder
- def customCheckRules: Seq[(LogicalPlan) => Unit]
Custom check rules to add to the Analyzer.
Custom check rules to add to the Analyzer. Prefer overriding this instead of creating your own Analyzer.
Note that this may NOT depend on the
analyzerfunction.- Attributes
- protected
- Definition Classes
- BaseSessionStateBuilder
- def customEarlyScanPushDownRules: Seq[Rule[LogicalPlan]]
Custom early scan push down rules to add to the Optimizer.
Custom early scan push down rules to add to the Optimizer. Prefer overriding this instead of creating your own Optimizer.
Note that this may NOT depend on the
optimizerfunction.- Attributes
- protected
- Definition Classes
- BaseSessionStateBuilder
- def customHintResolutionRules: Seq[Rule[LogicalPlan]]
Custom hint resolution rules to add to the Analyzer.
Custom hint resolution rules to add to the Analyzer.
- Attributes
- protected
- Definition Classes
- BaseSessionStateBuilder
- def customOperatorOptimizationRules: Seq[Rule[LogicalPlan]]
Custom operator optimization rules to add to the Optimizer.
Custom operator optimization rules to add to the Optimizer. Prefer overriding this instead of creating your own Optimizer.
Note that this may NOT depend on the
optimizerfunction.- Attributes
- protected
- Definition Classes
- BaseSessionStateBuilder
- def customPlanningStrategies: Seq[Strategy]
Custom strategies to add to the planner.
Custom strategies to add to the planner. Prefer overriding this instead of creating your own Planner.
Note that this may NOT depend on the
plannerfunction.- Attributes
- protected
- Definition Classes
- BaseSessionStateBuilder
- def customPostHocResolutionRules: Seq[Rule[LogicalPlan]]
Custom post resolution rules to add to the Analyzer.
Custom post resolution rules to add to the Analyzer. Prefer overriding this instead of creating your own Analyzer.
Note that this may NOT depend on the
analyzerfunction.- Attributes
- protected
- Definition Classes
- BaseSessionStateBuilder
- def customPreCBORules: Seq[Rule[LogicalPlan]]
Custom rules for rewriting plans after operator optimization and before CBO.
Custom rules for rewriting plans after operator optimization and before CBO. Prefer overriding this instead of creating your own Optimizer.
Note that this may NOT depend on the
optimizerfunction.- Attributes
- protected
- Definition Classes
- BaseSessionStateBuilder
- def customResolutionRules: Seq[Rule[LogicalPlan]]
Custom resolution rules to add to the Analyzer.
Custom resolution rules to add to the Analyzer. Prefer overriding this instead of creating your own Analyzer.
Note that this may NOT depend on the
analyzerfunction.- Attributes
- protected
- Definition Classes
- BaseSessionStateBuilder
- lazy val dataSourceManager: DataSourceManager
Manages the registration of data sources
Manages the registration of data sources
- Attributes
- protected
- Definition Classes
- BaseSessionStateBuilder
- def dataSourceRegistration: DataSourceRegistration
A collection of method used for registering user-defined data sources.
A collection of method used for registering user-defined data sources.
- Attributes
- protected
- Definition Classes
- BaseSessionStateBuilder
- final def eq(arg0: AnyRef): Boolean
- Definition Classes
- AnyRef
- def equals(arg0: AnyRef): Boolean
- Definition Classes
- AnyRef → Any
- lazy val experimentalMethods: ExperimentalMethods
Experimental methods that can be used to define custom optimization rules and custom planning strategies.
Experimental methods that can be used to define custom optimization rules and custom planning strategies.
This either gets cloned from a pre-existing version or newly created.
- Attributes
- protected
- Definition Classes
- BaseSessionStateBuilder
- def extensions: SparkSessionExtensions
Session extensions defined in the SparkSession.
Session extensions defined in the SparkSession.
- Attributes
- protected
- Definition Classes
- BaseSessionStateBuilder
- lazy val functionRegistry: FunctionRegistry
Internal catalog managing functions registered by the user.
Internal catalog managing functions registered by the user.
This either gets cloned from a pre-existing version or cloned from the built-in registry.
- Attributes
- protected
- Definition Classes
- BaseSessionStateBuilder
- final def getClass(): Class[_ <: AnyRef]
- Definition Classes
- AnyRef → Any
- Annotations
- @IntrinsicCandidate() @native()
- def hashCode(): Int
- Definition Classes
- AnyRef → Any
- Annotations
- @IntrinsicCandidate() @native()
- final def isInstanceOf[T0]: Boolean
- Definition Classes
- Any
- def listenerManager: ExecutionListenerManager
An interface to register custom org.apache.spark.sql.util.QueryExecutionListeners that listen for execution metrics.
An interface to register custom org.apache.spark.sql.util.QueryExecutionListeners that listen for execution metrics.
This gets cloned from parent if available, otherwise a new instance is created.
- Attributes
- protected
- Definition Classes
- BaseSessionStateBuilder
- final def ne(arg0: AnyRef): Boolean
- Definition Classes
- AnyRef
- def newBuilder: NewBuilder
Function that produces a new instance of the
BaseSessionStateBuilder.Function that produces a new instance of the
BaseSessionStateBuilder. This is used by the SessionState's clone functionality. Make sure to override this when implementing your own SessionStateBuilder.- Attributes
- protected
- Definition Classes
- SessionStateBuilder → BaseSessionStateBuilder
- final def notify(): Unit
- Definition Classes
- AnyRef
- Annotations
- @IntrinsicCandidate() @native()
- final def notifyAll(): Unit
- Definition Classes
- AnyRef
- Annotations
- @IntrinsicCandidate() @native()
- def optimizer: Optimizer
Logical query plan optimizer.
Logical query plan optimizer.
Note: this depends on
catalogandexperimentalMethodsfields.- Attributes
- protected
- Definition Classes
- BaseSessionStateBuilder
- val parentState: Option[SessionState]
- Definition Classes
- BaseSessionStateBuilder
- def planNormalizationRules: Seq[Rule[LogicalPlan]]
- Attributes
- protected
- Definition Classes
- BaseSessionStateBuilder
- def planner: SparkPlanner
Planner that converts optimized logical plans to physical plans.
Planner that converts optimized logical plans to physical plans.
Note: this depends on the
confandexperimentalMethodsfields.- Attributes
- protected
- Definition Classes
- BaseSessionStateBuilder
- lazy val resourceLoader: SessionResourceLoader
ResourceLoader that is used to load function resources and jars.
ResourceLoader that is used to load function resources and jars.
- Attributes
- protected
- Definition Classes
- BaseSessionStateBuilder
- val session: classic.SparkSession
- Definition Classes
- BaseSessionStateBuilder
- lazy val sqlParser: ParserInterface
Parser that extracts expressions, plans, table identifiers etc.
Parser that extracts expressions, plans, table identifiers etc. from SQL texts.
Note: this depends on the
conffield.- Attributes
- protected
- Definition Classes
- BaseSessionStateBuilder
- def streamingQueryManager: StreamingQueryManager
Interface to start and stop streaming queries.
Interface to start and stop streaming queries.
- Attributes
- protected
- Definition Classes
- BaseSessionStateBuilder
- final def synchronized[T0](arg0: => T0): T0
- Definition Classes
- AnyRef
- lazy val tableFunctionRegistry: TableFunctionRegistry
Internal catalog managing functions registered by the user.
Internal catalog managing functions registered by the user.
This either gets cloned from a pre-existing version or cloned from the built-in registry.
- Attributes
- protected
- Definition Classes
- BaseSessionStateBuilder
- def toString(): String
- Definition Classes
- AnyRef → Any
- def udfRegistration: classic.UDFRegistration
Interface exposed to the user for registering user-defined functions.
Interface exposed to the user for registering user-defined functions.
Note 1: The user-defined functions must be deterministic. Note 2: This depends on the
functionRegistryfield.- Attributes
- protected
- Definition Classes
- BaseSessionStateBuilder
- def udtfRegistration: UDTFRegistration
- Attributes
- protected
- Definition Classes
- BaseSessionStateBuilder
- lazy val v2SessionCatalog: V2SessionCatalog
- Attributes
- protected
- Definition Classes
- BaseSessionStateBuilder
- final def wait(arg0: Long, arg1: Int): Unit
- Definition Classes
- AnyRef
- Annotations
- @throws(classOf[java.lang.InterruptedException])
- final def wait(arg0: Long): Unit
- Definition Classes
- AnyRef
- Annotations
- @throws(classOf[java.lang.InterruptedException]) @native()
- final def wait(): Unit
- Definition Classes
- AnyRef
- Annotations
- @throws(classOf[java.lang.InterruptedException])
Deprecated Value Members
- def finalize(): Unit
- Attributes
- protected[lang]
- Definition Classes
- AnyRef
- Annotations
- @throws(classOf[java.lang.Throwable]) @Deprecated
- Deprecated
(Since version 9)