Packages

c

org.apache.spark.sql.internal

SessionStateBuilder

class SessionStateBuilder extends BaseSessionStateBuilder

Concrete implementation of a BaseSessionStateBuilder.

Annotations
@Unstable()
Linear Supertypes
BaseSessionStateBuilder, AnyRef, Any
Ordering
  1. Alphabetic
  2. By Inheritance
Inherited
  1. SessionStateBuilder
  2. BaseSessionStateBuilder
  3. AnyRef
  4. Any
  1. Hide All
  2. Show All
Visibility
  1. Public
  2. All

Instance Constructors

  1. new SessionStateBuilder(session: SparkSession, parentState: Option[SessionState] = None)

Type Members

  1. type NewBuilder = (SparkSession, Option[SessionState]) ⇒ BaseSessionStateBuilder
    Definition Classes
    BaseSessionStateBuilder

Value Members

  1. final def !=(arg0: Any): Boolean
    Definition Classes
    AnyRef → Any
  2. final def ##(): Int
    Definition Classes
    AnyRef → Any
  3. final def ==(arg0: Any): Boolean
    Definition Classes
    AnyRef → Any
  4. def analyzer: Analyzer

    Logical query plan analyzer for resolving unresolved attributes and relations.

    Logical query plan analyzer for resolving unresolved attributes and relations.

    Note: this depends on the conf and catalog fields.

    Attributes
    protected
    Definition Classes
    BaseSessionStateBuilder
  5. final def asInstanceOf[T0]: T0
    Definition Classes
    Any
  6. def build(): SessionState

    Build the SessionState.

    Build the SessionState.

    Definition Classes
    BaseSessionStateBuilder
  7. lazy val catalog: SessionCatalog

    Catalog for managing table and database states.

    Catalog for managing table and database states. If there is a pre-existing catalog, the state of that catalog (temp tables & current database) will be copied into the new catalog.

    Note: this depends on the conf, functionRegistry and sqlParser fields.

    Attributes
    protected
    Definition Classes
    BaseSessionStateBuilder
  8. lazy val catalogManager: CatalogManager
    Attributes
    protected
    Definition Classes
    BaseSessionStateBuilder
  9. def clone(): AnyRef
    Attributes
    protected[lang]
    Definition Classes
    AnyRef
    Annotations
    @throws( ... ) @native()
  10. def columnarRules: Seq[ColumnarRule]
    Attributes
    protected
    Definition Classes
    BaseSessionStateBuilder
  11. lazy val conf: SQLConf

    SQL-specific key-value configurations.

    SQL-specific key-value configurations.

    These either get cloned from a pre-existing instance or newly created. The conf is merged with its SparkConf only when there is no parent session.

    Attributes
    protected
    Definition Classes
    BaseSessionStateBuilder
  12. def createClone: (SparkSession, SessionState) ⇒ SessionState

    Function used to make clones of the session state.

    Function used to make clones of the session state.

    Attributes
    protected
    Definition Classes
    BaseSessionStateBuilder
  13. def createQueryExecution: (LogicalPlan) ⇒ QueryExecution

    Create a query execution object.

    Create a query execution object.

    Attributes
    protected
    Definition Classes
    BaseSessionStateBuilder
  14. def customCheckRules: Seq[(LogicalPlan) ⇒ Unit]

    Custom check rules to add to the Analyzer.

    Custom check rules to add to the Analyzer. Prefer overriding this instead of creating your own Analyzer.

    Note that this may NOT depend on the analyzer function.

    Attributes
    protected
    Definition Classes
    BaseSessionStateBuilder
  15. def customEarlyScanPushDownRules: Seq[Rule[LogicalPlan]]

    Custom early scan push down rules to add to the Optimizer.

    Custom early scan push down rules to add to the Optimizer. Prefer overriding this instead of creating your own Optimizer.

    Note that this may NOT depend on the optimizer function.

    Attributes
    protected
    Definition Classes
    BaseSessionStateBuilder
  16. def customOperatorOptimizationRules: Seq[Rule[LogicalPlan]]

    Custom operator optimization rules to add to the Optimizer.

    Custom operator optimization rules to add to the Optimizer. Prefer overriding this instead of creating your own Optimizer.

    Note that this may NOT depend on the optimizer function.

    Attributes
    protected
    Definition Classes
    BaseSessionStateBuilder
  17. def customPlanningStrategies: Seq[Strategy]

    Custom strategies to add to the planner.

    Custom strategies to add to the planner. Prefer overriding this instead of creating your own Planner.

    Note that this may NOT depend on the planner function.

    Attributes
    protected
    Definition Classes
    BaseSessionStateBuilder
  18. def customPostHocResolutionRules: Seq[Rule[LogicalPlan]]

    Custom post resolution rules to add to the Analyzer.

    Custom post resolution rules to add to the Analyzer. Prefer overriding this instead of creating your own Analyzer.

    Note that this may NOT depend on the analyzer function.

    Attributes
    protected
    Definition Classes
    BaseSessionStateBuilder
  19. def customResolutionRules: Seq[Rule[LogicalPlan]]

    Custom resolution rules to add to the Analyzer.

    Custom resolution rules to add to the Analyzer. Prefer overriding this instead of creating your own Analyzer.

    Note that this may NOT depend on the analyzer function.

    Attributes
    protected
    Definition Classes
    BaseSessionStateBuilder
  20. final def eq(arg0: AnyRef): Boolean
    Definition Classes
    AnyRef
  21. def equals(arg0: Any): Boolean
    Definition Classes
    AnyRef → Any
  22. lazy val experimentalMethods: ExperimentalMethods

    Experimental methods that can be used to define custom optimization rules and custom planning strategies.

    Experimental methods that can be used to define custom optimization rules and custom planning strategies.

    This either gets cloned from a pre-existing version or newly created.

    Attributes
    protected
    Definition Classes
    BaseSessionStateBuilder
  23. def extensions: SparkSessionExtensions

    Session extensions defined in the SparkSession.

    Session extensions defined in the SparkSession.

    Attributes
    protected
    Definition Classes
    BaseSessionStateBuilder
  24. def finalize(): Unit
    Attributes
    protected[lang]
    Definition Classes
    AnyRef
    Annotations
    @throws( classOf[java.lang.Throwable] )
  25. lazy val functionRegistry: FunctionRegistry

    Internal catalog managing functions registered by the user.

    Internal catalog managing functions registered by the user.

    This either gets cloned from a pre-existing version or cloned from the built-in registry.

    Attributes
    protected
    Definition Classes
    BaseSessionStateBuilder
  26. final def getClass(): Class[_]
    Definition Classes
    AnyRef → Any
    Annotations
    @native()
  27. def hashCode(): Int
    Definition Classes
    AnyRef → Any
    Annotations
    @native()
  28. final def isInstanceOf[T0]: Boolean
    Definition Classes
    Any
  29. def listenerManager: ExecutionListenerManager

    An interface to register custom org.apache.spark.sql.util.QueryExecutionListeners that listen for execution metrics.

    An interface to register custom org.apache.spark.sql.util.QueryExecutionListeners that listen for execution metrics.

    This gets cloned from parent if available, otherwise a new instance is created.

    Attributes
    protected
    Definition Classes
    BaseSessionStateBuilder
  30. def mergeSparkConf(sqlConf: SQLConf, sparkConf: SparkConf): Unit

    Extract entries from SparkConf and put them in the SQLConf

    Extract entries from SparkConf and put them in the SQLConf

    Attributes
    protected
    Definition Classes
    BaseSessionStateBuilder
  31. final def ne(arg0: AnyRef): Boolean
    Definition Classes
    AnyRef
  32. def newBuilder: NewBuilder

    Function that produces a new instance of the BaseSessionStateBuilder.

    Function that produces a new instance of the BaseSessionStateBuilder. This is used by the SessionState's clone functionality. Make sure to override this when implementing your own SessionStateBuilder.

    Attributes
    protected
    Definition Classes
    SessionStateBuilder → BaseSessionStateBuilder
  33. final def notify(): Unit
    Definition Classes
    AnyRef
    Annotations
    @native()
  34. final def notifyAll(): Unit
    Definition Classes
    AnyRef
    Annotations
    @native()
  35. def optimizer: Optimizer

    Logical query plan optimizer.

    Logical query plan optimizer.

    Note: this depends on catalog and experimentalMethods fields.

    Attributes
    protected
    Definition Classes
    BaseSessionStateBuilder
  36. val parentState: Option[SessionState]
    Definition Classes
    BaseSessionStateBuilder
  37. def planner: SparkPlanner

    Planner that converts optimized logical plans to physical plans.

    Planner that converts optimized logical plans to physical plans.

    Note: this depends on the conf and experimentalMethods fields.

    Attributes
    protected
    Definition Classes
    BaseSessionStateBuilder
  38. def queryStagePrepRules: Seq[Rule[SparkPlan]]
    Attributes
    protected
    Definition Classes
    BaseSessionStateBuilder
  39. lazy val resourceLoader: SessionResourceLoader

    ResourceLoader that is used to load function resources and jars.

    ResourceLoader that is used to load function resources and jars.

    Attributes
    protected
    Definition Classes
    BaseSessionStateBuilder
  40. val session: SparkSession
    Definition Classes
    BaseSessionStateBuilder
  41. lazy val sqlParser: ParserInterface

    Parser that extracts expressions, plans, table identifiers etc.

    Parser that extracts expressions, plans, table identifiers etc. from SQL texts.

    Note: this depends on the conf field.

    Attributes
    protected
    Definition Classes
    BaseSessionStateBuilder
  42. def streamingQueryManager: StreamingQueryManager

    Interface to start and stop streaming queries.

    Interface to start and stop streaming queries.

    Attributes
    protected
    Definition Classes
    BaseSessionStateBuilder
  43. final def synchronized[T0](arg0: ⇒ T0): T0
    Definition Classes
    AnyRef
  44. def toString(): String
    Definition Classes
    AnyRef → Any
  45. def udfRegistration: UDFRegistration

    Interface exposed to the user for registering user-defined functions.

    Interface exposed to the user for registering user-defined functions.

    Note 1: The user-defined functions must be deterministic. Note 2: This depends on the functionRegistry field.

    Attributes
    protected
    Definition Classes
    BaseSessionStateBuilder
  46. lazy val v2SessionCatalog: V2SessionCatalog
    Attributes
    protected
    Definition Classes
    BaseSessionStateBuilder
  47. final def wait(): Unit
    Definition Classes
    AnyRef
    Annotations
    @throws( ... )
  48. final def wait(arg0: Long, arg1: Int): Unit
    Definition Classes
    AnyRef
    Annotations
    @throws( ... )
  49. final def wait(arg0: Long): Unit
    Definition Classes
    AnyRef
    Annotations
    @throws( ... ) @native()

Inherited from BaseSessionStateBuilder

Inherited from AnyRef

Inherited from Any

Ungrouped