org.apache.spark.sql.catalyst

analysis

package analysis

Provides a logical query plan Analyzer and supporting classes for performing analysis. Analysis consists of translating UnresolvedAttributes and UnresolvedRelations into fully typed objects using information in a schema Catalog.

Linear Supertypes
AnyRef, Any
Ordering
  1. Alphabetic
  2. By inheritance
Inherited
  1. analysis
  2. AnyRef
  3. Any
  1. Hide All
  2. Show all
Learn more about member selection
Visibility
  1. Public
  2. All

Type Members

  1. class Analyzer extends RuleExecutor[LogicalPlan] with HiveTypeCoercion

    Provides a logical query plan analyzer, which translates UnresolvedAttributes and UnresolvedRelations into fully typed objects using information in a schema Catalog and a FunctionRegistry.

  2. trait Catalog extends AnyRef

    An interface for looking up relations by name.

    An interface for looking up relations by name. Used by an Analyzer.

  3. trait FunctionRegistry extends AnyRef

    A catalog for looking up user defined functions, used by an Analyzer.

  4. trait HiveTypeCoercion extends AnyRef

    A collection of Rules that can be used to coerce differing types that participate in operations into compatible ones.

    A collection of Rules that can be used to coerce differing types that participate in operations into compatible ones. Most of these rules are based on Hive semantics, but they do not introduce any dependencies on the hive codebase. For this reason they remain in Catalyst until we have a more standard set of coercions.

  5. trait MultiInstanceRelation extends AnyRef

    A trait that should be mixed into query operators where an single instance might appear multiple times in a logical query plan.

    A trait that should be mixed into query operators where an single instance might appear multiple times in a logical query plan. It is invalid to have multiple copies of the same attribute produced by distinct operators in a query tree as this breaks the guarantee that expression ids, which are used to differentiate attributes, are unique.

    Before analysis, all operators that include this trait will be asked to produce a new version of itself with globally unique expression ids.

  6. trait OverrideCatalog extends Catalog

    A trait that can be mixed in with other Catalogs allowing specific tables to be overridden with new logical plans.

    A trait that can be mixed in with other Catalogs allowing specific tables to be overridden with new logical plans. This can be used to bind query result to virtual tables, or replace tables with in-memory cached versions. Note that the set of overrides is stored in memory and thus lost when the JVM exits.

  7. trait OverrideFunctionRegistry extends FunctionRegistry

  8. type Resolver = (String, String) ⇒ Boolean

    Responsible for resolving which identifiers refer to the same entity.

    Responsible for resolving which identifiers refer to the same entity. For example, by using case insensitive equality.

  9. class SimpleCatalog extends Catalog

  10. class SimpleFunctionRegistry extends FunctionRegistry

  11. case class Star(table: Option[String], mapFunction: (Attribute) ⇒ Expression = identity[Attribute]) extends Attribute with LeafNode[Expression] with Product with Serializable

    Represents all of the input attributes to a given relational operator, for example in "SELECT * FROM ...".

    Represents all of the input attributes to a given relational operator, for example in "SELECT * FROM ...".

    table

    an optional table that should be the target of the expansion. If omitted all tables' columns are produced.

  12. case class UnresolvedAttribute(name: String) extends Attribute with LeafNode[Expression] with Product with Serializable

    Holds the name of an attribute that has yet to be resolved.

  13. class UnresolvedException[TreeType <: TreeNode[_]] extends TreeNodeException[TreeType]

    Thrown when an invalid attempt is made to access a property of a tree that has yet to be fully resolved.

  14. case class UnresolvedFunction(name: String, children: Seq[Expression]) extends Expression with Product with Serializable

  15. case class UnresolvedRelation(tableIdentifier: Seq[String], alias: Option[String] = None) extends LeafNode with Product with Serializable

    Holds the name of a relation that has yet to be looked up in a Catalog.

Value Members

  1. object EliminateAnalysisOperators extends Rule[LogicalPlan]

    Removes Subquery operators from the plan.

    Removes Subquery operators from the plan. Subqueries are only required to provide scoping information for attributes and can be removed once analysis is complete.

  2. object EmptyCatalog extends Catalog

    A trivial catalog that returns an error when a relation is requested.

    A trivial catalog that returns an error when a relation is requested. Used for testing when all relations are already filled in and the analyser needs only to resolve attribute references.

  3. object EmptyFunctionRegistry extends FunctionRegistry

    A trivial catalog that returns an error when a function is requested.

    A trivial catalog that returns an error when a function is requested. Used for testing when all functions are already filled in and the analyser needs only to resolve attribute references.

  4. object HiveTypeCoercion

  5. object NewRelationInstances extends Rule[LogicalPlan]

    If any MultiInstanceRelation appears more than once in the query plan then the plan is updated so that each instance has unique expression ids for the attributes produced.

  6. object SimpleAnalyzer extends Analyzer

    A trivial Analyzer with an EmptyCatalog and EmptyFunctionRegistry.

    A trivial Analyzer with an EmptyCatalog and EmptyFunctionRegistry. Used for testing when all relations are already filled in and the analyser needs only to resolve attribute references.

  7. val caseInsensitiveResolution: (String, String) ⇒ Boolean

  8. val caseSensitiveResolution: (String, String) ⇒ Boolean

Inherited from AnyRef

Inherited from Any

Ungrouped