org.apache.spark.sql.execution.datasources
DataSourceStrategy
Companion class DataSourceStrategy
object DataSourceStrategy extends Serializable
- Alphabetic
- By Inheritance
- DataSourceStrategy
- Serializable
- Serializable
- AnyRef
- Any
- Hide All
- Show All
- Public
- All
Value Members
-
final
def
!=(arg0: Any): Boolean
- Definition Classes
- AnyRef → Any
-
final
def
##(): Int
- Definition Classes
- AnyRef → Any
-
final
def
==(arg0: Any): Boolean
- Definition Classes
- AnyRef → Any
-
final
def
asInstanceOf[T0]: T0
- Definition Classes
- Any
-
def
clone(): AnyRef
- Attributes
- protected[lang]
- Definition Classes
- AnyRef
- Annotations
- @throws( ... ) @native()
-
final
def
eq(arg0: AnyRef): Boolean
- Definition Classes
- AnyRef
-
def
equals(arg0: Any): Boolean
- Definition Classes
- AnyRef → Any
-
def
finalize(): Unit
- Attributes
- protected[lang]
- Definition Classes
- AnyRef
- Annotations
- @throws( classOf[java.lang.Throwable] )
-
final
def
getClass(): Class[_]
- Definition Classes
- AnyRef → Any
- Annotations
- @native()
-
def
hashCode(): Int
- Definition Classes
- AnyRef → Any
- Annotations
- @native()
-
final
def
isInstanceOf[T0]: Boolean
- Definition Classes
- Any
-
final
def
ne(arg0: AnyRef): Boolean
- Definition Classes
- AnyRef
-
def
normalizeExprs(exprs: Seq[Expression], attributes: Seq[AttributeReference]): Seq[Expression]
The attribute name may differ from the one in the schema if the query analyzer is case insensitive.
The attribute name may differ from the one in the schema if the query analyzer is case insensitive. We should change attribute names to match the ones in the schema, so we do not need to worry about case sensitivity anymore.
- Attributes
- protected[sql]
-
final
def
notify(): Unit
- Definition Classes
- AnyRef
- Annotations
- @native()
-
final
def
notifyAll(): Unit
- Definition Classes
- AnyRef
- Annotations
- @native()
-
def
rebuildExpressionFromFilter(filter: Filter, translatedFilterToExpr: HashMap[Filter, Expression]): Expression
- Attributes
- protected[sql]
-
def
selectFilters(relation: BaseRelation, predicates: Seq[Expression]): (Seq[Expression], Seq[Filter], Set[Filter])
Selects Catalyst predicate Expressions which are convertible into data source Filters and can be handled by
relation
.Selects Catalyst predicate Expressions which are convertible into data source Filters and can be handled by
relation
.- returns
A triplet of
Seq[Expression]
,Seq[Filter]
, andSeq[Filter]
. The first element contains all Catalyst predicate Expressions that are either not convertible or cannot be handled byrelation
. The second element contains all converted data source Filters that will be pushed down to the data source. The third element contains all Filters that are completely filtered at the DataSource.
- Attributes
- protected[sql]
-
final
def
synchronized[T0](arg0: ⇒ T0): T0
- Definition Classes
- AnyRef
-
def
toString(): String
- Definition Classes
- AnyRef → Any
-
def
translateFilter(predicate: Expression, supportNestedPredicatePushdown: Boolean): Option[Filter]
Tries to translate a Catalyst Expression into data source Filter.
Tries to translate a Catalyst Expression into data source Filter.
- returns
a
Some[Filter]
if the input Expression is convertible, otherwise aNone
.
- Attributes
- protected[sql]
-
def
translateFilterWithMapping(predicate: Expression, translatedFilterToExpr: Option[HashMap[Filter, Expression]], nestedPredicatePushdownEnabled: Boolean): Option[Filter]
Tries to translate a Catalyst Expression into data source Filter.
Tries to translate a Catalyst Expression into data source Filter.
- predicate
The input Expression to be translated as Filter
- translatedFilterToExpr
An optional map from leaf node filter expressions to its translated Filter. The map is used for rebuilding Expression from Filter.
- nestedPredicatePushdownEnabled
Whether nested predicate pushdown is enabled.
- returns
a
Some[Filter]
if the input Expression is convertible, otherwise aNone
.
- Attributes
- protected[sql]
-
final
def
wait(): Unit
- Definition Classes
- AnyRef
- Annotations
- @throws( ... )
-
final
def
wait(arg0: Long, arg1: Int): Unit
- Definition Classes
- AnyRef
- Annotations
- @throws( ... )
-
final
def
wait(arg0: Long): Unit
- Definition Classes
- AnyRef
- Annotations
- @throws( ... ) @native()