Class

org.apache.spark.sql.cassandra

PredicatePushDown

Related Doc: package cassandra

Permalink

class PredicatePushDown[Predicate] extends AnyRef

Determines which filter predicates can be pushed down to Cassandra.

  1. Only push down no-partition key column predicates with =, >, <, >=, <= predicate 2. Only push down primary key column predicates with = or IN predicate. 3. If there are regular columns in the pushdown predicates, they should have at least one EQ expression on an indexed column and no IN predicates. 4. All partition column predicates must be included in the predicates to be pushed down, only the last part of the partition key can be an IN predicate. For each partition column, only one predicate is allowed. 5. For cluster column predicates, only last predicate can be non-EQ predicate including IN predicate, and preceding column predicates must be EQ predicates. If there is only one cluster column predicate, the predicates could be any non-IN predicate. 6. There is no pushdown predicates if there is any OR condition or NOT IN condition. 7. We're not allowed to push down multiple predicates for the same column if any of them is equality or IN predicate.

The list of predicates to be pushed down is available in predicatesToPushDown property. The list of predicates that cannot be pushed down is available in predicatesToPreserve property.

Linear Supertypes
AnyRef, Any
Ordering
  1. Alphabetic
  2. By inheritance
Inherited
  1. PredicatePushDown
  2. AnyRef
  3. Any
Implicitly
  1. by any2stringadd
  2. by StringFormat
  3. by Ensuring
  4. by ArrowAssoc
  1. Hide All
  2. Show all
Visibility
  1. Public
  2. All

Instance Constructors

  1. new PredicatePushDown(predicates: Set[Predicate], table: TableDef)(implicit arg0: PredicateOps[Predicate])

    Permalink

    predicates

    list of filter predicates available in the user query

    table

    Cassandra table definition

Value Members

  1. final def !=(arg0: Any): Boolean

    Permalink
    Definition Classes
    AnyRef → Any

  2. final def ##(): Int

    Permalink
    Definition Classes
    AnyRef → Any

  3. def +(other: String): String

    Permalink
    Implicit information
    This member is added by an implicit conversion from PredicatePushDown[Predicate] to any2stringadd[PredicatePushDown[Predicate]] performed by method any2stringadd in scala.Predef.
    Definition Classes
    any2stringadd

  4. def ->[B](y: B): (PredicatePushDown[Predicate], B)

    Permalink
    Implicit information
    This member is added by an implicit conversion from PredicatePushDown[Predicate] to ArrowAssoc[PredicatePushDown[Predicate]] performed by method ArrowAssoc in scala.Predef.
    Definition Classes
    ArrowAssoc
    Annotations
    @inline()

  5. final def ==(arg0: Any): Boolean

    Permalink
    Definition Classes
    AnyRef → Any

  6. final def asInstanceOf[T0]: T0

    Permalink
    Definition Classes
    Any

  7. def clone(): AnyRef

    Permalink
    Attributes
    protected[java.lang]
    Definition Classes
    AnyRef
    Annotations
    @throws( ... )

  8. def ensuring(cond: (PredicatePushDown[Predicate]) ⇒ Boolean, msg: ⇒ Any): PredicatePushDown[Predicate]

    Permalink
    Implicit information
    This member is added by an implicit conversion from PredicatePushDown[Predicate] to Ensuring[PredicatePushDown[Predicate]] performed by method Ensuring in scala.Predef.
    Definition Classes
    Ensuring

  9. def ensuring(cond: (PredicatePushDown[Predicate]) ⇒ Boolean): PredicatePushDown[Predicate]

    Permalink
    Implicit information
    This member is added by an implicit conversion from PredicatePushDown[Predicate] to Ensuring[PredicatePushDown[Predicate]] performed by method Ensuring in scala.Predef.
    Definition Classes
    Ensuring

  10. def ensuring(cond: Boolean, msg: ⇒ Any): PredicatePushDown[Predicate]

    Permalink
    Implicit information
    This member is added by an implicit conversion from PredicatePushDown[Predicate] to Ensuring[PredicatePushDown[Predicate]] performed by method Ensuring in scala.Predef.
    Definition Classes
    Ensuring

  11. def ensuring(cond: Boolean): PredicatePushDown[Predicate]

    Permalink
    Implicit information
    This member is added by an implicit conversion from PredicatePushDown[Predicate] to Ensuring[PredicatePushDown[Predicate]] performed by method Ensuring in scala.Predef.
    Definition Classes
    Ensuring

  12. final def eq(arg0: AnyRef): Boolean

    Permalink
    Definition Classes
    AnyRef

  13. def equals(arg0: Any): Boolean

    Permalink
    Definition Classes
    AnyRef → Any

  14. def finalize(): Unit

    Permalink
    Attributes
    protected[java.lang]
    Definition Classes
    AnyRef
    Annotations
    @throws( classOf[java.lang.Throwable] )

  15. def formatted(fmtstr: String): String

    Permalink
    Implicit information
    This member is added by an implicit conversion from PredicatePushDown[Predicate] to StringFormat[PredicatePushDown[Predicate]] performed by method StringFormat in scala.Predef.
    Definition Classes
    StringFormat
    Annotations
    @inline()

  16. final def getClass(): Class[_]

    Permalink
    Definition Classes
    AnyRef → Any

  17. def hashCode(): Int

    Permalink
    Definition Classes
    AnyRef → Any

  18. final def isInstanceOf[T0]: Boolean

    Permalink
    Definition Classes
    Any

  19. final def ne(arg0: AnyRef): Boolean

    Permalink
    Definition Classes
    AnyRef

  20. final def notify(): Unit

    Permalink
    Definition Classes
    AnyRef

  21. final def notifyAll(): Unit

    Permalink
    Definition Classes
    AnyRef

  22. val predicatesToPreserve: Set[Predicate]

    Permalink

    Returns the set of predicates that cannot be pushed down to Cassandra, so they must be applied by Spark

  23. val predicatesToPushDown: Set[Predicate]

    Permalink

    Returns the set of predicates that can be safely pushed down to Cassandra

  24. final def synchronized[T0](arg0: ⇒ T0): T0

    Permalink
    Definition Classes
    AnyRef

  25. def toString(): String

    Permalink
    Definition Classes
    AnyRef → Any

  26. final def wait(): Unit

    Permalink
    Definition Classes
    AnyRef
    Annotations
    @throws( ... )

  27. final def wait(arg0: Long, arg1: Int): Unit

    Permalink
    Definition Classes
    AnyRef
    Annotations
    @throws( ... )

  28. final def wait(arg0: Long): Unit

    Permalink
    Definition Classes
    AnyRef
    Annotations
    @throws( ... )

  29. def →[B](y: B): (PredicatePushDown[Predicate], B)

    Permalink
    Implicit information
    This member is added by an implicit conversion from PredicatePushDown[Predicate] to ArrowAssoc[PredicatePushDown[Predicate]] performed by method ArrowAssoc in scala.Predef.
    Definition Classes
    ArrowAssoc

Inherited from AnyRef

Inherited from Any

Inherited by implicit conversion any2stringadd from PredicatePushDown[Predicate] to any2stringadd[PredicatePushDown[Predicate]]

Inherited by implicit conversion StringFormat from PredicatePushDown[Predicate] to StringFormat[PredicatePushDown[Predicate]]

Inherited by implicit conversion Ensuring from PredicatePushDown[Predicate] to Ensuring[PredicatePushDown[Predicate]]

Inherited by implicit conversion ArrowAssoc from PredicatePushDown[Predicate] to ArrowAssoc[PredicatePushDown[Predicate]]

Ungrouped