Class/Object

org.apache.spark.sql.aliyun.redis

RedisRelation

Related Docs: object RedisRelation | package redis

Permalink

class RedisRelation extends BaseRelation with InsertableRelation with PrunedFilteredScan with Keys with Serializable with Logging

refer to org.apache.spark.sql.redis.RedisSourceRelation and change org.apache.spark.sql.redis.RedisSourceRelation.dataKeyId() for idempotent write

Linear Supertypes
Logging, Serializable, Serializable, Keys, PrunedFilteredScan, InsertableRelation, BaseRelation, AnyRef, Any
Ordering
  1. Alphabetic
  2. By inheritance
Inherited
  1. RedisRelation
  2. Logging
  3. Serializable
  4. Serializable
  5. Keys
  6. PrunedFilteredScan
  7. InsertableRelation
  8. BaseRelation
  9. AnyRef
  10. Any
  1. Hide All
  2. Show all
Visibility
  1. Public
  2. All

Instance Constructors

  1. new RedisRelation(sqlContext: SQLContext, parameters: Map[String, String], userSpecifiedSchema: Option[StructType], batchId: Long)

    Permalink

Value Members

  1. final def !=(arg0: Any): Boolean

    Permalink
    Definition Classes
    AnyRef → Any

  2. final def ##(): Int

    Permalink
    Definition Classes
    AnyRef → Any

  3. final def ==(arg0: Any): Boolean

    Permalink
    Definition Classes
    AnyRef → Any

  4. final def asInstanceOf[T0]: T0

    Permalink
    Definition Classes
    Any

  5. def buildScan(requiredColumns: Array[String], filters: Array[Filter]): RDD[Row]

    Permalink
    Definition Classes
    RedisRelation → PrunedFilteredScan

  6. def clone(): AnyRef

    Permalink
    Attributes
    protected[java.lang]
    Definition Classes
    AnyRef
    Annotations
    @throws( ... )

  7. final def eq(arg0: AnyRef): Boolean

    Permalink
    Definition Classes
    AnyRef

  8. def equals(arg0: Any): Boolean

    Permalink
    Definition Classes
    AnyRef → Any

  9. def filterKeysByType(conn: Jedis, keys: Array[String], t: String)(implicit readWriteConfig: ReadWriteConfig): Array[String]

    Permalink
    Definition Classes
    Keys

  10. def finalize(): Unit

    Permalink
    Attributes
    protected[java.lang]
    Definition Classes
    AnyRef
    Annotations
    @throws( classOf[java.lang.Throwable] )

  11. final def getClass(): Class[_]

    Permalink
    Definition Classes
    AnyRef → Any

  12. def getKeys(nodes: Array[RedisNode], sPos: Int, ePos: Int, keyPattern: String)(implicit readWriteConfig: ReadWriteConfig): Iterator[String]

    Permalink
    Definition Classes
    Keys

  13. def getMasterNode(nodes: Array[RedisNode], key: String): RedisNode

    Permalink
    Definition Classes
    Keys

  14. def groupKeysByNode(nodes: Array[RedisNode], keys: Iterator[String]): Iterator[(RedisNode, Array[String])]

    Permalink
    Definition Classes
    Keys

  15. def hashCode(): Int

    Permalink
    Definition Classes
    AnyRef → Any

  16. def insert(data: DataFrame, overwrite: Boolean): Unit

    Permalink
    Definition Classes
    RedisRelation → InsertableRelation

  17. def isEmpty: Boolean

    Permalink

    returns

    true if data exists in redis

  18. final def isInstanceOf[T0]: Boolean

    Permalink
    Definition Classes
    Any

  19. def logDebug(msg: ⇒ String): Unit

    Permalink
    Definition Classes
    Logging

  20. def logInfo(msg: ⇒ String): Unit

    Permalink
    Definition Classes
    Logging

  21. def logTrace(msg: ⇒ String): Unit

    Permalink
    Definition Classes
    Logging

  22. def logger: Logger

    Permalink
    Attributes
    protected
    Definition Classes
    Logging

  23. def loggerName: String

    Permalink
    Attributes
    protected
    Definition Classes
    Logging

  24. final def ne(arg0: AnyRef): Boolean

    Permalink
    Definition Classes
    AnyRef

  25. def needConversion: Boolean

    Permalink
    Definition Classes
    BaseRelation

  26. def nonEmpty: Boolean

    Permalink

    returns

    true if no data exists in redis

  27. final def notify(): Unit

    Permalink
    Definition Classes
    AnyRef

  28. final def notifyAll(): Unit

    Permalink
    Definition Classes
    AnyRef

  29. def schema: StructType

    Permalink
    Definition Classes
    RedisRelation → BaseRelation

  30. def sizeInBytes: Long

    Permalink
    Definition Classes
    BaseRelation

  31. val sqlContext: SQLContext

    Permalink
    Definition Classes
    RedisRelation → BaseRelation

  32. def supportDynamicPartitionPrune: Boolean

    Permalink
    Definition Classes
    BaseRelation

  33. final def synchronized[T0](arg0: ⇒ T0): T0

    Permalink
    Definition Classes
    AnyRef

  34. def toString(): String

    Permalink
    Definition Classes
    AnyRef → Any

  35. def unhandledFilters(filters: Array[Filter]): Array[Filter]

    Permalink
    Definition Classes
    RedisRelation → BaseRelation

  36. final def wait(): Unit

    Permalink
    Definition Classes
    AnyRef
    Annotations
    @throws( ... )

  37. final def wait(arg0: Long, arg1: Int): Unit

    Permalink
    Definition Classes
    AnyRef
    Annotations
    @throws( ... )

  38. final def wait(arg0: Long): Unit

    Permalink
    Definition Classes
    AnyRef
    Annotations
    @throws( ... )

Inherited from Logging

Inherited from Serializable

Inherited from Serializable

Inherited from Keys

Inherited from PrunedFilteredScan

Inherited from InsertableRelation

Inherited from BaseRelation

Inherited from AnyRef

Inherited from Any

Ungrouped