Packages

c

org.apache.hadoop.hbase.spark.HBaseRDDFunctions

GenericHBaseRDDFunctions

implicit class GenericHBaseRDDFunctions[T] extends AnyRef

These are implicit methods for a RDD that contains any type of data.

T

This is any type

Linear Supertypes
AnyRef, Any
Ordering
  1. Alphabetic
  2. By Inheritance
Inherited
  1. GenericHBaseRDDFunctions
  2. AnyRef
  3. Any
  1. Hide All
  2. Show All
Visibility
  1. Public
  2. All

Instance Constructors

  1. new GenericHBaseRDDFunctions(rdd: RDD[T])

    rdd

    This is for rdd of any type

Value Members

  1. final def !=(arg0: Any): Boolean
    Definition Classes
    AnyRef → Any
  2. final def ##(): Int
    Definition Classes
    AnyRef → Any
  3. final def ==(arg0: Any): Boolean
    Definition Classes
    AnyRef → Any
  4. final def asInstanceOf[T0]: T0
    Definition Classes
    Any
  5. def clone(): AnyRef
    Attributes
    protected[lang]
    Definition Classes
    AnyRef
    Annotations
    @throws( ... ) @native()
  6. final def eq(arg0: AnyRef): Boolean
    Definition Classes
    AnyRef
  7. def equals(arg0: Any): Boolean
    Definition Classes
    AnyRef → Any
  8. def finalize(): Unit
    Attributes
    protected[lang]
    Definition Classes
    AnyRef
    Annotations
    @throws( classOf[java.lang.Throwable] )
  9. final def getClass(): Class[_]
    Definition Classes
    AnyRef → Any
    Annotations
    @native()
  10. def hashCode(): Int
    Definition Classes
    AnyRef → Any
    Annotations
    @native()
  11. def hbaseBulkDelete(hc: HBaseContext, tableName: TableName, f: (T) ⇒ Delete, batchSize: Int): Unit

    Implicit method that gives easy access to HBaseContext's bulk Delete.

    Implicit method that gives easy access to HBaseContext's bulk Delete. This will not return a new RDD.

    hc

    The hbaseContext object to identify which HBase cluster connection to use

    tableName

    The tableName that the deletes will be sent to

    f

    The function that will convert the RDD value into a HBase Delete Object

    batchSize

    The number of Deletes to be sent in a single batch

  12. def hbaseBulkGet(hc: HBaseContext, tableName: TableName, batchSize: Int, f: (T) ⇒ Get): RDD[(ImmutableBytesWritable, Result)]

    Implicit method that gives easy access to HBaseContext's bulk get.

    Implicit method that gives easy access to HBaseContext's bulk get. This will return a new RDD. Think about it as a RDD map function. In that every RDD value will get a new value out of HBase. That new value will populate the newly generated RDD.

    hc

    The hbaseContext object to identify which HBase cluster connection to use

    tableName

    The tableName that the put will be sent to

    batchSize

    How many gets to execute in a single batch

    f

    The function that will turn the RDD values in HBase Get objects

    returns

    A resulting RDD with type R objects

  13. def hbaseBulkGet[R](hc: HBaseContext, tableName: TableName, batchSize: Int, f: (T) ⇒ Get, convertResult: (Result) ⇒ R)(implicit arg0: ClassTag[R]): RDD[R]

    Implicit method that gives easy access to HBaseContext's bulk get.

    Implicit method that gives easy access to HBaseContext's bulk get. This will return a new RDD. Think about it as a RDD map function. In that every RDD value will get a new value out of HBase. That new value will populate the newly generated RDD.

    R

    The type of Object that will be coming out of the resulting RDD

    hc

    The hbaseContext object to identify which HBase cluster connection to use

    tableName

    The tableName that the put will be sent to

    batchSize

    How many gets to execute in a single batch

    f

    The function that will turn the RDD values in HBase Get objects

    convertResult

    The function that will convert a HBase Result object into a value that will go into the resulting RDD

    returns

    A resulting RDD with type R objects

  14. def hbaseBulkPut(hc: HBaseContext, tableName: TableName, f: (T) ⇒ Put): Unit

    Implicit method that gives easy access to HBaseContext's bulk put.

    Implicit method that gives easy access to HBaseContext's bulk put. This will not return a new RDD. Think of it like a foreach

    hc

    The hbaseContext object to identify which HBase cluster connection to use

    tableName

    The tableName that the put will be sent to

    f

    The function that will turn the RDD values into HBase Put objects.

  15. def hbaseForeachPartition(hc: HBaseContext, f: (Iterator[T], Connection) ⇒ Unit): Unit

    Implicit method that gives easy access to HBaseContext's foreachPartition method.

    Implicit method that gives easy access to HBaseContext's foreachPartition method. This will ack very much like a normal RDD foreach method but for the fact that you will now have a HBase connection while iterating through the values.

    hc

    The hbaseContext object to identify which HBase cluster connection to use

    f

    This function will get an iterator for a Partition of an RDD along with a connection object to HBase

  16. def hbaseMapPartitions[R](hc: HBaseContext, f: (Iterator[T], Connection) ⇒ Iterator[R])(implicit arg0: ClassTag[R]): RDD[R]

    Implicit method that gives easy access to HBaseContext's mapPartitions method.

    Implicit method that gives easy access to HBaseContext's mapPartitions method. This will ask very much like a normal RDD map partitions method but for the fact that you will now have a HBase connection while iterating through the values

    R

    This is the type of objects that will go into the resulting RDD

    hc

    The hbaseContext object to identify which HBase cluster connection to use

    f

    This function will get an iterator for a Partition of an RDD along with a connection object to HBase

    returns

    A resulting RDD of type R

  17. final def isInstanceOf[T0]: Boolean
    Definition Classes
    Any
  18. final def ne(arg0: AnyRef): Boolean
    Definition Classes
    AnyRef
  19. final def notify(): Unit
    Definition Classes
    AnyRef
    Annotations
    @native()
  20. final def notifyAll(): Unit
    Definition Classes
    AnyRef
    Annotations
    @native()
  21. val rdd: RDD[T]
  22. final def synchronized[T0](arg0: ⇒ T0): T0
    Definition Classes
    AnyRef
  23. def toString(): String
    Definition Classes
    AnyRef → Any
  24. final def wait(): Unit
    Definition Classes
    AnyRef
    Annotations
    @throws( ... )
  25. final def wait(arg0: Long, arg1: Int): Unit
    Definition Classes
    AnyRef
    Annotations
    @throws( ... )
  26. final def wait(arg0: Long): Unit
    Definition Classes
    AnyRef
    Annotations
    @throws( ... ) @native()

Inherited from AnyRef

Inherited from Any

Ungrouped