implicit class GenericHBaseRDDFunctions[T] extends AnyRef
These are implicit methods for a RDD that contains any type of data.
- T
This is any type
- Alphabetic
- By Inheritance
- GenericHBaseRDDFunctions
- AnyRef
- Any
- Hide All
- Show All
- Public
- All
Instance Constructors
-
new
GenericHBaseRDDFunctions(rdd: RDD[T])
- rdd
This is for rdd of any type
Value Members
-
final
def
!=(arg0: Any): Boolean
- Definition Classes
- AnyRef → Any
-
final
def
##(): Int
- Definition Classes
- AnyRef → Any
-
final
def
==(arg0: Any): Boolean
- Definition Classes
- AnyRef → Any
-
final
def
asInstanceOf[T0]: T0
- Definition Classes
- Any
-
def
clone(): AnyRef
- Attributes
- protected[lang]
- Definition Classes
- AnyRef
- Annotations
- @throws( ... ) @native()
-
final
def
eq(arg0: AnyRef): Boolean
- Definition Classes
- AnyRef
-
def
equals(arg0: Any): Boolean
- Definition Classes
- AnyRef → Any
-
def
finalize(): Unit
- Attributes
- protected[lang]
- Definition Classes
- AnyRef
- Annotations
- @throws( classOf[java.lang.Throwable] )
-
final
def
getClass(): Class[_]
- Definition Classes
- AnyRef → Any
- Annotations
- @native()
-
def
hashCode(): Int
- Definition Classes
- AnyRef → Any
- Annotations
- @native()
-
def
hbaseBulkDelete(hc: HBaseContext, tableName: TableName, f: (T) ⇒ Delete, batchSize: Int): Unit
Implicit method that gives easy access to HBaseContext's bulk Delete.
Implicit method that gives easy access to HBaseContext's bulk Delete. This will not return a new RDD.
- hc
The hbaseContext object to identify which HBase cluster connection to use
- tableName
The tableName that the deletes will be sent to
- f
The function that will convert the RDD value into a HBase Delete Object
- batchSize
The number of Deletes to be sent in a single batch
-
def
hbaseBulkGet(hc: HBaseContext, tableName: TableName, batchSize: Int, f: (T) ⇒ Get): RDD[(ImmutableBytesWritable, Result)]
Implicit method that gives easy access to HBaseContext's bulk get.
Implicit method that gives easy access to HBaseContext's bulk get. This will return a new RDD. Think about it as a RDD map function. In that every RDD value will get a new value out of HBase. That new value will populate the newly generated RDD.
- hc
The hbaseContext object to identify which HBase cluster connection to use
- tableName
The tableName that the put will be sent to
- batchSize
How many gets to execute in a single batch
- f
The function that will turn the RDD values in HBase Get objects
- returns
A resulting RDD with type R objects
-
def
hbaseBulkGet[R](hc: HBaseContext, tableName: TableName, batchSize: Int, f: (T) ⇒ Get, convertResult: (Result) ⇒ R)(implicit arg0: ClassTag[R]): RDD[R]
Implicit method that gives easy access to HBaseContext's bulk get.
Implicit method that gives easy access to HBaseContext's bulk get. This will return a new RDD. Think about it as a RDD map function. In that every RDD value will get a new value out of HBase. That new value will populate the newly generated RDD.
- R
The type of Object that will be coming out of the resulting RDD
- hc
The hbaseContext object to identify which HBase cluster connection to use
- tableName
The tableName that the put will be sent to
- batchSize
How many gets to execute in a single batch
- f
The function that will turn the RDD values in HBase Get objects
- convertResult
The function that will convert a HBase Result object into a value that will go into the resulting RDD
- returns
A resulting RDD with type R objects
-
def
hbaseBulkPut(hc: HBaseContext, tableName: TableName, f: (T) ⇒ Put): Unit
Implicit method that gives easy access to HBaseContext's bulk put.
Implicit method that gives easy access to HBaseContext's bulk put. This will not return a new RDD. Think of it like a foreach
- hc
The hbaseContext object to identify which HBase cluster connection to use
- tableName
The tableName that the put will be sent to
- f
The function that will turn the RDD values into HBase Put objects.
-
def
hbaseForeachPartition(hc: HBaseContext, f: (Iterator[T], Connection) ⇒ Unit): Unit
Implicit method that gives easy access to HBaseContext's foreachPartition method.
Implicit method that gives easy access to HBaseContext's foreachPartition method. This will ack very much like a normal RDD foreach method but for the fact that you will now have a HBase connection while iterating through the values.
- hc
The hbaseContext object to identify which HBase cluster connection to use
- f
This function will get an iterator for a Partition of an RDD along with a connection object to HBase
-
def
hbaseMapPartitions[R](hc: HBaseContext, f: (Iterator[T], Connection) ⇒ Iterator[R])(implicit arg0: ClassTag[R]): RDD[R]
Implicit method that gives easy access to HBaseContext's mapPartitions method.
Implicit method that gives easy access to HBaseContext's mapPartitions method. This will ask very much like a normal RDD map partitions method but for the fact that you will now have a HBase connection while iterating through the values
- R
This is the type of objects that will go into the resulting RDD
- hc
The hbaseContext object to identify which HBase cluster connection to use
- f
This function will get an iterator for a Partition of an RDD along with a connection object to HBase
- returns
A resulting RDD of type R
-
final
def
isInstanceOf[T0]: Boolean
- Definition Classes
- Any
-
final
def
ne(arg0: AnyRef): Boolean
- Definition Classes
- AnyRef
-
final
def
notify(): Unit
- Definition Classes
- AnyRef
- Annotations
- @native()
-
final
def
notifyAll(): Unit
- Definition Classes
- AnyRef
- Annotations
- @native()
- val rdd: RDD[T]
-
final
def
synchronized[T0](arg0: ⇒ T0): T0
- Definition Classes
- AnyRef
-
def
toString(): String
- Definition Classes
- AnyRef → Any
-
final
def
wait(): Unit
- Definition Classes
- AnyRef
- Annotations
- @throws( ... )
-
final
def
wait(arg0: Long, arg1: Int): Unit
- Definition Classes
- AnyRef
- Annotations
- @throws( ... )
-
final
def
wait(arg0: Long): Unit
- Definition Classes
- AnyRef
- Annotations
- @throws( ... ) @native()