org.locationtech.geomesa.bigtable.spark

Class BigtableTableRecordReader

java.lang.Object

org.locationtech.geomesa.bigtable.spark.BigtableTableRecordReader

public class BigtableTableRecordReader
extends Object

Field Summary

Fields

Modifier and Type	Field and Description
static String	LOG_PER_ROW_COUNT

Constructor Summary

Constructors

Constructor and Description
BigtableTableRecordReader()

Method Summary

Modifier and Type	Method and Description
void	close() Closes the split.
org.apache.hadoop.hbase.io.ImmutableBytesWritable	getCurrentKey() Returns the current key.
org.apache.hadoop.hbase.client.Result	getCurrentValue() Returns the current value.
float	getProgress() The current progress of the record reader through its data.
void	initialize(org.apache.hadoop.mapreduce.InputSplit inputsplit, org.apache.hadoop.mapreduce.TaskAttemptContext context) Build the scanner.
boolean	nextKeyValue() Positions the record reader to the next record.
void	restart() Restart from survivable exceptions by creating a new scanner.
protected static Method	retrieveGetCounterWithStringsParams(org.apache.hadoop.mapreduce.TaskAttemptContext context) In new mapreduce APIs, TaskAttemptContext has two getCounter methods Check if getCounter(String, String) method is available.
void	setHTable(org.apache.hadoop.hbase.client.Table htable) Sets the HBase table.
void	setScan(com.google.cloud.bigtable.hbase.BigtableExtendedScan scan) Sets the scan defining the actual details like columns etc.
protected static void	updateCounters(org.apache.hadoop.hbase.client.metrics.ScanMetrics scanMetrics, Method getCounter, org.apache.hadoop.mapreduce.TaskAttemptContext context, long numStale)

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Field Detail

LOG_PER_ROW_COUNT

public static final String LOG_PER_ROW_COUNT

See Also:

Constant Field Values

Constructor Detail

BigtableTableRecordReader

public BigtableTableRecordReader()

Method Detail

restart

public void restart()
             throws IOException

Restart from survivable exceptions by creating a new scanner.

Throws:

IOException - When restarting fails.

retrieveGetCounterWithStringsParams

protected static Method retrieveGetCounterWithStringsParams(org.apache.hadoop.mapreduce.TaskAttemptContext context)
                                                     throws IOException

In new mapreduce APIs, TaskAttemptContext has two getCounter methods Check if getCounter(String, String) method is available.

Returns:

The getCounter method or null if not available.

Throws:

IOException

setHTable

public void setHTable(org.apache.hadoop.hbase.client.Table htable)

Sets the HBase table.

Parameters:

htable - The HTableDescriptor to scan.

setScan

public void setScan(com.google.cloud.bigtable.hbase.BigtableExtendedScan scan)

Sets the scan defining the actual details like columns etc.

Parameters:

scan - The scan to set.

initialize

public void initialize(org.apache.hadoop.mapreduce.InputSplit inputsplit,
                       org.apache.hadoop.mapreduce.TaskAttemptContext context)
                throws IOException,
                       InterruptedException

Build the scanner. Not done in constructor to allow for extension.

Throws:

IOException

InterruptedException

close

public void close()

Closes the split.

getCurrentKey

public org.apache.hadoop.hbase.io.ImmutableBytesWritable getCurrentKey()
                                                                throws IOException,
                                                                       InterruptedException

Returns the current key.

Returns:

The current key.

Throws:

IOException

InterruptedException - When the job is aborted.

getCurrentValue

public org.apache.hadoop.hbase.client.Result getCurrentValue()
                                                      throws IOException,
                                                             InterruptedException

Returns the current value.

Returns:

The current value.

Throws:

IOException - When the value is faulty.

InterruptedException - When the job is aborted.

nextKeyValue

public boolean nextKeyValue()
                     throws IOException,
                            InterruptedException

Positions the record reader to the next record.

Returns:

true if there was another record.

Throws:

IOException - When reading the record failed.

InterruptedException - When the job was aborted.

updateCounters

protected static void updateCounters(org.apache.hadoop.hbase.client.metrics.ScanMetrics scanMetrics,
                                     Method getCounter,
                                     org.apache.hadoop.mapreduce.TaskAttemptContext context,
                                     long numStale)

getProgress

public float getProgress()

The current progress of the record reader through its data.

Returns:

A number between 0.0 and 1.0, the fraction of the data read.