com.google.cloud.hadoop.io.bigquery

Class GsonBigQueryInputFormat

java.lang.Object

org.apache.hadoop.mapreduce.InputFormat<K,V>

com.google.cloud.hadoop.io.bigquery.AbstractBigQueryInputFormat<org.apache.hadoop.io.LongWritable,com.google.gson.JsonObject>

com.google.cloud.hadoop.io.bigquery.GsonBigQueryInputFormat

All Implemented Interfaces:

DelegateRecordReaderFactory<org.apache.hadoop.io.LongWritable,com.google.gson.JsonObject>

Direct Known Subclasses:

BigQueryInputFormat

public class GsonBigQueryInputFormat
extends AbstractBigQueryInputFormat<org.apache.hadoop.io.LongWritable,com.google.gson.JsonObject>

GsonBigQueryInputFormat provides access to BigQuery tables via exports to GCS in the form of gson JsonObjects as mapper values.

Field Summary

Fields inherited from class com.google.cloud.hadoop.io.bigquery.AbstractBigQueryInputFormat

EXTERNAL_TABLE_TYPE, INPUT_FORMAT_CLASS_KEY

Constructor Summary

Constructors

Constructor and Description
GsonBigQueryInputFormat()

Method Summary

Modifier and Type	Method and Description
org.apache.hadoop.mapreduce.RecordReader<org.apache.hadoop.io.LongWritable,com.google.gson.JsonObject>	createDelegateRecordReader(org.apache.hadoop.mapreduce.InputSplit split, org.apache.hadoop.conf.Configuration configuration) Create a new record reader for a single input split.
ExportFileFormat	getExportFileFormat() Get the ExportFileFormat that this input format supports.

Methods inherited from class com.google.cloud.hadoop.io.bigquery.AbstractBigQueryInputFormat

cleanupJob, cleanupJob, cleanupJob, createRecordReader, createRecordReader, getBigQuery, getBigQueryHelper, getExportFileFormat, getExportFileFormat, getSplits, isShardedExportEnabled, setEnableShardedExport, setInputTable, setInputTable, setTemporaryCloudStorageDirectory

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Detail

GsonBigQueryInputFormat

public GsonBigQueryInputFormat()

Method Detail

createDelegateRecordReader

public org.apache.hadoop.mapreduce.RecordReader<org.apache.hadoop.io.LongWritable,com.google.gson.JsonObject> createDelegateRecordReader(org.apache.hadoop.mapreduce.InputSplit split,
                                                                                                                                         org.apache.hadoop.conf.Configuration configuration)
                                                                                                                                  throws java.io.IOException,
                                                                                                                                         java.lang.InterruptedException

Description copied from interface: DelegateRecordReaderFactory

Create a new record reader for a single input split.

Throws:

java.io.IOException

java.lang.InterruptedException

getExportFileFormat

public ExportFileFormat getExportFileFormat()

Description copied from class: AbstractBigQueryInputFormat

Get the ExportFileFormat that this input format supports.

Specified by:

getExportFileFormat in class AbstractBigQueryInputFormat<org.apache.hadoop.io.LongWritable,com.google.gson.JsonObject>