com.google.cloud.hadoop.io.bigquery

Class AvroBigQueryInputFormat

java.lang.Object

org.apache.hadoop.mapreduce.InputFormat<K,V>

com.google.cloud.hadoop.io.bigquery.AbstractBigQueryInputFormat<org.apache.hadoop.io.LongWritable,org.apache.avro.generic.GenericData.Record>

com.google.cloud.hadoop.io.bigquery.AvroBigQueryInputFormat

All Implemented Interfaces:

DelegateRecordReaderFactory<org.apache.hadoop.io.LongWritable,org.apache.avro.generic.GenericData.Record>

public class AvroBigQueryInputFormat
extends AbstractBigQueryInputFormat<org.apache.hadoop.io.LongWritable,org.apache.avro.generic.GenericData.Record>

InputFormat to generate and ingest Avro-based BigQuery exports.

Field Summary

Fields inherited from class com.google.cloud.hadoop.io.bigquery.AbstractBigQueryInputFormat

EXTERNAL_TABLE_TYPE, INPUT_FORMAT_CLASS

Constructor Summary

Constructors

Constructor and Description
AvroBigQueryInputFormat()

Method Summary

Modifier and Type	Method and Description
org.apache.hadoop.mapreduce.RecordReader<org.apache.hadoop.io.LongWritable,org.apache.avro.generic.GenericData.Record>	createDelegateRecordReader(org.apache.hadoop.mapreduce.InputSplit split, org.apache.hadoop.conf.Configuration configuration) Create a new record reader for a single input split.
ExportFileFormat	getExportFileFormat() Get the ExportFileFormat that this input format supports.

Methods inherited from class com.google.cloud.hadoop.io.bigquery.AbstractBigQueryInputFormat

cleanupJob, cleanupJob, createRecordReader, createRecordReader, getBigQuery, getBigQueryHelper, getExportFileFormat, getExportFileFormat, getSplits, setInputTable, setInputTable, setTemporaryCloudStorageDirectory

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Detail

AvroBigQueryInputFormat

public AvroBigQueryInputFormat()

Method Detail

createDelegateRecordReader

public org.apache.hadoop.mapreduce.RecordReader<org.apache.hadoop.io.LongWritable,org.apache.avro.generic.GenericData.Record> createDelegateRecordReader(org.apache.hadoop.mapreduce.InputSplit split,
                                                                                                                                                         org.apache.hadoop.conf.Configuration configuration)
                                                                                                                                                  throws IOException,
                                                                                                                                                         InterruptedException

Description copied from interface: DelegateRecordReaderFactory

Create a new record reader for a single input split.

Throws:

IOException

InterruptedException

getExportFileFormat

public ExportFileFormat getExportFileFormat()

Description copied from class: AbstractBigQueryInputFormat

Get the ExportFileFormat that this input format supports.

Specified by:

getExportFileFormat in class AbstractBigQueryInputFormat<org.apache.hadoop.io.LongWritable,org.apache.avro.generic.GenericData.Record>