com.google.cloud.hadoop.io.bigquery

Class JsonTextBigQueryInputFormat

java.lang.Object

org.apache.hadoop.mapreduce.InputFormat<K,V>

com.google.cloud.hadoop.io.bigquery.AbstractBigQueryInputFormat<org.apache.hadoop.io.LongWritable,org.apache.hadoop.io.Text>

com.google.cloud.hadoop.io.bigquery.JsonTextBigQueryInputFormat

All Implemented Interfaces:

DelegateRecordReaderFactory<org.apache.hadoop.io.LongWritable,org.apache.hadoop.io.Text>

public class JsonTextBigQueryInputFormat
extends AbstractBigQueryInputFormat<org.apache.hadoop.io.LongWritable,org.apache.hadoop.io.Text>

An input format that provides BigQuery JSON as lines of text as they are written to the export by BigQuery.

Field Summary

Fields inherited from class com.google.cloud.hadoop.io.bigquery.AbstractBigQueryInputFormat

EXTERNAL_TABLE_TYPE, INPUT_FORMAT_CLASS_KEY

Constructor Summary

Constructors

Constructor and Description
JsonTextBigQueryInputFormat()

Method Summary

Modifier and Type	Method and Description
org.apache.hadoop.mapreduce.RecordReader<org.apache.hadoop.io.LongWritable,org.apache.hadoop.io.Text>	createDelegateRecordReader(org.apache.hadoop.mapreduce.InputSplit split, org.apache.hadoop.conf.Configuration configuration) Create a new record reader for a single input split.
ExportFileFormat	getExportFileFormat() Get the ExportFileFormat that this input format supports.

Methods inherited from class com.google.cloud.hadoop.io.bigquery.AbstractBigQueryInputFormat

cleanupJob, cleanupJob, cleanupJob, createRecordReader, createRecordReader, getBigQuery, getBigQueryHelper, getExportFileFormat, getExportFileFormat, getSplits, isShardedExportEnabled, setEnableShardedExport, setInputTable, setInputTable, setTemporaryCloudStorageDirectory

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Detail

JsonTextBigQueryInputFormat

public JsonTextBigQueryInputFormat()

Method Detail

createDelegateRecordReader

public org.apache.hadoop.mapreduce.RecordReader<org.apache.hadoop.io.LongWritable,org.apache.hadoop.io.Text> createDelegateRecordReader(org.apache.hadoop.mapreduce.InputSplit split,
                                                                                                                                        org.apache.hadoop.conf.Configuration configuration)
                                                                                                                                 throws java.io.IOException,
                                                                                                                                        java.lang.InterruptedException

Description copied from interface: DelegateRecordReaderFactory

Create a new record reader for a single input split.

Throws:

java.io.IOException

java.lang.InterruptedException

getExportFileFormat

public ExportFileFormat getExportFileFormat()

Description copied from class: AbstractBigQueryInputFormat

Get the ExportFileFormat that this input format supports.

Specified by:

getExportFileFormat in class AbstractBigQueryInputFormat<org.apache.hadoop.io.LongWritable,org.apache.hadoop.io.Text>