Skip navigation links
A B C D E F G H I J M N O P R S T U V W 

A

abortJob(JobContext, JobStatus.State) - Method in class com.google.cloud.hadoop.io.bigquery.output.FederatedBigQueryOutputCommitter
Performs a cleanup of the output path in addition to delegating the call to the wrapped OutputCommitter.
abortJob(JobContext, JobStatus.State) - Method in class com.google.cloud.hadoop.io.bigquery.output.ForwardingBigQueryFileOutputCommitter
Calls the delegate's OutputCommitter#abortJob(JobContext, State).
abortJob(JobContext, JobStatus.State) - Method in class com.google.cloud.hadoop.io.bigquery.output.IndirectBigQueryOutputCommitter
Performs a cleanup of the output path in addition to delegating the call to the wrapped OutputCommitter.
abortTask(TaskAttemptContext) - Method in class com.google.cloud.hadoop.io.bigquery.output.ForwardingBigQueryFileOutputCommitter
Calls the delegate's OutputCommitter.abortTask(TaskAttemptContext).
AbstractBigQueryInputFormat<K,V> - Class in com.google.cloud.hadoop.io.bigquery
Abstract base class for BigQuery input formats.
AbstractBigQueryInputFormat() - Constructor for class com.google.cloud.hadoop.io.bigquery.AbstractBigQueryInputFormat
 
AbstractExportToCloudStorage - Class in com.google.cloud.hadoop.io.bigquery
An abstract base class for BigQuery exports to GCS for use by MapReduce job setup
AbstractExportToCloudStorage(Configuration, String, ExportFileFormat, BigQueryHelper, String, Table) - Constructor for class com.google.cloud.hadoop.io.bigquery.AbstractExportToCloudStorage
 
AvroBigQueryInputFormat - Class in com.google.cloud.hadoop.io.bigquery
InputFormat to generate and ingest Avro-based BigQuery exports.
AvroBigQueryInputFormat() - Constructor for class com.google.cloud.hadoop.io.bigquery.AvroBigQueryInputFormat
 
AvroRecordReader - Class in com.google.cloud.hadoop.io.bigquery
RecordReader for avro BigQuery exports.
AvroRecordReader() - Constructor for class com.google.cloud.hadoop.io.bigquery.AvroRecordReader
 

B

beginExport() - Method in class com.google.cloud.hadoop.io.bigquery.AbstractExportToCloudStorage
 
beginExport() - Method in interface com.google.cloud.hadoop.io.bigquery.Export
Start exporting data
beginExport() - Method in class com.google.cloud.hadoop.io.bigquery.NoopFederatedExportToCloudStorage
 
BIGQUERY_CONFIG_PREFIX - Static variable in class com.google.cloud.hadoop.io.bigquery.BigQueryConfiguration
 
BIGQUERY_JOB_ID_MAX_LENGTH - Static variable in class com.google.cloud.hadoop.io.bigquery.BigQueryHelper
 
BIGQUERY_JOB_ID_PATTERN - Static variable in class com.google.cloud.hadoop.io.bigquery.BigQueryHelper
 
BIGQUERY_OAUTH_SCOPES - Static variable in class com.google.cloud.hadoop.io.bigquery.BigQueryFactory
 
BIGQUERY_PRIVATE_KEY_FILE - Static variable in class com.google.cloud.hadoop.io.bigquery.BigQueryFactory
 
BIGQUERY_SERVICE_ACCOUNT - Static variable in class com.google.cloud.hadoop.io.bigquery.BigQueryFactory
 
BigQueryConfiguration - Class in com.google.cloud.hadoop.io.bigquery
A container for configuration property names for jobs with BigQuery input/output.
BigQueryConfiguration() - Constructor for class com.google.cloud.hadoop.io.bigquery.BigQueryConfiguration
 
BigQueryFactory - Class in com.google.cloud.hadoop.io.bigquery
Helper class to get BigQuery from environment credentials.
BigQueryFactory() - Constructor for class com.google.cloud.hadoop.io.bigquery.BigQueryFactory
 
BigQueryFileFormat - Enum in com.google.cloud.hadoop.io.bigquery
An enum to describe file formats supported by the BigQuery api.
bigQueryHelper - Variable in class com.google.cloud.hadoop.io.bigquery.AbstractExportToCloudStorage
 
BigQueryHelper - Class in com.google.cloud.hadoop.io.bigquery
Wrapper for BigQuery API.
BigQueryHelper(Bigquery) - Constructor for class com.google.cloud.hadoop.io.bigquery.BigQueryHelper
 
BigQueryOutputConfiguration - Class in com.google.cloud.hadoop.io.bigquery.output
A container for configuration keys related to BigQuery indirect output formats.
BigQueryOutputConfiguration() - Constructor for class com.google.cloud.hadoop.io.bigquery.output.BigQueryOutputConfiguration
 
BigQueryStrings - Class in com.google.cloud.hadoop.io.bigquery
BigQueryStrings provides misc static helper methods for printing and formatting strings related to BigQuery data structures and API objects.
BigQueryStrings() - Constructor for class com.google.cloud.hadoop.io.bigquery.BigQueryStrings
 
BigQueryTableFieldSchema - Class in com.google.cloud.hadoop.io.bigquery.output
Wrapper for BigQuery TableFieldSchema.
BigQueryTableFieldSchema() - Constructor for class com.google.cloud.hadoop.io.bigquery.output.BigQueryTableFieldSchema
 
BigQueryTableSchema - Class in com.google.cloud.hadoop.io.bigquery.output
Wrapper for BigQuery TableSchema.
BigQueryTableSchema() - Constructor for class com.google.cloud.hadoop.io.bigquery.output.BigQueryTableSchema
 
BigQueryTimePartitioning - Class in com.google.cloud.hadoop.io.bigquery.output
Wrapper for BigQuery TimePartitioning.
BigQueryTimePartitioning() - Constructor for class com.google.cloud.hadoop.io.bigquery.output.BigQueryTimePartitioning
 
BigQueryTimePartitioning(TimePartitioning) - Constructor for class com.google.cloud.hadoop.io.bigquery.output.BigQueryTimePartitioning
 
BigQueryUtils - Class in com.google.cloud.hadoop.io.bigquery
Helper methods to interact with BigQuery.
BigQueryUtils() - Constructor for class com.google.cloud.hadoop.io.bigquery.BigQueryUtils
 
BQ_ROOT_URL - Static variable in class com.google.cloud.hadoop.io.bigquery.BigQueryConfiguration
Configuration key for the BigQuery API endpoint root URL.
BQC_ID - Static variable in class com.google.cloud.hadoop.io.bigquery.BigQueryFactory
 

C

checkJobIdEquality(Job, Job) - Method in class com.google.cloud.hadoop.io.bigquery.BigQueryHelper
Helper to check for non-null Job.getJobReference().getJobId() and quality of the getJobId() between expected and actual, using Preconditions.checkState.
checkOutputSpecs(JobContext) - Method in class com.google.cloud.hadoop.io.bigquery.output.ForwardingBigQueryFileOutputFormat
Checks to make sure the configuration is valid, the output path doesn't already exist, and that a connection to BigQuery can be established.
cleanup(JobContext) - Method in class com.google.cloud.hadoop.io.bigquery.output.ForwardingBigQueryFileOutputCommitter
Attempts to manually delete data in the output path.
cleanupExport() - Method in class com.google.cloud.hadoop.io.bigquery.AbstractExportToCloudStorage
 
cleanupExport() - Method in interface com.google.cloud.hadoop.io.bigquery.Export
Delete any temp tables or temporary data locations.
cleanupExport() - Method in class com.google.cloud.hadoop.io.bigquery.NoopFederatedExportToCloudStorage
 
cleanupJob(Configuration, JobID) - Static method in class com.google.cloud.hadoop.io.bigquery.AbstractBigQueryInputFormat
Cleans up relevant temporary resources associated with a job which used the GsonBigQueryInputFormat; this should be called explicitly after the completion of the entire job.
cleanupJob(BigQueryHelper, Configuration) - Static method in class com.google.cloud.hadoop.io.bigquery.AbstractBigQueryInputFormat
Similar to AbstractBigQueryInputFormat.cleanupJob(Configuration, JobID), but allows specifying the Bigquery instance to use.
close() - Method in class com.google.cloud.hadoop.io.bigquery.AvroRecordReader
 
close() - Method in class com.google.cloud.hadoop.io.bigquery.DirectBigQueryRecordReader
 
close() - Method in class com.google.cloud.hadoop.io.bigquery.DynamicFileListRecordReader
Closes the record reader.
close() - Method in class com.google.cloud.hadoop.io.bigquery.GsonRecordReader
Closes the record reader.
com.google.cloud.hadoop.io.bigquery - package com.google.cloud.hadoop.io.bigquery
 
com.google.cloud.hadoop.io.bigquery.output - package com.google.cloud.hadoop.io.bigquery.output
 
com.google.cloud.hadoop.io.bigquery.samples - package com.google.cloud.hadoop.io.bigquery.samples
 
commitJob(JobContext) - Method in class com.google.cloud.hadoop.io.bigquery.output.FederatedBigQueryOutputCommitter
Runs a federated import job on BigQuery for the data in the output path in addition to calling the delegate's commitJob.
commitJob(JobContext) - Method in class com.google.cloud.hadoop.io.bigquery.output.ForwardingBigQueryFileOutputCommitter
Calls the delegate's OutputCommitter.commitJob(JobContext).
commitJob(JobContext) - Method in class com.google.cloud.hadoop.io.bigquery.output.IndirectBigQueryOutputCommitter
Runs an import job on BigQuery for the data in the output path in addition to calling the delegate's commitJob.
commitTask(TaskAttemptContext) - Method in class com.google.cloud.hadoop.io.bigquery.output.ForwardingBigQueryFileOutputCommitter
Calls the delegate's OutputCommitter.commitTask(TaskAttemptContext).
configuration - Variable in class com.google.cloud.hadoop.io.bigquery.AbstractExportToCloudStorage
 
configure(Configuration, String, String, String, BigQueryFileFormat, Class<? extends FileOutputFormat>) - Static method in class com.google.cloud.hadoop.io.bigquery.output.BigQueryOutputConfiguration
A helper function to set the required output keys in the given configuration.
configure(Configuration, String, BigQueryTableSchema, String, BigQueryFileFormat, Class<? extends FileOutputFormat>) - Static method in class com.google.cloud.hadoop.io.bigquery.output.BigQueryOutputConfiguration
A helper function to set the required output keys in the given configuration.
configureBigQueryInput(Configuration, String, String, String) - Static method in class com.google.cloud.hadoop.io.bigquery.BigQueryConfiguration
Sets the Bigquery access related fields in the JobConf for input connector.
configureBigQueryInput(Configuration, String) - Static method in class com.google.cloud.hadoop.io.bigquery.BigQueryConfiguration
Sets the Bigquery access related fields in the JobConf for input connector.
configureBigQueryOutput(Configuration, String, String, String, String) - Static method in class com.google.cloud.hadoop.io.bigquery.BigQueryConfiguration
Sets the Bigquery access related fields in the JobConf for output connector.
configureBigQueryOutput(Configuration, String, String) - Static method in class com.google.cloud.hadoop.io.bigquery.BigQueryConfiguration
Sets the Bigquery access related fields in the JobConf for output connector.
configureWithAutoSchema(Configuration, String, String, BigQueryFileFormat, Class<? extends FileOutputFormat>) - Static method in class com.google.cloud.hadoop.io.bigquery.output.BigQueryOutputConfiguration
A helper function to set the required output keys in the given configuration.
createBigQueryCredential(Configuration) - Method in class com.google.cloud.hadoop.io.bigquery.BigQueryFactory
Construct credentials from the passed Configuration.
createCommitter(TaskAttemptContext) - Method in class com.google.cloud.hadoop.io.bigquery.output.FederatedBigQueryOutputFormat
Wraps the delegate's committer in a FederatedBigQueryOutputCommitter.
createCommitter(TaskAttemptContext) - Method in class com.google.cloud.hadoop.io.bigquery.output.ForwardingBigQueryFileOutputFormat
Create a new OutputCommitter for this OutputFormat.
createCommitter(TaskAttemptContext) - Method in class com.google.cloud.hadoop.io.bigquery.output.IndirectBigQueryOutputFormat
Wraps the delegate's committer in a IndirectBigQueryOutputCommitter.
createDelegateRecordReader(InputSplit, Configuration) - Method in class com.google.cloud.hadoop.io.bigquery.AvroBigQueryInputFormat
 
createDelegateRecordReader(InputSplit, Configuration) - Method in interface com.google.cloud.hadoop.io.bigquery.DelegateRecordReaderFactory
Create a new record reader for a single input split.
createDelegateRecordReader(InputSplit, Configuration) - Method in class com.google.cloud.hadoop.io.bigquery.GsonBigQueryInputFormat
 
createDelegateRecordReader(InputSplit, Configuration) - Method in class com.google.cloud.hadoop.io.bigquery.JsonTextBigQueryInputFormat
 
createJobReference(String, String, String) - Method in class com.google.cloud.hadoop.io.bigquery.BigQueryHelper
Creates a new JobReference with a unique jobId generated from jobIdPrefix plus a randomly generated UUID String.
createRecordReader(InputSplit, TaskAttemptContext) - Method in class com.google.cloud.hadoop.io.bigquery.AbstractBigQueryInputFormat
 
createRecordReader(InputSplit, Configuration) - Method in class com.google.cloud.hadoop.io.bigquery.AbstractBigQueryInputFormat
 
createRecordReader(InputSplit, TaskAttemptContext) - Method in class com.google.cloud.hadoop.io.bigquery.DirectBigQueryInputFormat
 

D

DATA_LOCATION - Static variable in class com.google.cloud.hadoop.io.bigquery.BigQueryConfiguration
Configure the location of the temporary dataset.
DATASET_AND_TABLE_REGEX - Static variable in class com.google.cloud.hadoop.io.bigquery.BigQueryStrings
 
DelegateRecordReaderFactory<K,V> - Interface in com.google.cloud.hadoop.io.bigquery
Interface to produce delegate RecordReader instances.
DELETE_EXPORT_FILES_FROM_GCS - Static variable in class com.google.cloud.hadoop.io.bigquery.BigQueryConfiguration
Configuration key for whether to delete the intermediate GCS-export files.
DESTINATION_FORMAT_KEY - Static variable in class com.google.cloud.hadoop.io.bigquery.AbstractExportToCloudStorage
 
DirectBigQueryInputFormat - Class in com.google.cloud.hadoop.io.bigquery
InputFormat that directly reads data from BigQuery using the BigQuery Storage API.
DirectBigQueryInputFormat() - Constructor for class com.google.cloud.hadoop.io.bigquery.DirectBigQueryInputFormat
 
DirectBigQueryInputFormat.DirectBigQueryInputSplit - Class in com.google.cloud.hadoop.io.bigquery
InputSplit containing session metadata.
DirectBigQueryInputSplit() - Constructor for class com.google.cloud.hadoop.io.bigquery.DirectBigQueryInputFormat.DirectBigQueryInputSplit
 
DirectBigQueryInputSplit(String, String, long) - Constructor for class com.google.cloud.hadoop.io.bigquery.DirectBigQueryInputFormat.DirectBigQueryInputSplit
 
DirectBigQueryRecordReader - Class in com.google.cloud.hadoop.io.bigquery
RecordReader for DirectBigQueryInputFormat.
DirectBigQueryRecordReader() - Constructor for class com.google.cloud.hadoop.io.bigquery.DirectBigQueryRecordReader
 
DirectBigQueryWordCount - Class in com.google.cloud.hadoop.io.bigquery.samples
An example Hadoop WordCount program that counts the number of times a word appears in a BigQuery table column.
DirectBigQueryWordCount() - Constructor for class com.google.cloud.hadoop.io.bigquery.samples.DirectBigQueryWordCount
 
DirectBigQueryWordCount.Map - Class in com.google.cloud.hadoop.io.bigquery.samples
The mapper for our WordCount job.
DirectBigQueryWordCount.Reduce - Class in com.google.cloud.hadoop.io.bigquery.samples
The reducer for our WordCount job.
DYNAMIC_FILE_LIST_RECORD_READER_POLL_INTERVAL_MS - Static variable in class com.google.cloud.hadoop.io.bigquery.BigQueryConfiguration
Number of milliseconds to wait between listStatus calls inside of nextKeyValue when no new files are available yet for reading; not that this polling is not done when files are already available for reading.
DYNAMIC_FILE_LIST_RECORD_READER_POLL_MAX_ATTEMPTS - Static variable in class com.google.cloud.hadoop.io.bigquery.BigQueryConfiguration
 
DynamicFileListRecordReader<K,V> - Class in com.google.cloud.hadoop.io.bigquery
DynamicFileListRecordReader implements hadoop RecordReader by exposing a single logical record stream despite being made up of multiple files which are still newly appearing while this RecordReader is being used.
DynamicFileListRecordReader(DelegateRecordReaderFactory<K, V>) - Constructor for class com.google.cloud.hadoop.io.bigquery.DynamicFileListRecordReader
 

E

equals(Object) - Method in class com.google.cloud.hadoop.io.bigquery.DirectBigQueryInputFormat.DirectBigQueryInputSplit
 
equals(Object) - Method in class com.google.cloud.hadoop.io.bigquery.output.BigQueryTableFieldSchema
 
equals(Object) - Method in class com.google.cloud.hadoop.io.bigquery.output.BigQueryTableSchema
 
equals(Object) - Method in class com.google.cloud.hadoop.io.bigquery.output.BigQueryTimePartitioning
 
Export - Interface in com.google.cloud.hadoop.io.bigquery
A single BigQuery export for the purpose of running a Hadoop MapReduce.
exportBigQueryToGcs(String, TableReference, List<String>, boolean) - Method in class com.google.cloud.hadoop.io.bigquery.BigQueryHelper
Exports BigQuery results into GCS, polls for completion before returning.
ExportFileFormat - Enum in com.google.cloud.hadoop.io.bigquery
BigQuery export file formats
exportJobReference - Variable in class com.google.cloud.hadoop.io.bigquery.AbstractExportToCloudStorage
 
EXTERNAL_TABLE_TYPE - Static variable in class com.google.cloud.hadoop.io.bigquery.AbstractBigQueryInputFormat
The keyword for the type of BigQueryTable store externally.

F

FederatedBigQueryOutputCommitter - Class in com.google.cloud.hadoop.io.bigquery.output
This class acts as a wrapper which delegates calls to another OutputCommitter whose responsibility is to generate files in the defined output path.
FederatedBigQueryOutputCommitter(TaskAttemptContext, OutputCommitter) - Constructor for class com.google.cloud.hadoop.io.bigquery.output.FederatedBigQueryOutputCommitter
This class acts as a wrapper which delegates calls to another OutputCommitter whose responsibility is to generate files in the defined output path.
FederatedBigQueryOutputFormat<K,V> - Class in com.google.cloud.hadoop.io.bigquery.output
An output format to write to Google Cloud Storage and then load that into BigQuery.
FederatedBigQueryOutputFormat() - Constructor for class com.google.cloud.hadoop.io.bigquery.output.FederatedBigQueryOutputFormat
 
fileFormat - Variable in class com.google.cloud.hadoop.io.bigquery.AbstractExportToCloudStorage
 
ForwardingBigQueryFileOutputCommitter - Class in com.google.cloud.hadoop.io.bigquery.output
This class acts as a wrapper which delegates calls to another OutputCommitter whose responsibility is to generate files in the defined output path.
ForwardingBigQueryFileOutputCommitter(TaskAttemptContext, OutputCommitter) - Constructor for class com.google.cloud.hadoop.io.bigquery.output.ForwardingBigQueryFileOutputCommitter
This acts as a wrapper which delegates calls to another OutputCommitter whose responsibility is to generate files in the defined output path.
ForwardingBigQueryFileOutputFormat<K,V> - Class in com.google.cloud.hadoop.io.bigquery.output
An OutputFormat to interact with Google Cloud Storage and BigQuery.
ForwardingBigQueryFileOutputFormat() - Constructor for class com.google.cloud.hadoop.io.bigquery.output.ForwardingBigQueryFileOutputFormat
 
fromName(String) - Static method in enum com.google.cloud.hadoop.io.bigquery.BigQueryFileFormat
Deserializes the name of a BigQueryFileFormat.

G

GCS_BUCKET - Static variable in class com.google.cloud.hadoop.io.bigquery.BigQueryConfiguration
Configuration key for the GCS bucket holding TEMP_GCS_PATH
gcsPath - Variable in class com.google.cloud.hadoop.io.bigquery.AbstractExportToCloudStorage
 
gcsPaths - Variable in class com.google.cloud.hadoop.io.bigquery.NoopFederatedExportToCloudStorage
 
getAsJson() - Method in class com.google.cloud.hadoop.io.bigquery.output.BigQueryTimePartitioning
 
getBigQuery(Configuration) - Method in class com.google.cloud.hadoop.io.bigquery.AbstractBigQueryInputFormat
Helper method to override for testing.
getBigQuery(Configuration) - Method in class com.google.cloud.hadoop.io.bigquery.BigQueryFactory
Constructs a BigQuery from the credential constructed from the environment.
getBigQueryFromCredential(Configuration, Credential, String) - Method in class com.google.cloud.hadoop.io.bigquery.BigQueryFactory
Constructs a BigQuery from a given Credential.
getBigQueryHelper(Configuration) - Method in class com.google.cloud.hadoop.io.bigquery.AbstractBigQueryInputFormat
Helper method to override for testing.
getBigQueryHelper(Configuration) - Method in class com.google.cloud.hadoop.io.bigquery.BigQueryFactory
Constructs a BigQueryHelper from a raw Bigquery constructed with BigQueryFactory.getBigQuery(org.apache.hadoop.conf.Configuration).
getBigQueryHelper(Configuration) - Method in class com.google.cloud.hadoop.io.bigquery.DirectBigQueryInputFormat
Helper method to override for testing.
getBigQueryHelper() - Method in class com.google.cloud.hadoop.io.bigquery.output.ForwardingBigQueryFileOutputCommitter
Gets the helper used to interact with BigQuery.
getCleanupTemporaryDataFlag(Configuration) - Static method in class com.google.cloud.hadoop.io.bigquery.output.BigQueryOutputConfiguration
Gets if the configuration flag to cleanup temporary data in GCS is enabled or not.
getClient(Configuration) - Method in class com.google.cloud.hadoop.io.bigquery.DirectBigQueryInputFormat
Helper method to override for testing.
getClient(Configuration) - Method in class com.google.cloud.hadoop.io.bigquery.DirectBigQueryRecordReader
Helper method to override for testing.
getCreateDisposition(Configuration) - Static method in class com.google.cloud.hadoop.io.bigquery.output.BigQueryOutputConfiguration
Gets the create disposition of the output table.
getCurrentKey() - Method in class com.google.cloud.hadoop.io.bigquery.AvroRecordReader
 
getCurrentKey() - Method in class com.google.cloud.hadoop.io.bigquery.DirectBigQueryRecordReader
 
getCurrentKey() - Method in class com.google.cloud.hadoop.io.bigquery.DynamicFileListRecordReader
Gets the current key as reported by the delegate record reader.
getCurrentKey() - Method in class com.google.cloud.hadoop.io.bigquery.GsonRecordReader
Gets the current key.
getCurrentValue() - Method in class com.google.cloud.hadoop.io.bigquery.AvroRecordReader
 
getCurrentValue() - Method in class com.google.cloud.hadoop.io.bigquery.DirectBigQueryRecordReader
 
getCurrentValue() - Method in class com.google.cloud.hadoop.io.bigquery.DynamicFileListRecordReader
Gets the current value.
getCurrentValue() - Method in class com.google.cloud.hadoop.io.bigquery.GsonRecordReader
Gets the current value.
getDelegate() - Method in class com.google.cloud.hadoop.io.bigquery.output.ForwardingBigQueryFileOutputCommitter
Gets the delegate OutputCommitter being wrapped.
getDelegate(Configuration) - Method in class com.google.cloud.hadoop.io.bigquery.output.ForwardingBigQueryFileOutputFormat
Gets a reference to the underlying delegate used by this OutputFormat.
getExpirationMs() - Method in class com.google.cloud.hadoop.io.bigquery.output.BigQueryTimePartitioning
 
getExportFileFormat() - Method in class com.google.cloud.hadoop.io.bigquery.AbstractBigQueryInputFormat
Get the ExportFileFormat that this input format supports.
getExportFileFormat(Configuration) - Static method in class com.google.cloud.hadoop.io.bigquery.AbstractBigQueryInputFormat
 
getExportFileFormat(Class<? extends AbstractBigQueryInputFormat<?, ?>>) - Static method in class com.google.cloud.hadoop.io.bigquery.AbstractBigQueryInputFormat
 
getExportFileFormat() - Method in class com.google.cloud.hadoop.io.bigquery.AvroBigQueryInputFormat
 
getExportFileFormat() - Method in class com.google.cloud.hadoop.io.bigquery.GsonBigQueryInputFormat
 
getExportFileFormat() - Method in class com.google.cloud.hadoop.io.bigquery.JsonTextBigQueryInputFormat
 
getExportPaths() - Method in interface com.google.cloud.hadoop.io.bigquery.Export
Get a list of export paths to provide to BigQuery
getExportPaths() - Method in class com.google.cloud.hadoop.io.bigquery.NoopFederatedExportToCloudStorage
 
getExportPaths() - Method in class com.google.cloud.hadoop.io.bigquery.UnshardedExportToCloudStorage
 
getExtension() - Method in enum com.google.cloud.hadoop.io.bigquery.BigQueryFileFormat
Get the default extension to denote the file format.
getField() - Method in class com.google.cloud.hadoop.io.bigquery.output.BigQueryTimePartitioning
 
getFields() - Method in class com.google.cloud.hadoop.io.bigquery.output.BigQueryTableFieldSchema
Gets the nested schema fields if the type property is set to RECORD.
getFileFormat(Configuration) - Static method in class com.google.cloud.hadoop.io.bigquery.output.BigQueryOutputConfiguration
Gets the stored output BigQueryFileFormat in the configuration.
getFileOutputFormat(Configuration) - Static method in class com.google.cloud.hadoop.io.bigquery.output.BigQueryOutputConfiguration
Gets a configured instance of the stored FileOutputFormat in the configuration.
getFilePattern() - Method in enum com.google.cloud.hadoop.io.bigquery.ExportFileFormat
Get the file pattern to use when exporting
getFormatIdentifier() - Method in enum com.google.cloud.hadoop.io.bigquery.BigQueryFileFormat
Get the identifier to specify in API requests.
getFormatIdentifier() - Method in enum com.google.cloud.hadoop.io.bigquery.ExportFileFormat
Get the identifier to specify in API requests
getGcsOutputPath(Configuration) - Static method in class com.google.cloud.hadoop.io.bigquery.output.BigQueryOutputConfiguration
Gets the stored GCS output path in the configuration.
getJobProjectId(Configuration) - Static method in class com.google.cloud.hadoop.io.bigquery.output.BigQueryOutputConfiguration
Gets the project id to be used to run BQ load job based on the given configuration.
getKmsKeyName(Configuration) - Static method in class com.google.cloud.hadoop.io.bigquery.output.BigQueryOutputConfiguration
Gets the output table KMS key name based on the given configuration.
getLength() - Method in class com.google.cloud.hadoop.io.bigquery.DirectBigQueryInputFormat.DirectBigQueryInputSplit
 
getLength() - Method in class com.google.cloud.hadoop.io.bigquery.ShardedInputSplit
Estimated number of records to read, *not* the number of bytes.
getLimit() - Method in class com.google.cloud.hadoop.io.bigquery.DirectBigQueryInputFormat.DirectBigQueryInputSplit
 
getLocations() - Method in class com.google.cloud.hadoop.io.bigquery.DirectBigQueryInputFormat.DirectBigQueryInputSplit
 
getLocations() - Method in class com.google.cloud.hadoop.io.bigquery.ShardedInputSplit
 
getMode() - Method in class com.google.cloud.hadoop.io.bigquery.output.BigQueryTableFieldSchema
 
getName() - Method in class com.google.cloud.hadoop.io.bigquery.DirectBigQueryInputFormat.DirectBigQueryInputSplit
 
getName() - Method in class com.google.cloud.hadoop.io.bigquery.output.BigQueryTableFieldSchema
 
getOutputCommitter(TaskAttemptContext) - Method in class com.google.cloud.hadoop.io.bigquery.output.ForwardingBigQueryFileOutputFormat
Gets the cached OutputCommitter, creating a new one if it doesn't exist.
getOutputFileURIs() - Method in class com.google.cloud.hadoop.io.bigquery.output.ForwardingBigQueryFileOutputCommitter
Queries the file system for the URIs of all files in the base output directory that are not directories and whose name isn't FileOutputCommitter.SUCCEEDED_FILE_NAME.
getProgress() - Method in class com.google.cloud.hadoop.io.bigquery.AvroRecordReader
 
getProgress() - Method in class com.google.cloud.hadoop.io.bigquery.DirectBigQueryRecordReader
 
getProgress() - Method in class com.google.cloud.hadoop.io.bigquery.DynamicFileListRecordReader
Returns the current progress based on the number of records read compared to the *estimated* total number of records planned to be read; this number may be inexact, but will not report a number greater than 1.
getProgress() - Method in class com.google.cloud.hadoop.io.bigquery.GsonRecordReader
Returns the current progress of the record reader through its data.
getProjectId(Configuration) - Static method in class com.google.cloud.hadoop.io.bigquery.output.BigQueryOutputConfiguration
Gets the output dataset project id based on the given configuration.
getRawBigquery() - Method in class com.google.cloud.hadoop.io.bigquery.BigQueryHelper
Returns the underlying Bigquery instance used for communicating with the BigQuery API.
getRecordWriter(TaskAttemptContext) - Method in class com.google.cloud.hadoop.io.bigquery.output.ForwardingBigQueryFileOutputFormat
Gets the RecordWriter from the wrapped FileOutputFormat.
getRequirePartitionFilter() - Method in class com.google.cloud.hadoop.io.bigquery.output.BigQueryTimePartitioning
 
getSchema() - Method in class com.google.cloud.hadoop.io.bigquery.DirectBigQueryInputFormat.DirectBigQueryInputSplit
 
getSchemaFromString(String) - Static method in class com.google.cloud.hadoop.io.bigquery.BigQueryUtils
Parses the given JSON string and returns the extracted schema.
getShardDirectoryAndPattern() - Method in class com.google.cloud.hadoop.io.bigquery.ShardedInputSplit
Accessor for shardDirectoryAndPattern.
getSplits(JobContext) - Method in class com.google.cloud.hadoop.io.bigquery.AbstractBigQueryInputFormat
 
getSplits(JobContext) - Method in class com.google.cloud.hadoop.io.bigquery.DirectBigQueryInputFormat
 
getSplits(JobContext) - Method in interface com.google.cloud.hadoop.io.bigquery.Export
Get input splits that should be passed to Hadoop.
getSplits(JobContext) - Method in class com.google.cloud.hadoop.io.bigquery.UnshardedExportToCloudStorage
 
getTable(TableReference) - Method in class com.google.cloud.hadoop.io.bigquery.BigQueryHelper
Gets the specified table resource by table ID.
getTemporaryPathRoot(Configuration, JobID) - Static method in class com.google.cloud.hadoop.io.bigquery.BigQueryConfiguration
Resolves to provided BigQueryConfiguration.TEMP_GCS_PATH or fallbacks to a temporary path based on BigQueryConfiguration.GCS_BUCKET and jobId.
getType() - Method in class com.google.cloud.hadoop.io.bigquery.output.BigQueryTableFieldSchema
 
getType() - Method in class com.google.cloud.hadoop.io.bigquery.output.BigQueryTimePartitioning
 
getWriteDisposition(Configuration) - Static method in class com.google.cloud.hadoop.io.bigquery.output.BigQueryOutputConfiguration
Gets the write disposition of the output table.
GsonBigQueryInputFormat - Class in com.google.cloud.hadoop.io.bigquery
GsonBigQueryInputFormat provides access to BigQuery tables via exports to GCS in the form of gson JsonObjects as mapper values.
GsonBigQueryInputFormat() - Constructor for class com.google.cloud.hadoop.io.bigquery.GsonBigQueryInputFormat
 
GsonRecordReader - Class in com.google.cloud.hadoop.io.bigquery
The GsonRecordReader reads records from GCS through GHFS.
GsonRecordReader() - Constructor for class com.google.cloud.hadoop.io.bigquery.GsonRecordReader
 

H

HadoopConfigurationProperty<T> - Class in com.google.cloud.hadoop.io.bigquery
Hadoop configuration property for BigQuery Connector
HadoopConfigurationProperty(String) - Constructor for class com.google.cloud.hadoop.io.bigquery.HadoopConfigurationProperty
 
HadoopConfigurationProperty(String, T, String...) - Constructor for class com.google.cloud.hadoop.io.bigquery.HadoopConfigurationProperty
 
hashCode() - Method in class com.google.cloud.hadoop.io.bigquery.DirectBigQueryInputFormat.DirectBigQueryInputSplit
 
hashCode() - Method in class com.google.cloud.hadoop.io.bigquery.output.BigQueryTableFieldSchema
 
hashCode() - Method in class com.google.cloud.hadoop.io.bigquery.output.BigQueryTableSchema
 
hashCode() - Method in class com.google.cloud.hadoop.io.bigquery.output.BigQueryTimePartitioning
 

I

importFederatedFromGcs(String, TableReference, TableSchema, BigQueryFileFormat, List<String>) - Method in class com.google.cloud.hadoop.io.bigquery.BigQueryHelper
Performs a federated import on data from GCS into BigQuery via a table insert.
importFromGcs(String, TableReference, TableSchema, TimePartitioning, String, BigQueryFileFormat, String, String, List<String>, boolean) - Method in class com.google.cloud.hadoop.io.bigquery.BigQueryHelper
Imports data from GCS into BigQuery via a load job.
IndirectBigQueryOutputCommitter - Class in com.google.cloud.hadoop.io.bigquery.output
This class acts as a wrapper which delegates calls to another OutputCommitter whose responsibility is to generate files in the defined output path.
IndirectBigQueryOutputCommitter(TaskAttemptContext, OutputCommitter) - Constructor for class com.google.cloud.hadoop.io.bigquery.output.IndirectBigQueryOutputCommitter
This class acts as a wrapper which delegates calls to another OutputCommitter whose responsibility is to generate files in the defined output path.
IndirectBigQueryOutputFormat<K,V> - Class in com.google.cloud.hadoop.io.bigquery.output
An output format to write to Google Cloud Storage and then load that into BigQuery.
IndirectBigQueryOutputFormat() - Constructor for class com.google.cloud.hadoop.io.bigquery.output.IndirectBigQueryOutputFormat
 
initialize(InputSplit, TaskAttemptContext) - Method in class com.google.cloud.hadoop.io.bigquery.AvroRecordReader
 
initialize(InputSplit, TaskAttemptContext) - Method in class com.google.cloud.hadoop.io.bigquery.DirectBigQueryRecordReader
 
initialize(InputSplit, TaskAttemptContext) - Method in class com.google.cloud.hadoop.io.bigquery.DynamicFileListRecordReader
 
initialize(InputSplit, TaskAttemptContext) - Method in class com.google.cloud.hadoop.io.bigquery.GsonRecordReader
Called once at initialization to initialize the RecordReader.
initializeInternal(InputSplit, Configuration) - Method in class com.google.cloud.hadoop.io.bigquery.AvroRecordReader
 
INPUT_DATASET_ID - Static variable in class com.google.cloud.hadoop.io.bigquery.BigQueryConfiguration
Configuration key for ID of the dataset accessed by this input connector.
INPUT_FORMAT_CLASS - Static variable in class com.google.cloud.hadoop.io.bigquery.AbstractBigQueryInputFormat
Configuration key for InputFormat class name.
INPUT_PROJECT_ID - Static variable in class com.google.cloud.hadoop.io.bigquery.BigQueryConfiguration
Configuration key for project ID of the dataset accessed by this input connector.
INPUT_TABLE_ID - Static variable in class com.google.cloud.hadoop.io.bigquery.BigQueryConfiguration
Configuration key for ID of the table written by this input connector.
insertJobOrFetchDuplicate(String, Job) - Method in class com.google.cloud.hadoop.io.bigquery.BigQueryHelper
Tries to run jobs().insert(...) with the provided projectId and job, which returns a Job under normal operation, which is then returned from this method.
INSTANCE - Static variable in class com.google.cloud.hadoop.io.bigquery.BigQueryFactory
Static instance of the BigQueryFactory.

J

JsonTextBigQueryInputFormat - Class in com.google.cloud.hadoop.io.bigquery
An input format that provides BigQuery JSON as lines of text as they are written to the export by BigQuery.
JsonTextBigQueryInputFormat() - Constructor for class com.google.cloud.hadoop.io.bigquery.JsonTextBigQueryInputFormat
 

M

main(String[]) - Static method in class com.google.cloud.hadoop.io.bigquery.samples.DirectBigQueryWordCount
 
main(String[]) - Static method in class com.google.cloud.hadoop.io.bigquery.samples.WordCount
Configures and runs the main Hadoop job.
MANDATORY_CONFIG_PROPERTIES_INPUT - Static variable in class com.google.cloud.hadoop.io.bigquery.BigQueryConfiguration
A list of all necessary Configuration keys for input connector.
Map() - Constructor for class com.google.cloud.hadoop.io.bigquery.samples.DirectBigQueryWordCount.Map
 
map(NullWritable, GenericRecord, Mapper<NullWritable, GenericRecord, Text, LongWritable>.Context) - Method in class com.google.cloud.hadoop.io.bigquery.samples.DirectBigQueryWordCount.Map
 
Map() - Constructor for class com.google.cloud.hadoop.io.bigquery.samples.WordCount.Map
 
map(LongWritable, JsonObject, Mapper<LongWritable, JsonObject, Text, LongWritable>.Context) - Method in class com.google.cloud.hadoop.io.bigquery.samples.WordCount.Map
 

N

needsTaskCommit(TaskAttemptContext) - Method in class com.google.cloud.hadoop.io.bigquery.output.ForwardingBigQueryFileOutputCommitter
Calls the delegate's OutputCommitter.needsTaskCommit(TaskAttemptContext).
nextKeyValue() - Method in class com.google.cloud.hadoop.io.bigquery.AvroRecordReader
 
nextKeyValue() - Method in class com.google.cloud.hadoop.io.bigquery.DirectBigQueryRecordReader
 
nextKeyValue() - Method in class com.google.cloud.hadoop.io.bigquery.DynamicFileListRecordReader
Reads the next key, value pair.
nextKeyValue() - Method in class com.google.cloud.hadoop.io.bigquery.GsonRecordReader
Reads the next key, value pair.
NoopFederatedExportToCloudStorage - Class in com.google.cloud.hadoop.io.bigquery
This class represents the logical "export" of BigQuery federated data source stored in Google Cloud Storage.
NoopFederatedExportToCloudStorage(Configuration, ExportFileFormat, BigQueryHelper, String, Table, InputFormat<LongWritable, Text>) - Constructor for class com.google.cloud.hadoop.io.bigquery.NoopFederatedExportToCloudStorage
 

O

OUTPUT_CLEANUP_TEMP - Static variable in class com.google.cloud.hadoop.io.bigquery.BigQueryConfiguration
Configuration key indicating whether temporary data stored in GCS should be deleted after the output job is complete.
OUTPUT_DATASET_ID - Static variable in class com.google.cloud.hadoop.io.bigquery.BigQueryConfiguration
Configuration key for numeric ID of the output dataset accessed by the output format.
OUTPUT_FILE_FORMAT - Static variable in class com.google.cloud.hadoop.io.bigquery.BigQueryConfiguration
Configuration key for the file format of the files outputted by the wrapped FileOutputFormat.
OUTPUT_FORMAT_CLASS - Static variable in class com.google.cloud.hadoop.io.bigquery.BigQueryConfiguration
Configuration key for the FileOutputFormat class that's going to be wrapped by the output format.
OUTPUT_PROJECT_ID - Static variable in class com.google.cloud.hadoop.io.bigquery.BigQueryConfiguration
Configuration key for the output project ID of the dataset accessed by the output format.
OUTPUT_TABLE_CREATE_DISPOSITION - Static variable in class com.google.cloud.hadoop.io.bigquery.BigQueryConfiguration
Configuration key for the create disposition of the output table.
OUTPUT_TABLE_ID - Static variable in class com.google.cloud.hadoop.io.bigquery.BigQueryConfiguration
Configuration key for numeric ID of the output table written by the output format.
OUTPUT_TABLE_KMS_KEY_NAME - Static variable in class com.google.cloud.hadoop.io.bigquery.BigQueryConfiguration
Configuration key for the Cloud KMS encryption key that will be used to protect output BigQuery table.
OUTPUT_TABLE_PARTITIONING - Static variable in class com.google.cloud.hadoop.io.bigquery.BigQueryConfiguration
Configuration key for the output table partitioning used by the output format.
OUTPUT_TABLE_SCHEMA - Static variable in class com.google.cloud.hadoop.io.bigquery.BigQueryConfiguration
Configuration key for the output table schema used by the output format.
OUTPUT_TABLE_WRITE_DISPOSITION - Static variable in class com.google.cloud.hadoop.io.bigquery.BigQueryConfiguration
Configuration key for the write disposition of the output table.
OUTPUT_WRITE_BUFFER_SIZE - Static variable in class com.google.cloud.hadoop.io.bigquery.BigQueryConfiguration
Size of the output buffer, in bytes, to use for BigQuery output.

P

parseTableReference(String) - Static method in class com.google.cloud.hadoop.io.bigquery.BigQueryStrings
Parses a string into a TableReference; projectId may be omitted if the caller defines a "default" project; in such a case, getProjectId() of the returned TableReference will return null.
POLL_WAIT_INITIAL_MILLIS - Static variable in class com.google.cloud.hadoop.io.bigquery.BigQueryUtils
 
POLL_WAIT_INTERVAL_MAX_MILLIS - Static variable in class com.google.cloud.hadoop.io.bigquery.BigQueryUtils
 
POLL_WAIT_MAX_ELAPSED_MILLIS - Static variable in class com.google.cloud.hadoop.io.bigquery.BigQueryUtils
 
prepare() - Method in class com.google.cloud.hadoop.io.bigquery.AbstractExportToCloudStorage
 
prepare() - Method in interface com.google.cloud.hadoop.io.bigquery.Export
Create any temporary directories, tables, etc
prepare() - Method in class com.google.cloud.hadoop.io.bigquery.NoopFederatedExportToCloudStorage
 
PROJECT_ID - Static variable in class com.google.cloud.hadoop.io.bigquery.BigQueryConfiguration
Configuration key for project ID on whose behalf to perform BigQuery operations, and the default project for referencing datasets when input/output datasets are not explicitly specified.
projectId - Variable in class com.google.cloud.hadoop.io.bigquery.AbstractExportToCloudStorage
 
PROPERTIES_FILE - Static variable in class com.google.cloud.hadoop.io.bigquery.BigQueryFactory
 

R

readFields(DataInput) - Method in class com.google.cloud.hadoop.io.bigquery.DirectBigQueryInputFormat.DirectBigQueryInputSplit
 
readFields(DataInput) - Method in class com.google.cloud.hadoop.io.bigquery.ShardedInputSplit
 
Reduce() - Constructor for class com.google.cloud.hadoop.io.bigquery.samples.DirectBigQueryWordCount.Reduce
 
reduce(Text, Iterable<LongWritable>, Reducer<Text, LongWritable, Text, LongWritable>.Context) - Method in class com.google.cloud.hadoop.io.bigquery.samples.DirectBigQueryWordCount.Reduce
 
Reduce() - Constructor for class com.google.cloud.hadoop.io.bigquery.samples.WordCount.Reduce
 
reduce(Text, Iterable<LongWritable>, Reducer<Text, LongWritable, JsonObject, NullWritable>.Context) - Method in class com.google.cloud.hadoop.io.bigquery.samples.WordCount.Reduce
 
REQUIRED_PROPERTIES - Static variable in class com.google.cloud.hadoop.io.bigquery.output.BigQueryOutputConfiguration
A list of keys that are required for this output connector.

S

SELECTED_FIELDS - Static variable in class com.google.cloud.hadoop.io.bigquery.BigQueryConfiguration
 
setExpirationMs(long) - Method in class com.google.cloud.hadoop.io.bigquery.output.BigQueryTimePartitioning
 
setField(String) - Method in class com.google.cloud.hadoop.io.bigquery.output.BigQueryTimePartitioning
 
setFields(List<BigQueryTableFieldSchema>) - Method in class com.google.cloud.hadoop.io.bigquery.output.BigQueryTableFieldSchema
Sets the nested schema fields if the type property is set to RECORD.
setFields(List<BigQueryTableFieldSchema>) - Method in class com.google.cloud.hadoop.io.bigquery.output.BigQueryTableSchema
 
setInputTable(Configuration, String, String, String) - Static method in class com.google.cloud.hadoop.io.bigquery.AbstractBigQueryInputFormat
Configure the BigQuery input table for a job
setInputTable(Configuration, TableReference) - Static method in class com.google.cloud.hadoop.io.bigquery.AbstractBigQueryInputFormat
Configure the BigQuery input table for a job
setKmsKeyName(Configuration, String) - Static method in class com.google.cloud.hadoop.io.bigquery.output.BigQueryOutputConfiguration
 
setMode(String) - Method in class com.google.cloud.hadoop.io.bigquery.output.BigQueryTableFieldSchema
 
setName(String) - Method in class com.google.cloud.hadoop.io.bigquery.output.BigQueryTableFieldSchema
 
setRequirePartitionFilter(Boolean) - Method in class com.google.cloud.hadoop.io.bigquery.output.BigQueryTimePartitioning
 
setTemporaryCloudStorageDirectory(Configuration, String) - Static method in class com.google.cloud.hadoop.io.bigquery.AbstractBigQueryInputFormat
Configure a directory to which we will export BigQuery data
setType(String) - Method in class com.google.cloud.hadoop.io.bigquery.output.BigQueryTableFieldSchema
 
setType(String) - Method in class com.google.cloud.hadoop.io.bigquery.output.BigQueryTimePartitioning
 
setup(Mapper<NullWritable, GenericRecord, Text, LongWritable>.Context) - Method in class com.google.cloud.hadoop.io.bigquery.samples.DirectBigQueryWordCount.Map
 
setup(Mapper<LongWritable, JsonObject, Text, LongWritable>.Context) - Method in class com.google.cloud.hadoop.io.bigquery.samples.WordCount.Map
 
setupJob(JobContext) - Method in class com.google.cloud.hadoop.io.bigquery.output.ForwardingBigQueryFileOutputCommitter
Calls the delegate's OutputCommitter.setupJob(JobContext).
setupTask(TaskAttemptContext) - Method in class com.google.cloud.hadoop.io.bigquery.output.ForwardingBigQueryFileOutputCommitter
Calls the delegate's OutputCommitter.setupTask(TaskAttemptContext).
ShardedInputSplit - Class in com.google.cloud.hadoop.io.bigquery
ShardedInputSplit implements Hadoop InputSplit by storing path information for a logical "shard" corresponding to a single Hadoop task.
ShardedInputSplit() - Constructor for class com.google.cloud.hadoop.io.bigquery.ShardedInputSplit
Default constructor for dynamic-classloading deserialization.
ShardedInputSplit(Path, long) - Constructor for class com.google.cloud.hadoop.io.bigquery.ShardedInputSplit
For creation of splits in JobClient.
SKEW_LIMIT - Static variable in class com.google.cloud.hadoop.io.bigquery.BigQueryConfiguration
 
SQL_FILTER - Static variable in class com.google.cloud.hadoop.io.bigquery.BigQueryConfiguration
 

T

tableExists(TableReference) - Method in class com.google.cloud.hadoop.io.bigquery.BigQueryHelper
Returns true if the table exists, or false if not.
tableToExport - Variable in class com.google.cloud.hadoop.io.bigquery.AbstractExportToCloudStorage
 
TEMP_GCS_PATH - Static variable in class com.google.cloud.hadoop.io.bigquery.BigQueryConfiguration
Configuration key for the GCS temp path this connector uses.
toString(TableReference) - Static method in class com.google.cloud.hadoop.io.bigquery.BigQueryStrings
Returns a String representation of the TableReference suitable for interop with other bigquery tools and for passing back into BigQueryStrings.parseTableReference(String).
toString() - Method in class com.google.cloud.hadoop.io.bigquery.DirectBigQueryInputFormat.DirectBigQueryInputSplit
 
toString() - Method in class com.google.cloud.hadoop.io.bigquery.ShardedInputSplit
 

U

UNKNOWN_VERSION - Static variable in class com.google.cloud.hadoop.io.bigquery.BigQueryFactory
 
UnshardedExportToCloudStorage - Class in com.google.cloud.hadoop.io.bigquery
An Export to GCS that provides a single directory for BigQuery to export to and requires all content to be written (the export complete) before we begin execution of the MapReduce.
UnshardedExportToCloudStorage(Configuration, String, ExportFileFormat, BigQueryHelper, String, Table, InputFormat<LongWritable, Text>) - Constructor for class com.google.cloud.hadoop.io.bigquery.UnshardedExportToCloudStorage
 
UnshardedInputSplit - Class in com.google.cloud.hadoop.io.bigquery
A class to tag BigQuery input splits
UnshardedInputSplit() - Constructor for class com.google.cloud.hadoop.io.bigquery.UnshardedInputSplit
 
UnshardedInputSplit(Path, long, long, String[]) - Constructor for class com.google.cloud.hadoop.io.bigquery.UnshardedInputSplit
 

V

validateConfiguration(Configuration) - Static method in class com.google.cloud.hadoop.io.bigquery.output.BigQueryOutputConfiguration
Helper function that validates the output configuration.
valueOf(String) - Static method in enum com.google.cloud.hadoop.io.bigquery.BigQueryFileFormat
Returns the enum constant of this type with the specified name.
valueOf(String) - Static method in enum com.google.cloud.hadoop.io.bigquery.ExportFileFormat
Returns the enum constant of this type with the specified name.
values() - Static method in enum com.google.cloud.hadoop.io.bigquery.BigQueryFileFormat
Returns an array containing the constants of this enum type, in the order they are declared.
values() - Static method in enum com.google.cloud.hadoop.io.bigquery.ExportFileFormat
Returns an array containing the constants of this enum type, in the order they are declared.
VERSION - Static variable in class com.google.cloud.hadoop.io.bigquery.BigQueryFactory
 
VERSION_PROPERTY - Static variable in class com.google.cloud.hadoop.io.bigquery.BigQueryFactory
 

W

waitForJobCompletion(Bigquery, String, JobReference, Progressable) - Static method in class com.google.cloud.hadoop.io.bigquery.BigQueryUtils
Polls job until it is completed.
waitForUsableMapReduceInput() - Method in interface com.google.cloud.hadoop.io.bigquery.Export
Wait for enough data to be available for us to start a MapReduce.
waitForUsableMapReduceInput() - Method in class com.google.cloud.hadoop.io.bigquery.NoopFederatedExportToCloudStorage
 
waitForUsableMapReduceInput() - Method in class com.google.cloud.hadoop.io.bigquery.UnshardedExportToCloudStorage
 
WordCount - Class in com.google.cloud.hadoop.io.bigquery.samples
An example Hadoop WordCount program that counts the number of times a word appears in a BigQuery table column.
WordCount() - Constructor for class com.google.cloud.hadoop.io.bigquery.samples.WordCount
 
WordCount.Map - Class in com.google.cloud.hadoop.io.bigquery.samples
Mapper function for the WordCount job.
WordCount.Reduce - Class in com.google.cloud.hadoop.io.bigquery.samples
Reducer function for the WordCount job.
WORDCOUNT_WORD_FIELDNAME - Static variable in class com.google.cloud.hadoop.io.bigquery.samples.WordCount
The configuration key used to specify the BigQuery field name ("column name").
write(DataOutput) - Method in class com.google.cloud.hadoop.io.bigquery.DirectBigQueryInputFormat.DirectBigQueryInputSplit
 
write(DataOutput) - Method in class com.google.cloud.hadoop.io.bigquery.ShardedInputSplit
 
A B C D E F G H I J M N O P R S T U V W 
Skip navigation links

Copyright © 2020. All rights reserved.