Skip navigation links
A B C D E F G H I J L M N O P Q R S T U V W 

A

AbstractGoogleAsyncWriteChannel<T extends com.google.api.client.googleapis.services.AbstractGoogleClientRequest<S>,S> - Class in com.google.cloud.hadoop.util
 
AbstractGoogleAsyncWriteChannel(ClientRequestHelper<S>, ExecutorService, AsyncWriteChannelOptions) - Constructor for class com.google.cloud.hadoop.util.AbstractGoogleAsyncWriteChannel
Construct a new channel using the given ExecutorService to run background uploads.
ACCESS_NOT_CONFIGURED_REASON - Static variable in class com.google.cloud.hadoop.util.ApiErrorExtractor
 
AccessBoundary - Class in com.google.cloud.hadoop.util
An access boundary used to generate a downscoped access token.
AccessBoundary() - Constructor for class com.google.cloud.hadoop.util.AccessBoundary
 
AccessBoundary.Action - Enum in com.google.cloud.hadoop.util
 
accessDenied(IOException) - Method in class com.google.cloud.hadoop.util.ApiErrorExtractor
Determines if the given exception indicates 'access denied'.
accessDeniedNonRecoverable(IOException) - Method in class com.google.cloud.hadoop.util.ApiErrorExtractor
Determines if the exception is a non-recoverable access denied code (such as account closed or marked for deletion).
ACCOUNT_DISABLED_REASON - Static variable in class com.google.cloud.hadoop.util.ApiErrorExtractor
 
action() - Method in class com.google.cloud.hadoop.util.AccessBoundary
 
ALL_ERRORS - Static variable in interface com.google.cloud.hadoop.util.RetryDeterminer
Always retries.
andThen(Function<? super R, ? extends V>) - Method in interface com.google.cloud.hadoop.util.CheckedFunction
Returns a composed function that first applies this function to its input, and then applies the after function to the result.
ApiErrorExtractor - Class in com.google.cloud.hadoop.util
Translates exceptions from API calls into higher-level meaning, while allowing injectability for testing how API errors are handled.
ApiErrorExtractor() - Constructor for class com.google.cloud.hadoop.util.ApiErrorExtractor
 
apply(T) - Method in interface com.google.cloud.hadoop.util.CheckedFunction
Applies this function to the given argument.
arbitraryInputStreamSupplier(Supplier<InputStream>) - Static method in class com.google.cloud.hadoop.util.testing.MockHttpTransportHelper
Return an arbitrary InputStream supplier.
AsyncWriteChannelOptions - Class in com.google.cloud.hadoop.util
AsyncWriteChannelOptions() - Constructor for class com.google.cloud.hadoop.util.AsyncWriteChannelOptions
 
AsyncWriteChannelOptions.Builder - Class in com.google.cloud.hadoop.util
Mutable builder for the GoogleCloudStorageWriteChannelOptions class.
AsyncWriteChannelOptions.PipeType - Enum in com.google.cloud.hadoop.util
Pipe used for output stream.
awaitTermination(long, TimeUnit) - Method in class com.google.cloud.hadoop.util.LazyExecutorService
 

B

badRequest(IOException) - Method in class com.google.cloud.hadoop.util.ApiErrorExtractor
Determines if the given exception indicates bad request.
BaseAbstractGoogleAsyncWriteChannel<T> - Class in com.google.cloud.hadoop.util
Skeletal implementation of a WritableByteChannel that executes an asynchronous upload operation and optionally handles the result.
BaseAbstractGoogleAsyncWriteChannel(ExecutorService, AsyncWriteChannelOptions) - Constructor for class com.google.cloud.hadoop.util.BaseAbstractGoogleAsyncWriteChannel
Construct a new channel using the given ExecutorService to run background uploads.
bucketName() - Method in class com.google.cloud.hadoop.util.AccessBoundary
 
BUFFER_SIZE_DEFAULT - Static variable in class com.google.cloud.hadoop.util.AsyncWriteChannelOptions
Default upload buffer size.
build() - Method in class com.google.cloud.hadoop.util.AsyncWriteChannelOptions.Builder
 
build() - Method in class com.google.cloud.hadoop.util.CredentialOptions.Builder
 
build() - Method in class com.google.cloud.hadoop.util.RequesterPaysOptions.Builder
 
build() - Method in class com.google.cloud.hadoop.util.RetryHttpInitializerOptions.Builder
 
builder() - Static method in class com.google.cloud.hadoop.util.AsyncWriteChannelOptions
 
Builder() - Constructor for class com.google.cloud.hadoop.util.AsyncWriteChannelOptions.Builder
 
builder() - Static method in class com.google.cloud.hadoop.util.CredentialOptions
 
Builder() - Constructor for class com.google.cloud.hadoop.util.CredentialOptions.Builder
 
builder() - Static method in class com.google.cloud.hadoop.util.RequesterPaysOptions
 
Builder() - Constructor for class com.google.cloud.hadoop.util.RequesterPaysOptions.Builder
 
builder() - Static method in class com.google.cloud.hadoop.util.RetryHttpInitializerOptions
 
Builder() - Constructor for class com.google.cloud.hadoop.util.RetryHttpInitializerOptions.Builder
 

C

ChainingHttpRequestInitializer - Class in com.google.cloud.hadoop.util
HttpRequestInitializer that composes handlers and interceptors supplied by component handlers.
ChainingHttpRequestInitializer(HttpRequestInitializer...) - Constructor for class com.google.cloud.hadoop.util.ChainingHttpRequestInitializer
 
channelOptions - Variable in class com.google.cloud.hadoop.util.BaseAbstractGoogleAsyncWriteChannel
 
CheckedFunction<T,R,E extends Throwable> - Interface in com.google.cloud.hadoop.util
Represents a function that accepts one argument and produces a result that can throw checked exception.
clientError(IOException) - Method in class com.google.cloud.hadoop.util.ApiErrorExtractor
Determines if the exception is a client error.
ClientRequestHelper<S> - Class in com.google.cloud.hadoop.util
ClientRequestHelper provides wrapper methods around final methods of AbstractGoogleClientRequest to allow overriding them if necessary.
ClientRequestHelper() - Constructor for class com.google.cloud.hadoop.util.ClientRequestHelper
 
close() - Method in class com.google.cloud.hadoop.util.BaseAbstractGoogleAsyncWriteChannel
Closes this channel.
com.google.cloud.hadoop.util - package com.google.cloud.hadoop.util
 
com.google.cloud.hadoop.util.interceptors - package com.google.cloud.hadoop.util.interceptors
 
com.google.cloud.hadoop.util.testing - package com.google.cloud.hadoop.util.testing
 
compose(Function<? super V, ? extends T>) - Method in interface com.google.cloud.hadoop.util.CheckedFunction
Returns a composed function that first applies the before function to its input, and then applies this function to the result.
ComputeCredentialWithRetry(ComputeCredential.Builder) - Constructor for class com.google.cloud.hadoop.util.CredentialFactory.ComputeCredentialWithRetry
 
create(String, String, AccessBoundary.Action) - Static method in class com.google.cloud.hadoop.util.AccessBoundary
 
create(String) - Static method in class com.google.cloud.hadoop.util.RedactedString
 
createApacheHttpTransport(URI, Credentials) - Static method in class com.google.cloud.hadoop.util.HttpTransportFactory
Create an ApacheHttpTransport for calling Google APIs with an optional HTTP proxy.
createHttpTransport(HttpTransportFactory.HttpTransportType) - Static method in class com.google.cloud.hadoop.util.HttpTransportFactory
Create an HttpTransport with socketKeepAlive true
createHttpTransport(HttpTransportFactory.HttpTransportType, String, RedactedString, RedactedString) - Static method in class com.google.cloud.hadoop.util.HttpTransportFactory
Create an HttpTransport based on a type class and an optional HTTP proxy.
createHttpTransport(HttpTransportFactory.HttpTransportType, String, RedactedString, RedactedString, Duration) - Static method in class com.google.cloud.hadoop.util.HttpTransportFactory
Create an HttpTransport based on a type class, optional HTTP proxy and optional socket read timeout.
createNetHttpTransport(URI, PasswordAuthentication, Duration) - Static method in class com.google.cloud.hadoop.util.HttpTransportFactory
Create an NetHttpTransport for calling Google APIs with an optional HTTP proxy.
createRequest(InputStreamContent) - Method in class com.google.cloud.hadoop.util.AbstractGoogleAsyncWriteChannel
Create an API request to upload the given InputStreamContent.
createResponseFromException(IOException) - Method in class com.google.cloud.hadoop.util.BaseAbstractGoogleAsyncWriteChannel
Derived classes may optionally intercept an IOException thrown from the execute() method of a prepared request that came from #createRequest, and return a reconstituted "response" object if the IOException can be handled as a success; for example, if the caller already has an identifier for an object, and the response is used solely for obtaining the same identifier, and the IOException is a handled "409 Already Exists" type of exception, then the derived class may override this method to return the expected "identifier" response.
CredentialAdapter - Class in com.google.cloud.hadoop.util
A wrapper for using Credential with the Google API Client Libraries for Java.
CredentialAdapter(Credential) - Constructor for class com.google.cloud.hadoop.util.CredentialAdapter
 
CredentialFactory - Class in com.google.cloud.hadoop.util
Miscellaneous helper methods for getting a Credential from various sources.
CredentialFactory(CredentialOptions) - Constructor for class com.google.cloud.hadoop.util.CredentialFactory
 
CredentialFactory.ComputeCredentialWithRetry - Class in com.google.cloud.hadoop.util
A subclass of ComputeCredential that properly sets request initializers.
CredentialFactory.CredentialHttpRetryInitializer - Class in com.google.cloud.hadoop.util
Simple HttpRequestInitializer that retries requests that result in 5XX response codes and IO Exceptions with an exponential backoff.
CredentialFactory.GoogleCredentialWithRetry - Class in com.google.cloud.hadoop.util
A subclass of GoogleCredential that properly wires specified HttpRequestInitializer through the @{link Credential#executeRefreshToken} override.
CredentialHttpRetryInitializer() - Constructor for class com.google.cloud.hadoop.util.CredentialFactory.CredentialHttpRetryInitializer
 
CredentialHttpRetryInitializer(Credential) - Constructor for class com.google.cloud.hadoop.util.CredentialFactory.CredentialHttpRetryInitializer
 
CredentialOptions - Class in com.google.cloud.hadoop.util
Configuration for how components should obtain Credentials.
CredentialOptions() - Constructor for class com.google.cloud.hadoop.util.CredentialOptions
 
CredentialOptions.Builder - Class in com.google.cloud.hadoop.util
Builder for CredentialOptions

D

dataRangeResponse(byte[], long, long) - Static method in class com.google.cloud.hadoop.util.testing.MockHttpTransportHelper
 
dataResponse(byte[]) - Static method in class com.google.cloud.hadoop.util.testing.MockHttpTransportHelper
 
dataResponse(Map<String, Object>, byte[]) - Static method in class com.google.cloud.hadoop.util.testing.MockHttpTransportHelper
 
DEFAULT - Static variable in class com.google.cloud.hadoop.util.AsyncWriteChannelOptions
 
DEFAULT - Static variable in class com.google.cloud.hadoop.util.RequesterPaysOptions
 
DEFAULT - Static variable in interface com.google.cloud.hadoop.util.RetryDeterminer
Retries exception when either SOCKET_ERRORS or SERVER_ERRORS would retry.
DEFAULT - Static variable in class com.google.cloud.hadoop.util.RetryHttpInitializerOptions
 
DEFAULT_CONNECT_TIMEOUT - Static variable in class com.google.cloud.hadoop.util.RetryHttpInitializerOptions
 
DEFAULT_DEFAULT_USER_AGENT - Static variable in class com.google.cloud.hadoop.util.RetryHttpInitializerOptions
 
DEFAULT_GRPC_WRITE_MESSAGE_TIMEOUT_MILLIS - Static variable in class com.google.cloud.hadoop.util.AsyncWriteChannelOptions
 
DEFAULT_GRPC_WRITE_TIMEOUT - Static variable in class com.google.cloud.hadoop.util.AsyncWriteChannelOptions
Default timeout for grpc write stream.
DEFAULT_HTTP_HEADERS - Static variable in class com.google.cloud.hadoop.util.RetryHttpInitializerOptions
 
DEFAULT_MAX_REQUEST_RETRIES - Static variable in class com.google.cloud.hadoop.util.RetryHttpInitializerOptions
 
DEFAULT_NUM_REQUESTS_BUFFERED_GRPC - Static variable in class com.google.cloud.hadoop.util.AsyncWriteChannelOptions
Default number of insert requests to retain, in case we need to rewind and resume an upload
DEFAULT_READ_TIMEOUT - Static variable in class com.google.cloud.hadoop.util.RetryHttpInitializerOptions
 
DEFAULT_SCOPES - Static variable in class com.google.cloud.hadoop.util.CredentialFactory
 
DEFAULT_TRANSPORT_TYPE - Static variable in class com.google.cloud.hadoop.util.HttpTransportFactory
 
DIRECT_UPLOAD_ENABLED_DEFAULT - Static variable in class com.google.cloud.hadoop.util.AsyncWriteChannelOptions
Default of whether to use direct upload.

E

emptyResponse(int) - Static method in class com.google.cloud.hadoop.util.testing.MockHttpTransportHelper
 
execute(Runnable) - Method in class com.google.cloud.hadoop.util.LazyExecutorService
Always throws a RejectedExecutionException because using this method does not make sense from either a lazy execution perspective or a cached result perspective.
executeRefreshToken() - Method in class com.google.cloud.hadoop.util.CredentialFactory.ComputeCredentialWithRetry
 
executeRefreshToken() - Method in class com.google.cloud.hadoop.util.CredentialFactory.GoogleCredentialWithRetry
 
executeRefreshToken() - Method in class com.google.cloud.hadoop.util.GoogleCredentialWithIamAccessToken
 

F

FIELD_SIZE_TOO_LARGE_REASON - Static variable in class com.google.cloud.hadoop.util.ApiErrorExtractor
 
fieldSizeTooLarge(IOException) - Method in class com.google.cloud.hadoop.util.ApiErrorExtractor
Determines if the given exception indicates 'field size too large'.

G

GCCL_INVOCATION_ID_PREFIX - Static variable in class com.google.cloud.hadoop.util.interceptors.InvocationIdInterceptor
 
getBuckets() - Method in class com.google.cloud.hadoop.util.RequesterPaysOptions
 
getBufferSize() - Method in class com.google.cloud.hadoop.util.AsyncWriteChannelOptions
 
getConnectTimeout() - Method in class com.google.cloud.hadoop.util.RetryHttpInitializerOptions
A connection timeout - maximum time to wait until connection will be established.
getContentType() - Method in class com.google.cloud.hadoop.util.AbstractGoogleAsyncWriteChannel
 
getCredential(List<String>) - Method in class com.google.cloud.hadoop.util.CredentialFactory
Get the credential as configured.
getCredential() - Method in class com.google.cloud.hadoop.util.RetryHttpInitializer
 
getCredentialFromMetadataServiceAccount() - Static method in class com.google.cloud.hadoop.util.CredentialFactory
Initializes OAuth2 credential using preconfigured ServiceAccount settings on the local GCE VM.
getCredentialFromPrivateKeyServiceAccount(List<String>, HttpTransport) - Method in class com.google.cloud.hadoop.util.CredentialFactory
Initializes OAuth2 credential from a private keyfile, as described in OAuth2 Service Accounts.
getDebugInfo(IOException) - Method in class com.google.cloud.hadoop.util.ApiErrorExtractor
 
getDefaultUserAgent() - Method in class com.google.cloud.hadoop.util.RetryHttpInitializerOptions
A String to set as the user-agent when initializing an HTTP request if it doesn't already have a "User-Agent" header.
getErrorCode() - Method in enum com.google.cloud.hadoop.util.testing.MockHttpTransportHelper.ErrorResponses
 
getErrorDomain() - Method in enum com.google.cloud.hadoop.util.testing.MockHttpTransportHelper.ErrorResponses
 
getErrorInfo(IOException) - Method in class com.google.cloud.hadoop.util.ApiErrorExtractor
Get the first ErrorInfo from an IOException if it is an instance of GoogleJsonResponseException, otherwise return null.
getErrorMessage(IOException) - Method in class com.google.cloud.hadoop.util.ApiErrorExtractor
Extracts the error message.
getErrorMessage() - Method in enum com.google.cloud.hadoop.util.testing.MockHttpTransportHelper.ErrorResponses
 
getErrorReason() - Method in enum com.google.cloud.hadoop.util.testing.MockHttpTransportHelper.ErrorResponses
 
getGrpcWriteMessageTimeoutMillis() - Method in class com.google.cloud.hadoop.util.AsyncWriteChannelOptions
 
getGrpcWriteTimeout() - Method in class com.google.cloud.hadoop.util.AsyncWriteChannelOptions
 
getHttpHeaders() - Method in class com.google.cloud.hadoop.util.RetryHttpInitializerOptions
An additional HTTP headers to set in an HTTP request.
getHttpStatusCode(GoogleJsonResponseException) - Method in class com.google.cloud.hadoop.util.ApiErrorExtractor
Returns HTTP status code from the given exception.
getJsonError(IOException) - Method in class com.google.cloud.hadoop.util.ApiErrorExtractor
If the exception is a GoogleJsonResponseException, get the error details, else return null.
getJsonResponseException(Throwable) - Static method in class com.google.cloud.hadoop.util.ApiErrorExtractor
 
getMaxRequestRetries() - Method in class com.google.cloud.hadoop.util.RetryHttpInitializerOptions
A max number of retries for an HTTP request.
getMode() - Method in class com.google.cloud.hadoop.util.RequesterPaysOptions
 
getNumberOfBufferedRequests() - Method in class com.google.cloud.hadoop.util.AsyncWriteChannelOptions
 
getPipeBufferSize() - Method in class com.google.cloud.hadoop.util.AsyncWriteChannelOptions
 
getPipeType() - Method in class com.google.cloud.hadoop.util.AsyncWriteChannelOptions
 
getProjectId() - Method in class com.google.cloud.hadoop.util.RequesterPaysOptions
 
getPropertyOrDefault(Class<?>, String, String, String) - Static method in class com.google.cloud.hadoop.util.PropertyUtil
Get the value of a property or a default value if there's an error retrieving the property key.
getProxyAddress() - Method in class com.google.cloud.hadoop.util.CredentialOptions
 
getProxyPassword() - Method in class com.google.cloud.hadoop.util.CredentialOptions
 
getProxyUsername() - Method in class com.google.cloud.hadoop.util.CredentialOptions
 
getReadTimeout() - Method in class com.google.cloud.hadoop.util.RetryHttpInitializerOptions
A read timeout from an established connection - maximum time to wait for a read form an established connection to finish.
getRequestHeaders(AbstractGoogleClientRequest<S>) - Method in class com.google.cloud.hadoop.util.ClientRequestHelper
Wraps AbstractGoogleClientRequest.getRequestHeaders().
getResourceString() - Method in class com.google.cloud.hadoop.util.BaseAbstractGoogleAsyncWriteChannel
 
getResponseCode() - Method in enum com.google.cloud.hadoop.util.testing.MockHttpTransportHelper.ErrorResponses
 
getServiceAccountEmail() - Method in class com.google.cloud.hadoop.util.CredentialOptions
 
getServiceAccountJsonKeyFile() - Method in class com.google.cloud.hadoop.util.CredentialOptions
 
getServiceAccountKeyFile() - Method in class com.google.cloud.hadoop.util.CredentialOptions
 
getServiceAccountPrivateKey() - Method in class com.google.cloud.hadoop.util.CredentialOptions
 
getServiceAccountPrivateKeyId() - Method in class com.google.cloud.hadoop.util.CredentialOptions
 
getTokenServerUrl() - Method in class com.google.cloud.hadoop.util.CredentialOptions
 
getTransportType() - Method in class com.google.cloud.hadoop.util.CredentialOptions
 
getUploadCacheSize() - Method in class com.google.cloud.hadoop.util.AsyncWriteChannelOptions
 
getUploadChunkSize() - Method in class com.google.cloud.hadoop.util.AsyncWriteChannelOptions
 
GLOBAL_DOMAIN - Static variable in class com.google.cloud.hadoop.util.ApiErrorExtractor
 
GOOG_API_CLIENT - Static variable in class com.google.cloud.hadoop.util.interceptors.InvocationIdInterceptor
 
GoogleCredentialWithIamAccessToken - Class in com.google.cloud.hadoop.util
A Credential to generate or refresh IAM access token.
GoogleCredentialWithIamAccessToken(HttpTransport, HttpRequestInitializer, String, ImmutableList<String>) - Constructor for class com.google.cloud.hadoop.util.GoogleCredentialWithIamAccessToken
 
GoogleCredentialWithIamAccessToken(HttpTransport, HttpRequestInitializer, String, ImmutableList<String>, Clock) - Constructor for class com.google.cloud.hadoop.util.GoogleCredentialWithIamAccessToken
 
GRPC_CHECKSUMS_ENABLED_DEFAULT - Static variable in class com.google.cloud.hadoop.util.AsyncWriteChannelOptions
Default of whether to enabled checksums for gRPC.

H

handleResponse(T) - Method in class com.google.cloud.hadoop.util.BaseAbstractGoogleAsyncWriteChannel
Handle the API response.
HttpTransportFactory - Class in com.google.cloud.hadoop.util
Factory for creating HttpTransport types.
HttpTransportFactory() - Constructor for class com.google.cloud.hadoop.util.HttpTransportFactory
 
HttpTransportFactory.HttpTransportType - Enum in com.google.cloud.hadoop.util
Types of HttpTransports the factory can create.

I

identity() - Static method in interface com.google.cloud.hadoop.util.CheckedFunction
Returns a function that always returns its input argument.
initialize() - Method in class com.google.cloud.hadoop.util.BaseAbstractGoogleAsyncWriteChannel
Initialize this channel object for writing.
initialize(HttpRequest) - Method in class com.google.cloud.hadoop.util.ChainingHttpRequestInitializer
 
initialize(HttpRequest) - Method in class com.google.cloud.hadoop.util.CredentialFactory.CredentialHttpRetryInitializer
 
initialize(HttpRequest) - Method in class com.google.cloud.hadoop.util.RetryHttpInitializer
 
inputStreamResponse(String, Object, InputStream) - Static method in class com.google.cloud.hadoop.util.testing.MockHttpTransportHelper
 
inputStreamResponse(Map<String, Object>, InputStream) - Static method in class com.google.cloud.hadoop.util.testing.MockHttpTransportHelper
 
INSTANCE - Static variable in class com.google.cloud.hadoop.util.ApiErrorExtractor
Singleton instance of the ApiErrorExtractor.
intercept(HttpRequest) - Method in class com.google.cloud.hadoop.util.interceptors.InvocationIdInterceptor
 
internalServerError(IOException) - Method in class com.google.cloud.hadoop.util.ApiErrorExtractor
Determines if the exception is an internal server error.
InvocationIdInterceptor - Class in com.google.cloud.hadoop.util.interceptors
HTTP request interceptor to attach unique identifier i.e.
InvocationIdInterceptor(HttpExecuteInterceptor) - Constructor for class com.google.cloud.hadoop.util.interceptors.InvocationIdInterceptor
 
invokeAll(Collection<? extends Callable<T>>) - Method in class com.google.cloud.hadoop.util.LazyExecutorService
ExecutorService requires that this method should not return until all tasks are completed, which precludes lazy execution.
invokeAll(Collection<? extends Callable<T>>, long, TimeUnit) - Method in class com.google.cloud.hadoop.util.LazyExecutorService
ExecutorService requires that this method should not return until all tasks are completed or the timeout expires, which precludes lazy execution.
invokeAny(Collection<? extends Callable<T>>) - Method in class com.google.cloud.hadoop.util.LazyExecutorService
Always throws a RejectedExecutionException because using this method does not make sense from either a lazy execution perspective or a cached result perspective.
invokeAny(Collection<? extends Callable<T>>, long, TimeUnit) - Method in class com.google.cloud.hadoop.util.LazyExecutorService
Always throws a RejectedExecutionException because using this method does not make sense from either a lazy execution perspective or a cached result perspective.
IoExceptionHelper - Class in com.google.cloud.hadoop.util
Translates exceptions from API calls into higher-level meaning, while allowing injectability for testing how API errors are handled.
isDirectUploadEnabled() - Method in class com.google.cloud.hadoop.util.AsyncWriteChannelOptions
 
isDirectUploadEnabled() - Method in class com.google.cloud.hadoop.util.BaseAbstractGoogleAsyncWriteChannel
Returns true if direct media uploads are enabled.
isGrpcChecksumsEnabled() - Method in class com.google.cloud.hadoop.util.AsyncWriteChannelOptions
 
isIoError(Throwable) - Static method in class com.google.cloud.hadoop.util.IoExceptionHelper
Determines if a given Throwable is caused by an IO error.
isNullCredentialEnabled() - Method in class com.google.cloud.hadoop.util.CredentialOptions
 
isOpen() - Method in class com.google.cloud.hadoop.util.BaseAbstractGoogleAsyncWriteChannel
Tells whether this channel is open.
isReadTimedOut(IOException) - Static method in class com.google.cloud.hadoop.util.IoExceptionHelper
Determines if a given IOException is caused by a timed out read.
isServiceAccountEnabled() - Method in class com.google.cloud.hadoop.util.CredentialOptions
 
isShutdown() - Method in class com.google.cloud.hadoop.util.LazyExecutorService
 
isSocketError(Throwable) - Static method in class com.google.cloud.hadoop.util.IoExceptionHelper
Determines if a given Throwable is caused by a socket error.
isTerminated() - Method in class com.google.cloud.hadoop.util.LazyExecutorService
 
itemAlreadyExists(IOException) - Method in class com.google.cloud.hadoop.util.ApiErrorExtractor
Determines if the given exception indicates 'item already exists'.
itemNotFound(IOException) - Method in class com.google.cloud.hadoop.util.ApiErrorExtractor
Determines if the given exception indicates 'item not found'.

J

JSON_FACTORY - Static variable in class com.google.cloud.hadoop.util.testing.MockHttpTransportHelper
 
jsonDataResponse(Object) - Static method in class com.google.cloud.hadoop.util.testing.MockHttpTransportHelper
 
jsonErrorResponse(MockHttpTransportHelper.ErrorResponses) - Static method in class com.google.cloud.hadoop.util.testing.MockHttpTransportHelper
 

L

LazyExecutorService - Class in com.google.cloud.hadoop.util
Defers execution to the time that a method that expresses interest in the result (get or isDone) is called on the Future.
LazyExecutorService() - Constructor for class com.google.cloud.hadoop.util.LazyExecutorService
Creates an instance using a MoreExecutors.newDirectExecutorService() for the backing service.
LazyExecutorService(ExecutorService) - Constructor for class com.google.cloud.hadoop.util.LazyExecutorService
Creates an instance using the given ExecutorService as the backing service.
logger - Static variable in class com.google.cloud.hadoop.util.BaseAbstractGoogleAsyncWriteChannel
 
LoggingMediaHttpUploaderProgressListener - Class in com.google.cloud.hadoop.util
Logs the status of uploads.
LoggingMediaHttpUploaderProgressListener(String, long) - Constructor for class com.google.cloud.hadoop.util.LoggingMediaHttpUploaderProgressListener
Creates a upload progress listener that emits relevant statistics about the progress of the upload.

M

mockBatchTransport(int, LowLevelHttpResponse...) - Static method in class com.google.cloud.hadoop.util.testing.MockHttpTransportHelper
 
MockHttpTransportHelper - Class in com.google.cloud.hadoop.util.testing
Utility methods for testing with MockHttpTransport
MockHttpTransportHelper.ErrorResponses - Enum in com.google.cloud.hadoop.util.testing
HTTP JSON API error responses
mockTransport(Object...) - Static method in class com.google.cloud.hadoop.util.testing.MockHttpTransportHelper
 

N

nextBackOffMillis() - Method in class com.google.cloud.hadoop.util.RetryBoundedBackOff
 
nextSleep(BackOff, Sleeper, Exception) - Static method in class com.google.cloud.hadoop.util.ResilientOperation
Determines the amount to sleep for and sleeps if needed.

O

objectName() - Method in class com.google.cloud.hadoop.util.AccessBoundary
 

P

PIPE_BUFFER_SIZE_DEFAULT - Static variable in class com.google.cloud.hadoop.util.AsyncWriteChannelOptions
Default pipe buffer size.
PIPE_TYPE_DEFAULT - Static variable in class com.google.cloud.hadoop.util.AsyncWriteChannelOptions
 
preconditionNotMet(IOException) - Method in class com.google.cloud.hadoop.util.ApiErrorExtractor
Determines if the given IOException indicates 'precondition not met' Recursively checks getCause() if outer exception isn't an instance of the correct class.
progressChanged(MediaHttpUploader) - Method in class com.google.cloud.hadoop.util.LoggingMediaHttpUploaderProgressListener
 
PropertyUtil - Class in com.google.cloud.hadoop.util
Helpers for interacting with properties files
PropertyUtil() - Constructor for class com.google.cloud.hadoop.util.PropertyUtil
 

Q

QUOTA_EXCEEDED_REASON - Static variable in class com.google.cloud.hadoop.util.ApiErrorExtractor
 
quotaExceeded(IOException) - Method in class com.google.cloud.hadoop.util.ApiErrorExtractor
Determines if a given Throwable is caused by Quota Exceeded.

R

rangeNotSatisfiable(IOException) - Method in class com.google.cloud.hadoop.util.ApiErrorExtractor
Determines if the given exception indicates 'range not satisfiable'.
RATE_LIMIT_ERRORS - Static variable in interface com.google.cloud.hadoop.util.RetryDeterminer
A rate limited determiner that uses a default ApiErrorExtractor.
RATE_LIMITED_REASON - Static variable in class com.google.cloud.hadoop.util.ApiErrorExtractor
 
rateLimited(IOException) - Method in class com.google.cloud.hadoop.util.ApiErrorExtractor
Determines if a given Throwable is caused by a rate limit being applied.
recursiveCheckForCode(IOException, int) - Method in class com.google.cloud.hadoop.util.ApiErrorExtractor
Recursively checks getCause() if outer exception isn't an instance of the correct class.
RedactedString - Class in com.google.cloud.hadoop.util
Holder class for string values that should not be logged and displayed when toString method called.
RedactedString() - Constructor for class com.google.cloud.hadoop.util.RedactedString
 
refreshAccessToken() - Method in class com.google.cloud.hadoop.util.CredentialAdapter
 
REQUESTER_PAYS_BUCKETS_DEFAULT - Static variable in class com.google.cloud.hadoop.util.RequesterPaysOptions
REQUESTER_PAYS_MODE_DEFAULT - Static variable in class com.google.cloud.hadoop.util.RequesterPaysOptions
RequesterPaysOptions - Class in com.google.cloud.hadoop.util
Options for the GCS Requester Pays feature.
RequesterPaysOptions() - Constructor for class com.google.cloud.hadoop.util.RequesterPaysOptions
 
RequesterPaysOptions.Builder - Class in com.google.cloud.hadoop.util
RequesterPaysOptions.RequesterPaysMode - Enum in com.google.cloud.hadoop.util
Operational modes of GCS Requester Pays feature.
requestFailure(IOException) - Method in class com.google.cloud.hadoop.util.ApiErrorExtractor
Determines if the given exception indicates intermittent request failure or failure caused by user error.
reset() - Method in class com.google.cloud.hadoop.util.RetryBoundedBackOff
 
ResilientOperation - Class in com.google.cloud.hadoop.util
A class which defines static functions to be called to make a user-provided function more resilient by attempting retries.
ResilientOperation() - Constructor for class com.google.cloud.hadoop.util.ResilientOperation
 
RESOURCE_NOT_READY_REASON - Static variable in class com.google.cloud.hadoop.util.ApiErrorExtractor
 
resourceNotReady(IOException) - Method in class com.google.cloud.hadoop.util.ApiErrorExtractor
Determines if the given exception indicates 'resource not ready'.
retry(Callable<T>, BackOff, RetryDeterminer<? super X>, Class<X>, Sleeper) - Static method in class com.google.cloud.hadoop.util.ResilientOperation
Retries the given executable function in the case of transient errors defined by the RetryDeterminer.
retry(Callable<T>, BackOff, RetryDeterminer<? super X>, Class<X>) - Static method in class com.google.cloud.hadoop.util.ResilientOperation
Retries the given executable function in the case of transient errors defined by the RetryDeterminer and uses default sleeper.
RetryBoundedBackOff - Class in com.google.cloud.hadoop.util
An implementation of BackOff that limits the number of calls on another BackOff.
RetryBoundedBackOff(BackOff, int) - Constructor for class com.google.cloud.hadoop.util.RetryBoundedBackOff
RetryBoundedBackOff takes a BackOff and limits the retries.
RetryDeterminer<X extends Exception> - Interface in com.google.cloud.hadoop.util
This abstract class is designed to tell if an exception is transient and should result in a retry or not, and should result in a returned exception to the caller.
RetryHttpInitializer - Class in com.google.cloud.hadoop.util
 
RetryHttpInitializer(Credential, String) - Constructor for class com.google.cloud.hadoop.util.RetryHttpInitializer
 
RetryHttpInitializer(Credential, RetryHttpInitializerOptions) - Constructor for class com.google.cloud.hadoop.util.RetryHttpInitializer
 
RetryHttpInitializerOptions - Class in com.google.cloud.hadoop.util
Options for the RetryHttpInitializer class.
RetryHttpInitializerOptions() - Constructor for class com.google.cloud.hadoop.util.RetryHttpInitializerOptions
 
RetryHttpInitializerOptions.Builder - Class in com.google.cloud.hadoop.util

S

SERVER_ERRORS - Static variable in interface com.google.cloud.hadoop.util.RetryDeterminer
Server errors RetryDeterminer decides to retry on HttpResponseExceptions that return a 500.
setBuckets(Collection<String>) - Method in class com.google.cloud.hadoop.util.RequesterPaysOptions.Builder
 
setBuckets(String...) - Method in class com.google.cloud.hadoop.util.RequesterPaysOptions.Builder
 
setBufferSize(int) - Method in class com.google.cloud.hadoop.util.AsyncWriteChannelOptions.Builder
 
setChunkSize(AbstractGoogleClientRequest<S>, int) - Method in class com.google.cloud.hadoop.util.ClientRequestHelper
Wraps AbstractGoogleClientRequest.getMediaHttpUploader().
setConnectTimeout(Duration) - Method in class com.google.cloud.hadoop.util.RetryHttpInitializerOptions.Builder
 
setDefaultUserAgent(String) - Method in class com.google.cloud.hadoop.util.RetryHttpInitializerOptions.Builder
 
setDirectUploadEnabled(boolean) - Method in class com.google.cloud.hadoop.util.AsyncWriteChannelOptions.Builder
 
setDirectUploadEnabled(AbstractGoogleClientRequest<S>, boolean) - Method in class com.google.cloud.hadoop.util.ClientRequestHelper
Configures the clientRequest to enable/disable direct (single-request) uploads according to enable.
setGrpcChecksumsEnabled(boolean) - Method in class com.google.cloud.hadoop.util.AsyncWriteChannelOptions.Builder
Enable gRPC checksumming.
setGrpcWriteMessageTimeoutMillis(long) - Method in class com.google.cloud.hadoop.util.AsyncWriteChannelOptions.Builder
 
setGrpcWriteTimeout(long) - Method in class com.google.cloud.hadoop.util.AsyncWriteChannelOptions.Builder
 
setHttpHeaders(Map<String, String>) - Method in class com.google.cloud.hadoop.util.RetryHttpInitializerOptions.Builder
 
setMaxRequestRetries(int) - Method in class com.google.cloud.hadoop.util.RetryHttpInitializerOptions.Builder
 
setMode(RequesterPaysOptions.RequesterPaysMode) - Method in class com.google.cloud.hadoop.util.RequesterPaysOptions.Builder
 
setNullCredentialEnabled(boolean) - Method in class com.google.cloud.hadoop.util.CredentialOptions.Builder
 
setNumberOfBufferedRequests(long) - Method in class com.google.cloud.hadoop.util.AsyncWriteChannelOptions.Builder
 
setPipeBufferSize(int) - Method in class com.google.cloud.hadoop.util.AsyncWriteChannelOptions.Builder
 
setPipeType(AsyncWriteChannelOptions.PipeType) - Method in class com.google.cloud.hadoop.util.AsyncWriteChannelOptions.Builder
 
setProjectId(String) - Method in class com.google.cloud.hadoop.util.RequesterPaysOptions.Builder
 
setProxyAddress(String) - Method in class com.google.cloud.hadoop.util.CredentialOptions.Builder
 
setProxyPassword(RedactedString) - Method in class com.google.cloud.hadoop.util.CredentialOptions.Builder
 
setProxyUsername(RedactedString) - Method in class com.google.cloud.hadoop.util.CredentialOptions.Builder
 
setReadTimeout(Duration) - Method in class com.google.cloud.hadoop.util.RetryHttpInitializerOptions.Builder
 
setServiceAccountEmail(String) - Method in class com.google.cloud.hadoop.util.CredentialOptions.Builder
 
setServiceAccountEnabled(boolean) - Method in class com.google.cloud.hadoop.util.CredentialOptions.Builder
 
setServiceAccountJsonKeyFile(String) - Method in class com.google.cloud.hadoop.util.CredentialOptions.Builder
 
setServiceAccountKeyFile(String) - Method in class com.google.cloud.hadoop.util.CredentialOptions.Builder
 
setServiceAccountPrivateKey(RedactedString) - Method in class com.google.cloud.hadoop.util.CredentialOptions.Builder
 
setServiceAccountPrivateKeyId(RedactedString) - Method in class com.google.cloud.hadoop.util.CredentialOptions.Builder
 
setTokenServerUrl(String) - Method in class com.google.cloud.hadoop.util.CredentialOptions.Builder
 
setTransportType(HttpTransportFactory.HttpTransportType) - Method in class com.google.cloud.hadoop.util.CredentialOptions.Builder
 
setUploadCacheSize(int) - Method in class com.google.cloud.hadoop.util.AsyncWriteChannelOptions.Builder
 
setUploadChunkSize(int) - Method in class com.google.cloud.hadoop.util.AsyncWriteChannelOptions.Builder
 
shouldRetry(X) - Method in interface com.google.cloud.hadoop.util.RetryDeterminer
Determines if we should attempt a retry depending on the caught exception.
shutdown() - Method in class com.google.cloud.hadoop.util.LazyExecutorService
Shuts this service down, but leaves the backing service untouched.
shutdownNow() - Method in class com.google.cloud.hadoop.util.LazyExecutorService
Trying to interpret the assumptions about the contract of this method in the light of this implementation, it seems most reasonable to take the view that all tasks are running, even if the processing has not actually started.
SOCKET_ERRORS - Static variable in interface com.google.cloud.hadoop.util.RetryDeterminer
Socket errors retry determiner retries on socket exceptions.
startUpload(InputStream) - Method in class com.google.cloud.hadoop.util.AbstractGoogleAsyncWriteChannel
 
startUpload(InputStream) - Method in class com.google.cloud.hadoop.util.BaseAbstractGoogleAsyncWriteChannel
Create a new thread which handles the upload.
STATUS_CODE_RANGE_NOT_SATISFIABLE - Static variable in class com.google.cloud.hadoop.util.ApiErrorExtractor
 
submit(Callable<T>) - Method in class com.google.cloud.hadoop.util.LazyExecutorService
 
submit(Runnable, T) - Method in class com.google.cloud.hadoop.util.LazyExecutorService
 
submit(Runnable) - Method in class com.google.cloud.hadoop.util.LazyExecutorService
 

T

threadPool - Variable in class com.google.cloud.hadoop.util.BaseAbstractGoogleAsyncWriteChannel
 
toBuilder() - Method in class com.google.cloud.hadoop.util.AsyncWriteChannelOptions
 
toBuilder() - Method in class com.google.cloud.hadoop.util.CredentialOptions
 
toBuilder() - Method in class com.google.cloud.hadoop.util.RequesterPaysOptions
 
toBuilder() - Method in class com.google.cloud.hadoop.util.RetryHttpInitializerOptions
 
toString() - Method in class com.google.cloud.hadoop.util.RedactedString
 
toUserPresentableException(IOException, String) - Method in class com.google.cloud.hadoop.util.ApiErrorExtractor
Converts the exception to a user-presentable error message.
toUserPresentableMessage(IOException, String) - Method in class com.google.cloud.hadoop.util.ApiErrorExtractor
Converts the exception to a user-presentable error message.
toUserPresentableMessage(IOException) - Method in class com.google.cloud.hadoop.util.ApiErrorExtractor

U

unauthorized(IOException) - Method in class com.google.cloud.hadoop.util.ApiErrorExtractor
Determines if the given exception indicates the request was unauthenticated.
UPLOAD_CACHE_SIZE_DEFAULT - Static variable in class com.google.cloud.hadoop.util.AsyncWriteChannelOptions
Default upload cache size.
UPLOAD_CHUNK_SIZE_DEFAULT - Static variable in class com.google.cloud.hadoop.util.AsyncWriteChannelOptions
Default upload chunk size.
UPLOAD_CHUNK_SIZE_GRANULARITY - Static variable in class com.google.cloud.hadoop.util.AsyncWriteChannelOptions
Upload chunk size granularity
uploadOperation - Variable in class com.google.cloud.hadoop.util.BaseAbstractGoogleAsyncWriteChannel
 
USAGE_LIMITS_DOMAIN - Static variable in class com.google.cloud.hadoop.util.ApiErrorExtractor
 
USER_PROJECT_MISSING_MESSAGE - Static variable in class com.google.cloud.hadoop.util.ApiErrorExtractor
 
USER_RATE_LIMITED_REASON - Static variable in class com.google.cloud.hadoop.util.ApiErrorExtractor
 
userProjectMissing(IOException) - Method in class com.google.cloud.hadoop.util.ApiErrorExtractor
Determines if the given exception indicates that 'userProject' is missing in request.

V

value() - Method in class com.google.cloud.hadoop.util.RedactedString
 
valueOf(String) - Static method in enum com.google.cloud.hadoop.util.AccessBoundary.Action
Returns the enum constant of this type with the specified name.
valueOf(String) - Static method in enum com.google.cloud.hadoop.util.AsyncWriteChannelOptions.PipeType
Returns the enum constant of this type with the specified name.
valueOf(String) - Static method in enum com.google.cloud.hadoop.util.HttpTransportFactory.HttpTransportType
Returns the enum constant of this type with the specified name.
valueOf(String) - Static method in enum com.google.cloud.hadoop.util.RequesterPaysOptions.RequesterPaysMode
Returns the enum constant of this type with the specified name.
valueOf(String) - Static method in enum com.google.cloud.hadoop.util.testing.MockHttpTransportHelper.ErrorResponses
Returns the enum constant of this type with the specified name.
values() - Static method in enum com.google.cloud.hadoop.util.AccessBoundary.Action
Returns an array containing the constants of this enum type, in the order they are declared.
values() - Static method in enum com.google.cloud.hadoop.util.AsyncWriteChannelOptions.PipeType
Returns an array containing the constants of this enum type, in the order they are declared.
values() - Static method in enum com.google.cloud.hadoop.util.HttpTransportFactory.HttpTransportType
Returns an array containing the constants of this enum type, in the order they are declared.
values() - Static method in enum com.google.cloud.hadoop.util.RequesterPaysOptions.RequesterPaysMode
Returns an array containing the constants of this enum type, in the order they are declared.
values() - Static method in enum com.google.cloud.hadoop.util.testing.MockHttpTransportHelper.ErrorResponses
Returns an array containing the constants of this enum type, in the order they are declared.

W

write(ByteBuffer) - Method in class com.google.cloud.hadoop.util.BaseAbstractGoogleAsyncWriteChannel
Writes contents of the given buffer to this channel.
A B C D E F G H I J L M N O P Q R S T U V W 
Skip navigation links

Copyright © 2022. All rights reserved.