A B C D E F G H I J L M N O P Q R S T U V W
All Classes All Packages
All Classes All Packages
All Classes All Packages
A
- AbstractGoogleAsyncWriteChannel<T> - Class in com.google.cloud.hadoop.util
-
Skeletal implementation of a WritableByteChannel that executes an asynchronous upload operation and optionally handles the result.
- AbstractGoogleAsyncWriteChannel(ExecutorService, AsyncWriteChannelOptions) - Constructor for class com.google.cloud.hadoop.util.AbstractGoogleAsyncWriteChannel
-
Construct a new channel using the given ExecutorService to run background uploads.
- ACCESS_NOT_CONFIGURED_REASON - Static variable in class com.google.cloud.hadoop.util.ApiErrorExtractor
- AccessBoundary - Class in com.google.cloud.hadoop.util
-
An access boundary used to generate a downscoped access token.
- AccessBoundary() - Constructor for class com.google.cloud.hadoop.util.AccessBoundary
- AccessBoundary.Action - Enum in com.google.cloud.hadoop.util
- accessDenied(IOException) - Method in class com.google.cloud.hadoop.util.ApiErrorExtractor
-
Determines if the given exception indicates 'access denied'.
- accessDeniedNonRecoverable(IOException) - Method in class com.google.cloud.hadoop.util.ApiErrorExtractor
-
Determines if the exception is a non-recoverable access denied code (such as account closed or marked for deletion).
- ACCOUNT_DISABLED_REASON - Static variable in class com.google.cloud.hadoop.util.ApiErrorExtractor
- action() - Method in class com.google.cloud.hadoop.util.AccessBoundary
- addToExistingTrace(String) - Static method in class com.google.cloud.hadoop.util.TraceOperation
- ALL_ERRORS - Static variable in interface com.google.cloud.hadoop.util.RetryDeterminer
-
Always retries.
- ALWAYS - com.google.cloud.hadoop.util.AsyncWriteChannelOptions.PartFileCleanupType
- andThen(Function<? super R, ? extends V>) - Method in interface com.google.cloud.hadoop.util.CheckedFunction
-
Returns a composed function that first applies this function to its input, and then applies the
after
function to the result. - annotate(String, int) - Method in interface com.google.cloud.hadoop.util.ITraceOperation
- annotate(String, int) - Method in class com.google.cloud.hadoop.util.TraceOperation
- annotate(String, Object) - Method in class com.google.cloud.hadoop.util.ThreadTrace
- ApiErrorExtractor - Class in com.google.cloud.hadoop.util
-
Translates exceptions from API calls into higher-level meaning, while allowing injectability for testing how API errors are handled.
- ApiErrorExtractor() - Constructor for class com.google.cloud.hadoop.util.ApiErrorExtractor
- apply(T) - Method in interface com.google.cloud.hadoop.util.CheckedFunction
-
Applies this function to the given argument.
- arbitraryInputStreamSupplier(Supplier<InputStream>) - Static method in class com.google.cloud.hadoop.util.testing.MockHttpTransportHelper
-
Return an arbitrary InputStream supplier.
- AsyncWriteChannelOptions - Class in com.google.cloud.hadoop.util
-
Options for the
AbstractGoogleAsyncWriteChannel
. - AsyncWriteChannelOptions() - Constructor for class com.google.cloud.hadoop.util.AsyncWriteChannelOptions
- AsyncWriteChannelOptions.Builder - Class in com.google.cloud.hadoop.util
-
Mutable builder for the GoogleCloudStorageWriteChannelOptions class.
- AsyncWriteChannelOptions.PartFileCleanupType - Enum in com.google.cloud.hadoop.util
-
Part file cleanup strategy for parallel composite upload.
- AsyncWriteChannelOptions.PipeType - Enum in com.google.cloud.hadoop.util
-
Pipe used for output stream.
- AsyncWriteChannelOptions.UploadType - Enum in com.google.cloud.hadoop.util
-
UploadType are in parity with various upload configuration offered by google-java-storage client ref: https://cloud.google.com/java/docs/reference/google-cloud-storage/latest/com.google.cloud.storage.BlobWriteSessionConfigs
- AUTO - com.google.cloud.hadoop.util.RequesterPaysOptions.RequesterPaysMode
- awaitTermination(long, TimeUnit) - Method in class com.google.cloud.hadoop.util.LazyExecutorService
B
- BACKOFF - com.google.cloud.hadoop.util.GcsJsonApiEvent.EventType
- BACKOFF_TIME - Static variable in class com.google.cloud.hadoop.util.GcsJsonApiEvent
- badRequest(IOException) - Method in class com.google.cloud.hadoop.util.ApiErrorExtractor
-
Determines if the given exception indicates bad request.
- bucketName() - Method in class com.google.cloud.hadoop.util.AccessBoundary
- build() - Method in class com.google.cloud.hadoop.util.AsyncWriteChannelOptions.Builder
- build() - Method in class com.google.cloud.hadoop.util.RequesterPaysOptions.Builder
- build() - Method in class com.google.cloud.hadoop.util.RetryHttpInitializerOptions.Builder
- builder() - Static method in class com.google.cloud.hadoop.util.AsyncWriteChannelOptions
- builder() - Static method in class com.google.cloud.hadoop.util.RequesterPaysOptions
- builder() - Static method in class com.google.cloud.hadoop.util.RetryHttpInitializerOptions
- Builder() - Constructor for class com.google.cloud.hadoop.util.AsyncWriteChannelOptions.Builder
- Builder() - Constructor for class com.google.cloud.hadoop.util.RequesterPaysOptions.Builder
- Builder() - Constructor for class com.google.cloud.hadoop.util.RetryHttpInitializerOptions.Builder
C
- ChainingHttpRequestInitializer - Class in com.google.cloud.hadoop.util
-
HttpRequestInitializer
that composes handlers and interceptors supplied by component handlers. - ChainingHttpRequestInitializer(HttpRequestInitializer...) - Constructor for class com.google.cloud.hadoop.util.ChainingHttpRequestInitializer
- channelOptions - Variable in class com.google.cloud.hadoop.util.AbstractGoogleAsyncWriteChannel
- CheckedFunction<T,R,E extends Throwable> - Interface in com.google.cloud.hadoop.util
-
Represents a function that accepts one argument and produces a result that can throw checked exception.
- CHUNK_UPLOAD - com.google.cloud.hadoop.util.AsyncWriteChannelOptions.UploadType
- clientError(IOException) - Method in class com.google.cloud.hadoop.util.ApiErrorExtractor
-
Determines if the exception is a client error.
- ClientRequestHelper<S> - Class in com.google.cloud.hadoop.util
-
ClientRequestHelper provides wrapper methods around final methods of AbstractGoogleClientRequest to allow overriding them if necessary.
- ClientRequestHelper() - Constructor for class com.google.cloud.hadoop.util.ClientRequestHelper
- close() - Method in class com.google.cloud.hadoop.util.AbstractGoogleAsyncWriteChannel
-
Closes this channel.
- close() - Method in interface com.google.cloud.hadoop.util.ITraceOperation
- close() - Method in class com.google.cloud.hadoop.util.TraceOperation
- com.google.cloud.hadoop.util - package com.google.cloud.hadoop.util
- com.google.cloud.hadoop.util.interceptors - package com.google.cloud.hadoop.util.interceptors
- com.google.cloud.hadoop.util.testing - package com.google.cloud.hadoop.util.testing
- compose(Function<? super V, ? extends T>) - Method in interface com.google.cloud.hadoop.util.CheckedFunction
-
Returns a composed function that first applies the
before
function to its input, and then applies this function to the result. - create(HttpRequest) - Static method in class com.google.cloud.hadoop.util.RequestTracker
- create(String) - Static method in class com.google.cloud.hadoop.util.RedactedString
- create(String, String, AccessBoundary.Action) - Static method in class com.google.cloud.hadoop.util.AccessBoundary
- CREATE_BUCKETS - com.google.cloud.hadoop.util.AccessBoundary.Action
- createHttpTransport() - Static method in class com.google.cloud.hadoop.util.HttpTransportFactory
-
Create an
HttpTransport
with socketKeepAlive true - createHttpTransport(String, RedactedString, RedactedString) - Static method in class com.google.cloud.hadoop.util.HttpTransportFactory
-
Create an
HttpTransport
based on a type class and an optional HTTP proxy. - createHttpTransport(String, RedactedString, RedactedString, Duration) - Static method in class com.google.cloud.hadoop.util.HttpTransportFactory
-
Create an
HttpTransport
based on a type class, optional HTTP proxy and optional socket read timeout. - createNetHttpTransport(URI, PasswordAuthentication, Duration) - Static method in class com.google.cloud.hadoop.util.HttpTransportFactory
-
Create an
NetHttpTransport
for calling Google APIs with an optional HTTP proxy. - createRootWithLogging(String, Object) - Method in interface com.google.cloud.hadoop.util.ITraceFactory
- createRootWithLogging(String, Object) - Static method in class com.google.cloud.hadoop.util.TraceOperation
- current() - Static method in class com.google.cloud.hadoop.util.TraceOperation
- CUSTOM - com.google.cloud.hadoop.util.RequesterPaysOptions.RequesterPaysMode
D
- dataRangeResponse(byte[], long, long) - Static method in class com.google.cloud.hadoop.util.testing.MockHttpTransportHelper
- dataResponse(byte[]) - Static method in class com.google.cloud.hadoop.util.testing.MockHttpTransportHelper
- dataResponse(Map<String, Object>, byte[]) - Static method in class com.google.cloud.hadoop.util.testing.MockHttpTransportHelper
- DEFAULT - Static variable in class com.google.cloud.hadoop.util.AsyncWriteChannelOptions
- DEFAULT - Static variable in class com.google.cloud.hadoop.util.RequesterPaysOptions
- DEFAULT - Static variable in interface com.google.cloud.hadoop.util.RetryDeterminer
-
Retries exception when either
SOCKET_ERRORS
orSERVER_ERRORS
would retry. - DEFAULT - Static variable in class com.google.cloud.hadoop.util.RetryHttpInitializerOptions
- DELETE - com.google.cloud.hadoop.util.GcsJsonApiEvent.RequestType
- DELETE_BUCKETS - com.google.cloud.hadoop.util.AccessBoundary.Action
- DELETE_OBJECTS - com.google.cloud.hadoop.util.AccessBoundary.Action
- DISABLED - com.google.cloud.hadoop.util.RequesterPaysOptions.RequesterPaysMode
- DURATION - Static variable in class com.google.cloud.hadoop.util.GcsJsonApiEvent
E
- EDIT_OBJECTS - com.google.cloud.hadoop.util.AccessBoundary.Action
- emptyResponse(int) - Static method in class com.google.cloud.hadoop.util.testing.MockHttpTransportHelper
- ENABLED - com.google.cloud.hadoop.util.RequesterPaysOptions.RequesterPaysMode
- ErrorTypeExtractor - Interface in com.google.cloud.hadoop.util
-
Translates exceptions from API calls into ErrorType
- ErrorTypeExtractor.ErrorType - Enum in com.google.cloud.hadoop.util
- EXCEPTION - com.google.cloud.hadoop.util.GcsJsonApiEvent.EventType
- execute(Runnable) - Method in class com.google.cloud.hadoop.util.LazyExecutorService
-
Always throws a RejectedExecutionException because using this method does not make sense from either a lazy execution perspective or a cached result perspective.
F
- FAILED_PRECONDITION - com.google.cloud.hadoop.util.ErrorTypeExtractor.ErrorType
- FIELD_SIZE_TOO_LARGE_REASON - Static variable in class com.google.cloud.hadoop.util.ApiErrorExtractor
- fieldSizeTooLarge(IOException) - Method in class com.google.cloud.hadoop.util.ApiErrorExtractor
-
Determines if the given exception indicates 'field size too large'.
G
- GCCL_INVOCATION_ID_PREFIX - Static variable in class com.google.cloud.hadoop.util.interceptors.InvocationIdInterceptor
- GcsJsonApiEvent - Class in com.google.cloud.hadoop.util
- GcsJsonApiEvent(HttpRequest, GcsJsonApiEvent.EventType, Object) - Constructor for class com.google.cloud.hadoop.util.GcsJsonApiEvent
- GcsJsonApiEvent.EventType - Enum in com.google.cloud.hadoop.util
- GcsJsonApiEvent.RequestType - Enum in com.google.cloud.hadoop.util
- GcsRequestExecutionEvent - Class in com.google.cloud.hadoop.util
-
This an Event which is published in EvenBus queue whenever a gcs request is created/executed.
- GcsRequestExecutionEvent() - Constructor for class com.google.cloud.hadoop.util.GcsRequestExecutionEvent
- get(boolean) - Static method in class com.google.cloud.hadoop.util.TraceFactory
- GET_BUCKETS - com.google.cloud.hadoop.util.AccessBoundary.Action
- GET_MEDIA - com.google.cloud.hadoop.util.GcsJsonApiEvent.RequestType
- GET_METADATA - com.google.cloud.hadoop.util.GcsJsonApiEvent.RequestType
- GET_METADATA_OBJECTS - com.google.cloud.hadoop.util.AccessBoundary.Action
- GET_OTHER - com.google.cloud.hadoop.util.GcsJsonApiEvent.RequestType
- getBuckets() - Method in class com.google.cloud.hadoop.util.RequesterPaysOptions
- getBufferSize() - Method in class com.google.cloud.hadoop.util.AsyncWriteChannelOptions
- getChildTrace(ThreadTrace, String) - Static method in class com.google.cloud.hadoop.util.TraceOperation
- getConnectTimeout() - Method in class com.google.cloud.hadoop.util.RetryHttpInitializerOptions
-
A connection timeout - maximum time to wait until connection will be established.
- getContext() - Method in class com.google.cloud.hadoop.util.GcsJsonApiEvent
- getContext() - Method in interface com.google.cloud.hadoop.util.IGcsJsonApiEvent
- getCredentials() - Method in class com.google.cloud.hadoop.util.RetryHttpInitializer
- getDebugInfo(IOException) - Method in class com.google.cloud.hadoop.util.ApiErrorExtractor
- getDefaultUserAgent() - Method in class com.google.cloud.hadoop.util.RetryHttpInitializerOptions
-
A String to set as the user-agent when initializing an HTTP request if it doesn't already have a "User-Agent" header.
- getErrorCode() - Method in enum com.google.cloud.hadoop.util.testing.MockHttpTransportHelper.ErrorResponses
- getErrorDomain() - Method in enum com.google.cloud.hadoop.util.testing.MockHttpTransportHelper.ErrorResponses
- getErrorInfo(IOException) - Method in class com.google.cloud.hadoop.util.ApiErrorExtractor
-
Get the first ErrorInfo from an IOException if it is an instance of GoogleJsonResponseException, otherwise return null.
- getErrorMessage() - Method in enum com.google.cloud.hadoop.util.testing.MockHttpTransportHelper.ErrorResponses
- getErrorMessage(IOException) - Method in class com.google.cloud.hadoop.util.ApiErrorExtractor
-
Extracts the error message.
- getErrorReason() - Method in enum com.google.cloud.hadoop.util.testing.MockHttpTransportHelper.ErrorResponses
- getErrorType(Exception) - Method in interface com.google.cloud.hadoop.util.ErrorTypeExtractor
- getErrorType(Exception) - Method in class com.google.cloud.hadoop.util.GrpcErrorTypeExtractor
- getEventType() - Method in class com.google.cloud.hadoop.util.GcsJsonApiEvent
- getEventType() - Method in interface com.google.cloud.hadoop.util.IGcsJsonApiEvent
- getGrpcWriteMessageTimeout() - Method in class com.google.cloud.hadoop.util.AsyncWriteChannelOptions
- getGrpcWriteTimeout() - Method in class com.google.cloud.hadoop.util.AsyncWriteChannelOptions
- getHttpHeaders() - Method in class com.google.cloud.hadoop.util.RetryHttpInitializerOptions
-
An additional HTTP headers to set in an HTTP request.
- getHttpResponseException(Throwable) - Static method in class com.google.cloud.hadoop.util.ApiErrorExtractor
- getHttpStatusCode(HttpResponseException) - Method in class com.google.cloud.hadoop.util.ApiErrorExtractor
-
Returns HTTP status code from the given exception.
- getJsonError(IOException) - Method in class com.google.cloud.hadoop.util.ApiErrorExtractor
-
If the exception is a GoogleJsonResponseException, get the error details, else return null.
- getJsonResponseException(Throwable) - Static method in class com.google.cloud.hadoop.util.ApiErrorExtractor
- getMaxRequestRetries() - Method in class com.google.cloud.hadoop.util.RetryHttpInitializerOptions
-
A max number of retries for an HTTP request.
- getMethod() - Method in class com.google.cloud.hadoop.util.GcsJsonApiEvent
- getMethod() - Method in interface com.google.cloud.hadoop.util.IGcsJsonApiEvent
- getMode() - Method in class com.google.cloud.hadoop.util.RequesterPaysOptions
- getNumberOfBufferedRequests() - Method in class com.google.cloud.hadoop.util.AsyncWriteChannelOptions
- getPartFileCleanupType() - Method in class com.google.cloud.hadoop.util.AsyncWriteChannelOptions
- getPartFileNamePrefix() - Method in class com.google.cloud.hadoop.util.AsyncWriteChannelOptions
- getPCUBufferCapacity() - Method in class com.google.cloud.hadoop.util.AsyncWriteChannelOptions
- getPCUBufferCount() - Method in class com.google.cloud.hadoop.util.AsyncWriteChannelOptions
- getPipeBufferSize() - Method in class com.google.cloud.hadoop.util.AsyncWriteChannelOptions
- getPipeType() - Method in class com.google.cloud.hadoop.util.AsyncWriteChannelOptions
- getProjectId() - Method in class com.google.cloud.hadoop.util.RequesterPaysOptions
- getProperty(String) - Method in class com.google.cloud.hadoop.util.GcsJsonApiEvent
- getProperty(String) - Method in interface com.google.cloud.hadoop.util.IGcsJsonApiEvent
- getPropertyOrDefault(Class<?>, String, String, String) - Static method in class com.google.cloud.hadoop.util.PropertyUtil
-
Get the value of a property or a default value if there's an error retrieving the property key.
- getReadTimeout() - Method in class com.google.cloud.hadoop.util.RetryHttpInitializerOptions
-
A read timeout from an established connection - maximum time to wait for a read form an established connection to finish.
- getRequestHeaders(AbstractGoogleClientRequest<S>) - Method in class com.google.cloud.hadoop.util.ClientRequestHelper
-
Wraps AbstractGoogleClientRequest.getRequestHeaders().
- getRequestTracker(HttpRequest) - Method in class com.google.cloud.hadoop.util.RetryHttpInitializer
- getResourceString() - Method in class com.google.cloud.hadoop.util.AbstractGoogleAsyncWriteChannel
- getResponseCode() - Method in enum com.google.cloud.hadoop.util.testing.MockHttpTransportHelper.ErrorResponses
- getResponseEvent(HttpResponse, long, Object) - Static method in class com.google.cloud.hadoop.util.GcsJsonApiEvent
- getTemporaryPaths() - Method in class com.google.cloud.hadoop.util.AsyncWriteChannelOptions
- getTrace() - Method in interface com.google.cloud.hadoop.util.ITraceOperation
- getTrace() - Method in class com.google.cloud.hadoop.util.TraceOperation
- getTrackingId() - Method in class com.google.cloud.hadoop.util.ThreadTrace
- getTrackingId() - Static method in class com.google.cloud.hadoop.util.TraceOperation
- getUploadCacheSize() - Method in class com.google.cloud.hadoop.util.AsyncWriteChannelOptions
- getUploadChunkSize() - Method in class com.google.cloud.hadoop.util.AsyncWriteChannelOptions
- getUploadType() - Method in class com.google.cloud.hadoop.util.AsyncWriteChannelOptions
- GLOBAL_DOMAIN - Static variable in class com.google.cloud.hadoop.util.ApiErrorExtractor
- GONE - com.google.cloud.hadoop.util.testing.MockHttpTransportHelper.ErrorResponses
- GOOG_API_CLIENT - Static variable in class com.google.cloud.hadoop.util.interceptors.InvocationIdInterceptor
- GoogleCloudStorageEventBus - Class in com.google.cloud.hadoop.util
-
Event Bus class
- GoogleCloudStorageEventBus() - Constructor for class com.google.cloud.hadoop.util.GoogleCloudStorageEventBus
- GrpcErrorTypeExtractor - Class in com.google.cloud.hadoop.util
-
Implementation for
ErrorTypeExtractor
for exception specifically thrown from gRPC path.
H
- handleResponse(T) - Method in class com.google.cloud.hadoop.util.AbstractGoogleAsyncWriteChannel
-
Handle the API response.
- HttpTransportFactory - Class in com.google.cloud.hadoop.util
-
Factory for creating HttpTransport types.
- HttpTransportFactory() - Constructor for class com.google.cloud.hadoop.util.HttpTransportFactory
I
- identity() - Static method in interface com.google.cloud.hadoop.util.CheckedFunction
-
Returns a function that always returns its input argument.
- IGcsJsonApiEvent - Interface in com.google.cloud.hadoop.util
- init(HttpRequest) - Method in class com.google.cloud.hadoop.util.RequestTracker
- initialize() - Method in class com.google.cloud.hadoop.util.AbstractGoogleAsyncWriteChannel
-
Initialize this channel object for writing.
- initialize(HttpRequest) - Method in class com.google.cloud.hadoop.util.ChainingHttpRequestInitializer
- initialize(HttpRequest) - Method in class com.google.cloud.hadoop.util.RetryHttpInitializer
- inputStreamResponse(InputStream) - Static method in class com.google.cloud.hadoop.util.testing.MockHttpTransportHelper
- inputStreamResponse(String, Object, InputStream) - Static method in class com.google.cloud.hadoop.util.testing.MockHttpTransportHelper
- inputStreamResponse(Map<String, Object>, InputStream) - Static method in class com.google.cloud.hadoop.util.testing.MockHttpTransportHelper
- INSTANCE - Static variable in class com.google.cloud.hadoop.util.ApiErrorExtractor
-
Singleton instance of the ApiErrorExtractor.
- INSTANCE - Static variable in class com.google.cloud.hadoop.util.GrpcErrorTypeExtractor
- intercept(HttpRequest) - Method in class com.google.cloud.hadoop.util.interceptors.InvocationIdInterceptor
- internalServerError(IOException) - Method in class com.google.cloud.hadoop.util.ApiErrorExtractor
-
Determines if the exception is an internal server error.
- InvocationIdInterceptor - Class in com.google.cloud.hadoop.util.interceptors
-
HTTP request interceptor to attach unique identifier i.e.
- InvocationIdInterceptor(HttpExecuteInterceptor, RequestTracker) - Constructor for class com.google.cloud.hadoop.util.interceptors.InvocationIdInterceptor
- invokeAll(Collection<? extends Callable<T>>) - Method in class com.google.cloud.hadoop.util.LazyExecutorService
-
ExecutorService requires that this method should not return until all tasks are completed, which precludes lazy execution.
- invokeAll(Collection<? extends Callable<T>>, long, TimeUnit) - Method in class com.google.cloud.hadoop.util.LazyExecutorService
-
ExecutorService requires that this method should not return until all tasks are completed or the timeout expires, which precludes lazy execution.
- invokeAny(Collection<? extends Callable<T>>) - Method in class com.google.cloud.hadoop.util.LazyExecutorService
-
Always throws a RejectedExecutionException because using this method does not make sense from either a lazy execution perspective or a cached result perspective.
- invokeAny(Collection<? extends Callable<T>>, long, TimeUnit) - Method in class com.google.cloud.hadoop.util.LazyExecutorService
-
Always throws a RejectedExecutionException because using this method does not make sense from either a lazy execution perspective or a cached result perspective.
- IO_STREAM_PIPE - com.google.cloud.hadoop.util.AsyncWriteChannelOptions.PipeType
- IoExceptionHelper - Class in com.google.cloud.hadoop.util
-
Translates exceptions from API calls into higher-level meaning, while allowing injectability for testing how API errors are handled.
- isDirectUploadEnabled() - Method in class com.google.cloud.hadoop.util.AbstractGoogleAsyncWriteChannel
-
Returns true if direct media uploads are enabled.
- isDirectUploadEnabled() - Method in class com.google.cloud.hadoop.util.AsyncWriteChannelOptions
- isGrpcChecksumsEnabled() - Method in class com.google.cloud.hadoop.util.AsyncWriteChannelOptions
- isIoError(Throwable) - Static method in class com.google.cloud.hadoop.util.IoExceptionHelper
-
Determines if a given
Throwable
is caused by an IO error. - isOpen() - Method in class com.google.cloud.hadoop.util.AbstractGoogleAsyncWriteChannel
-
Tells whether this channel is open.
- isReadTimedOut(IOException) - Static method in class com.google.cloud.hadoop.util.IoExceptionHelper
-
Determines if a given
IOException
is caused by a timed out read. - isShutdown() - Method in class com.google.cloud.hadoop.util.LazyExecutorService
- isSocketError(Throwable) - Static method in class com.google.cloud.hadoop.util.IoExceptionHelper
-
Determines if a given
Throwable
is caused by a socket error. - isTerminated() - Method in class com.google.cloud.hadoop.util.LazyExecutorService
- itemAlreadyExists(IOException) - Method in class com.google.cloud.hadoop.util.ApiErrorExtractor
-
Determines if the given exception indicates 'item already exists'.
- itemNotFound(IOException) - Method in class com.google.cloud.hadoop.util.ApiErrorExtractor
-
Determines if the given exception indicates 'item not found'.
- ITraceFactory - Interface in com.google.cloud.hadoop.util
- ITraceOperation - Interface in com.google.cloud.hadoop.util
J
- JOURNALING - com.google.cloud.hadoop.util.AsyncWriteChannelOptions.UploadType
- jsonDataResponse(Object) - Static method in class com.google.cloud.hadoop.util.testing.MockHttpTransportHelper
- jsonErrorResponse(MockHttpTransportHelper.ErrorResponses) - Static method in class com.google.cloud.hadoop.util.testing.MockHttpTransportHelper
L
- LazyExecutorService - Class in com.google.cloud.hadoop.util
-
Defers execution to the time that a method that expresses interest in the result (get or isDone) is called on the Future.
- LazyExecutorService() - Constructor for class com.google.cloud.hadoop.util.LazyExecutorService
-
Creates an instance using a
MoreExecutors.newDirectExecutorService()
for the backing service. - LazyExecutorService(ExecutorService) - Constructor for class com.google.cloud.hadoop.util.LazyExecutorService
-
Creates an instance using the given
ExecutorService
as the backing service. - LIST_BUCKETS - com.google.cloud.hadoop.util.AccessBoundary.Action
- LIST_DIR - com.google.cloud.hadoop.util.GcsJsonApiEvent.RequestType
- LIST_FILE - com.google.cloud.hadoop.util.GcsJsonApiEvent.RequestType
- LIST_OBJECTS - com.google.cloud.hadoop.util.AccessBoundary.Action
- logger - Static variable in class com.google.cloud.hadoop.util.AbstractGoogleAsyncWriteChannel
- LoggingMediaHttpUploaderProgressListener - Class in com.google.cloud.hadoop.util
-
Logs the status of uploads.
- LoggingMediaHttpUploaderProgressListener(String, long) - Constructor for class com.google.cloud.hadoop.util.LoggingMediaHttpUploaderProgressListener
-
Creates a upload progress listener that emits relevant statistics about the progress of the upload.
M
- mockBatchTransport(int, LowLevelHttpResponse...) - Static method in class com.google.cloud.hadoop.util.testing.MockHttpTransportHelper
- MockHttpTransportHelper - Class in com.google.cloud.hadoop.util.testing
-
Utility methods for testing with
MockHttpTransport
- MockHttpTransportHelper.ErrorResponses - Enum in com.google.cloud.hadoop.util.testing
-
HTTP JSON API error responses
- mockTransport(Object...) - Static method in class com.google.cloud.hadoop.util.testing.MockHttpTransportHelper
N
- NEVER - com.google.cloud.hadoop.util.AsyncWriteChannelOptions.PartFileCleanupType
- nextBackOffMillis() - Method in class com.google.cloud.hadoop.util.RetryBoundedBackOff
- nextSleep(BackOff, Sleeper, Exception) - Static method in class com.google.cloud.hadoop.util.ResilientOperation
-
Determines the amount to sleep for and sleeps if needed.
- NIO_CHANNEL_PIPE - com.google.cloud.hadoop.util.AsyncWriteChannelOptions.PipeType
- NOT_FOUND - com.google.cloud.hadoop.util.ErrorTypeExtractor.ErrorType
- NOT_FOUND - com.google.cloud.hadoop.util.testing.MockHttpTransportHelper.ErrorResponses
O
- objectName() - Method in class com.google.cloud.hadoop.util.AccessBoundary
- ON_SUCCESS - com.google.cloud.hadoop.util.AsyncWriteChannelOptions.PartFileCleanupType
- onGcsRequest(GcsRequestExecutionEvent) - Static method in class com.google.cloud.hadoop.util.GoogleCloudStorageEventBus
-
Posting Gcs request execution event i.e.
- onGrpcStatus(Status) - Static method in class com.google.cloud.hadoop.util.GoogleCloudStorageEventBus
-
Posting grpc Status to invoke the corresponding Subscriber method.
- OTHER - com.google.cloud.hadoop.util.GcsJsonApiEvent.RequestType
- OUT_OF_RANGE - com.google.cloud.hadoop.util.ErrorTypeExtractor.ErrorType
P
- PARALLEL_COMPOSITE_UPLOAD - com.google.cloud.hadoop.util.AsyncWriteChannelOptions.UploadType
- PATCH - com.google.cloud.hadoop.util.GcsJsonApiEvent.RequestType
- POST - com.google.cloud.hadoop.util.GcsJsonApiEvent.RequestType
- postGcsJsonApiEvent(IGcsJsonApiEvent) - Static method in class com.google.cloud.hadoop.util.GoogleCloudStorageEventBus
- postOnException() - Static method in class com.google.cloud.hadoop.util.GoogleCloudStorageEventBus
-
Posting Exception to invoke corresponding Subscriber method.
- postToEventQueue(GcsJsonApiEvent) - Method in class com.google.cloud.hadoop.util.RequestTracker
- preconditionNotMet(IOException) - Method in class com.google.cloud.hadoop.util.ApiErrorExtractor
-
Determines if the given IOException indicates 'precondition not met' Recursively checks getCause() if outer exception isn't an instance of the correct class.
- progressChanged(MediaHttpUploader) - Method in class com.google.cloud.hadoop.util.LoggingMediaHttpUploaderProgressListener
- PropertyUtil - Class in com.google.cloud.hadoop.util
-
Helpers for interacting with properties files
- PropertyUtil() - Constructor for class com.google.cloud.hadoop.util.PropertyUtil
- PUT - com.google.cloud.hadoop.util.GcsJsonApiEvent.RequestType
Q
- QUOTA_EXCEEDED_REASON - Static variable in class com.google.cloud.hadoop.util.ApiErrorExtractor
- quotaExceeded(IOException) - Method in class com.google.cloud.hadoop.util.ApiErrorExtractor
-
Determines if a given Throwable is caused by Quota Exceeded.
R
- RANGE_NOT_SATISFIABLE - com.google.cloud.hadoop.util.testing.MockHttpTransportHelper.ErrorResponses
- rangeNotSatisfiable(IOException) - Method in class com.google.cloud.hadoop.util.ApiErrorExtractor
-
Determines if the given exception indicates 'range not satisfiable'.
- RATE_LIMIT_ERRORS - Static variable in interface com.google.cloud.hadoop.util.RetryDeterminer
-
A rate limited determiner that uses a default
ApiErrorExtractor
. - RATE_LIMITED - com.google.cloud.hadoop.util.testing.MockHttpTransportHelper.ErrorResponses
- RATE_LIMITED_REASON - Static variable in class com.google.cloud.hadoop.util.ApiErrorExtractor
- rateLimited(IOException) - Method in class com.google.cloud.hadoop.util.ApiErrorExtractor
-
Determines if a given Throwable is caused by a rate limit being applied.
- READ_OBJECTS - com.google.cloud.hadoop.util.AccessBoundary.Action
- recursiveCheckForCode(IOException, int) - Method in class com.google.cloud.hadoop.util.ApiErrorExtractor
-
Recursively checks getCause() if outer exception isn't an instance of the correct class.
- RedactedString - Class in com.google.cloud.hadoop.util
-
Holder class for string values that should not be logged and displayed when
toString
method called. - RedactedString() - Constructor for class com.google.cloud.hadoop.util.RedactedString
- register(Object) - Static method in class com.google.cloud.hadoop.util.GoogleCloudStorageEventBus
-
Method to register an obj to event bus
- REQUEST_TYPE - Static variable in class com.google.cloud.hadoop.util.GcsJsonApiEvent
- RequesterPaysOptions - Class in com.google.cloud.hadoop.util
-
Options for the GCS Requester Pays feature.
- RequesterPaysOptions() - Constructor for class com.google.cloud.hadoop.util.RequesterPaysOptions
- RequesterPaysOptions.Builder - Class in com.google.cloud.hadoop.util
-
Builder for
RequesterPaysOptions
- RequesterPaysOptions.RequesterPaysMode - Enum in com.google.cloud.hadoop.util
-
Operational modes of GCS Requester Pays feature.
- requestFailure(IOException) - Method in class com.google.cloud.hadoop.util.ApiErrorExtractor
-
Determines if the given exception indicates intermittent request failure or failure caused by user error.
- RequestTracker - Class in com.google.cloud.hadoop.util
- RequestTracker() - Constructor for class com.google.cloud.hadoop.util.RequestTracker
- reset() - Method in class com.google.cloud.hadoop.util.RetryBoundedBackOff
- ResilientOperation - Class in com.google.cloud.hadoop.util
-
A class which defines static functions to be called to make a user-provided function more resilient by attempting retries.
- ResilientOperation() - Constructor for class com.google.cloud.hadoop.util.ResilientOperation
- RESOURCE_NOT_READY_REASON - Static variable in class com.google.cloud.hadoop.util.ApiErrorExtractor
- resourceNotReady(IOException) - Method in class com.google.cloud.hadoop.util.ApiErrorExtractor
-
Determines if the given exception indicates 'resource not ready'.
- RESPONSE - com.google.cloud.hadoop.util.GcsJsonApiEvent.EventType
- retry(Callable<T>, BackOff, RetryDeterminer<? super X>, Class<X>) - Static method in class com.google.cloud.hadoop.util.ResilientOperation
-
Retries the given executable function in the case of transient errors defined by the RetryDeterminer and uses default sleeper.
- retry(Callable<T>, BackOff, RetryDeterminer<? super X>, Class<X>, Sleeper) - Static method in class com.google.cloud.hadoop.util.ResilientOperation
-
Retries the given executable function in the case of transient errors defined by the RetryDeterminer.
- RETRY_COUNT - Static variable in class com.google.cloud.hadoop.util.GcsJsonApiEvent
- RETRY_SKIPPED - com.google.cloud.hadoop.util.GcsJsonApiEvent.EventType
- RetryBoundedBackOff - Class in com.google.cloud.hadoop.util
-
An implementation of
BackOff
that limits the number of calls on anotherBackOff
. - RetryBoundedBackOff(BackOff, int) - Constructor for class com.google.cloud.hadoop.util.RetryBoundedBackOff
-
RetryBoundedBackOff takes a
BackOff
and limits the retries. - RetryDeterminer<X extends Exception> - Interface in com.google.cloud.hadoop.util
-
This abstract class is designed to tell if an exception is transient and should result in a retry or not, and should result in a returned exception to the caller.
- RetryHttpInitializer - Class in com.google.cloud.hadoop.util
-
An implementation of
HttpRequestInitializer
with retries. - RetryHttpInitializer(Credentials, RetryHttpInitializerOptions) - Constructor for class com.google.cloud.hadoop.util.RetryHttpInitializer
- RetryHttpInitializerOptions - Class in com.google.cloud.hadoop.util
-
Options for the
RetryHttpInitializer
class. - RetryHttpInitializerOptions() - Constructor for class com.google.cloud.hadoop.util.RetryHttpInitializerOptions
- RetryHttpInitializerOptions.Builder - Class in com.google.cloud.hadoop.util
-
Builder for
RetryHttpInitializerOptions
S
- SERVER_ERROR - com.google.cloud.hadoop.util.testing.MockHttpTransportHelper.ErrorResponses
- SERVER_ERRORS - Static variable in interface com.google.cloud.hadoop.util.RetryDeterminer
-
Server errors RetryDeterminer decides to retry on HttpResponseExceptions that return a 500.
- setBuckets(String...) - Method in class com.google.cloud.hadoop.util.RequesterPaysOptions.Builder
- setBuckets(Collection<String>) - Method in class com.google.cloud.hadoop.util.RequesterPaysOptions.Builder
- setBufferSize(int) - Method in class com.google.cloud.hadoop.util.AsyncWriteChannelOptions.Builder
- setChunkSize(AbstractGoogleClientRequest<S>, int) - Method in class com.google.cloud.hadoop.util.ClientRequestHelper
-
Wraps AbstractGoogleClientRequest.getMediaHttpUploader().
- setConnectTimeout(Duration) - Method in class com.google.cloud.hadoop.util.RetryHttpInitializerOptions.Builder
- setDefaultUserAgent(String) - Method in class com.google.cloud.hadoop.util.RetryHttpInitializerOptions.Builder
- setDirectUploadEnabled(boolean) - Method in class com.google.cloud.hadoop.util.AsyncWriteChannelOptions.Builder
- setDirectUploadEnabled(AbstractGoogleClientRequest<S>, boolean) - Method in class com.google.cloud.hadoop.util.ClientRequestHelper
-
Configures the
clientRequest
to enable/disable direct (single-request) uploads according toenable
. - setGrpcChecksumsEnabled(boolean) - Method in class com.google.cloud.hadoop.util.AsyncWriteChannelOptions.Builder
-
Enable gRPC checksumming.
- setGrpcWriteMessageTimeout(Duration) - Method in class com.google.cloud.hadoop.util.AsyncWriteChannelOptions.Builder
- setGrpcWriteTimeout(Duration) - Method in class com.google.cloud.hadoop.util.AsyncWriteChannelOptions.Builder
- setHttpHeaders(Map<String, String>) - Method in class com.google.cloud.hadoop.util.RetryHttpInitializerOptions.Builder
- setMaxRequestRetries(int) - Method in class com.google.cloud.hadoop.util.RetryHttpInitializerOptions.Builder
- setMode(RequesterPaysOptions.RequesterPaysMode) - Method in class com.google.cloud.hadoop.util.RequesterPaysOptions.Builder
- setNumberOfBufferedRequests(int) - Method in class com.google.cloud.hadoop.util.AsyncWriteChannelOptions.Builder
- setPartFileCleanupType(AsyncWriteChannelOptions.PartFileCleanupType) - Method in class com.google.cloud.hadoop.util.AsyncWriteChannelOptions.Builder
- setPartFileNamePrefix(String) - Method in class com.google.cloud.hadoop.util.AsyncWriteChannelOptions.Builder
- setPCUBufferCapacity(int) - Method in class com.google.cloud.hadoop.util.AsyncWriteChannelOptions.Builder
- setPCUBufferCount(int) - Method in class com.google.cloud.hadoop.util.AsyncWriteChannelOptions.Builder
- setPipeBufferSize(int) - Method in class com.google.cloud.hadoop.util.AsyncWriteChannelOptions.Builder
- setPipeType(AsyncWriteChannelOptions.PipeType) - Method in class com.google.cloud.hadoop.util.AsyncWriteChannelOptions.Builder
- setProjectId(String) - Method in class com.google.cloud.hadoop.util.RequesterPaysOptions.Builder
- setReadTimeout(Duration) - Method in class com.google.cloud.hadoop.util.RetryHttpInitializerOptions.Builder
- setTemporaryPaths(ImmutableSet<String>) - Method in class com.google.cloud.hadoop.util.AsyncWriteChannelOptions.Builder
- setUploadCacheSize(int) - Method in class com.google.cloud.hadoop.util.AsyncWriteChannelOptions.Builder
- setUploadChunkSize(int) - Method in class com.google.cloud.hadoop.util.AsyncWriteChannelOptions.Builder
- setUploadType(AsyncWriteChannelOptions.UploadType) - Method in class com.google.cloud.hadoop.util.AsyncWriteChannelOptions.Builder
- shouldRetry(X) - Method in interface com.google.cloud.hadoop.util.RetryDeterminer
-
Determines if we should attempt a retry depending on the caught exception.
- shutdown() - Method in class com.google.cloud.hadoop.util.LazyExecutorService
-
Shuts this service down, but leaves the backing service untouched.
- shutdownNow() - Method in class com.google.cloud.hadoop.util.LazyExecutorService
-
Trying to interpret the assumptions about the contract of this method in the light of this implementation, it seems most reasonable to take the view that all tasks are running, even if the processing has not actually started.
- SOCKET_ERRORS - Static variable in interface com.google.cloud.hadoop.util.RetryDeterminer
-
Socket errors retry determiner retries on socket exceptions.
- STARTED - com.google.cloud.hadoop.util.GcsJsonApiEvent.EventType
- startUpload(InputStream) - Method in class com.google.cloud.hadoop.util.AbstractGoogleAsyncWriteChannel
-
Create a new thread which handles the upload.
- STATUS_CODE - Static variable in class com.google.cloud.hadoop.util.GcsJsonApiEvent
- STATUS_CODE_RANGE_NOT_SATISFIABLE - Static variable in class com.google.cloud.hadoop.util.ApiErrorExtractor
- submit(Runnable) - Method in class com.google.cloud.hadoop.util.LazyExecutorService
- submit(Runnable, T) - Method in class com.google.cloud.hadoop.util.LazyExecutorService
- submit(Callable<T>) - Method in class com.google.cloud.hadoop.util.LazyExecutorService
T
- threadPool - Variable in class com.google.cloud.hadoop.util.AbstractGoogleAsyncWriteChannel
- ThreadTrace - Class in com.google.cloud.hadoop.util
-
Helps track a request.
- ThreadTrace(String) - Constructor for class com.google.cloud.hadoop.util.ThreadTrace
- toBuilder() - Method in class com.google.cloud.hadoop.util.AsyncWriteChannelOptions
- toBuilder() - Method in class com.google.cloud.hadoop.util.RequesterPaysOptions
- toBuilder() - Method in class com.google.cloud.hadoop.util.RetryHttpInitializerOptions
- toString() - Method in class com.google.cloud.hadoop.util.GcsJsonApiEvent
- toString() - Method in class com.google.cloud.hadoop.util.RedactedString
- toString() - Method in class com.google.cloud.hadoop.util.RequestTracker
- toString() - Method in class com.google.cloud.hadoop.util.ThreadTrace
- toUserPresentableException(IOException, String) - Method in class com.google.cloud.hadoop.util.ApiErrorExtractor
-
Converts the exception to a user-presentable error message.
- toUserPresentableMessage(IOException) - Method in class com.google.cloud.hadoop.util.ApiErrorExtractor
- toUserPresentableMessage(IOException, String) - Method in class com.google.cloud.hadoop.util.ApiErrorExtractor
-
Converts the exception to a user-presentable error message.
- TraceFactory - Class in com.google.cloud.hadoop.util
- TraceOperation - Class in com.google.cloud.hadoop.util
-
Helps trace a block of code.
U
- unauthorized(IOException) - Method in class com.google.cloud.hadoop.util.ApiErrorExtractor
-
Determines if the given exception indicates the request was unauthenticated.
- UNKNOWN - com.google.cloud.hadoop.util.ErrorTypeExtractor.ErrorType
- unregister(Object) - Static method in class com.google.cloud.hadoop.util.GoogleCloudStorageEventBus
-
Method to unregister an obj to event bus
- UNSPECIFIED_ACTION - com.google.cloud.hadoop.util.AccessBoundary.Action
- uploadOperation - Variable in class com.google.cloud.hadoop.util.AbstractGoogleAsyncWriteChannel
- USAGE_LIMITS_DOMAIN - Static variable in class com.google.cloud.hadoop.util.ApiErrorExtractor
- USER_PROJECT_MISSING_MESSAGE - Static variable in class com.google.cloud.hadoop.util.ApiErrorExtractor
- USER_RATE_LIMITED_REASON - Static variable in class com.google.cloud.hadoop.util.ApiErrorExtractor
- userProjectMissing(IOException) - Method in class com.google.cloud.hadoop.util.ApiErrorExtractor
-
Determines if the given exception indicates that 'userProject' is missing in request.
V
- value() - Method in class com.google.cloud.hadoop.util.RedactedString
- valueOf(String) - Static method in enum com.google.cloud.hadoop.util.AccessBoundary.Action
-
Returns the enum constant of this type with the specified name.
- valueOf(String) - Static method in enum com.google.cloud.hadoop.util.AsyncWriteChannelOptions.PartFileCleanupType
-
Returns the enum constant of this type with the specified name.
- valueOf(String) - Static method in enum com.google.cloud.hadoop.util.AsyncWriteChannelOptions.PipeType
-
Returns the enum constant of this type with the specified name.
- valueOf(String) - Static method in enum com.google.cloud.hadoop.util.AsyncWriteChannelOptions.UploadType
-
Returns the enum constant of this type with the specified name.
- valueOf(String) - Static method in enum com.google.cloud.hadoop.util.ErrorTypeExtractor.ErrorType
-
Returns the enum constant of this type with the specified name.
- valueOf(String) - Static method in enum com.google.cloud.hadoop.util.GcsJsonApiEvent.EventType
-
Returns the enum constant of this type with the specified name.
- valueOf(String) - Static method in enum com.google.cloud.hadoop.util.GcsJsonApiEvent.RequestType
-
Returns the enum constant of this type with the specified name.
- valueOf(String) - Static method in enum com.google.cloud.hadoop.util.RequesterPaysOptions.RequesterPaysMode
-
Returns the enum constant of this type with the specified name.
- valueOf(String) - Static method in enum com.google.cloud.hadoop.util.testing.MockHttpTransportHelper.ErrorResponses
-
Returns the enum constant of this type with the specified name.
- values() - Static method in enum com.google.cloud.hadoop.util.AccessBoundary.Action
-
Returns an array containing the constants of this enum type, in the order they are declared.
- values() - Static method in enum com.google.cloud.hadoop.util.AsyncWriteChannelOptions.PartFileCleanupType
-
Returns an array containing the constants of this enum type, in the order they are declared.
- values() - Static method in enum com.google.cloud.hadoop.util.AsyncWriteChannelOptions.PipeType
-
Returns an array containing the constants of this enum type, in the order they are declared.
- values() - Static method in enum com.google.cloud.hadoop.util.AsyncWriteChannelOptions.UploadType
-
Returns an array containing the constants of this enum type, in the order they are declared.
- values() - Static method in enum com.google.cloud.hadoop.util.ErrorTypeExtractor.ErrorType
-
Returns an array containing the constants of this enum type, in the order they are declared.
- values() - Static method in enum com.google.cloud.hadoop.util.GcsJsonApiEvent.EventType
-
Returns an array containing the constants of this enum type, in the order they are declared.
- values() - Static method in enum com.google.cloud.hadoop.util.GcsJsonApiEvent.RequestType
-
Returns an array containing the constants of this enum type, in the order they are declared.
- values() - Static method in enum com.google.cloud.hadoop.util.RequesterPaysOptions.RequesterPaysMode
-
Returns an array containing the constants of this enum type, in the order they are declared.
- values() - Static method in enum com.google.cloud.hadoop.util.testing.MockHttpTransportHelper.ErrorResponses
-
Returns an array containing the constants of this enum type, in the order they are declared.
W
- write(ByteBuffer) - Method in class com.google.cloud.hadoop.util.AbstractGoogleAsyncWriteChannel
-
Writes contents of the given buffer to this channel.
- WRITE_OBJECTS - com.google.cloud.hadoop.util.AccessBoundary.Action
- WRITE_TO_DISK_THEN_UPLOAD - com.google.cloud.hadoop.util.AsyncWriteChannelOptions.UploadType
All Classes All Packages