Index (gcs-connector-hadoop2 hadoop2-2.0.0 API)

A B C D E F G H I L M O P R S T U V W

A

AbstractDelegationTokenBinding - Class in com.google.cloud.hadoop.fs.gcs.auth: Binds file system with service and access token provider
AbstractDelegationTokenBinding(Text) - Constructor for class com.google.cloud.hadoop.fs.gcs.auth.AbstractDelegationTokenBinding
AbstractDelegationTokenBinding.TokenSecretManager - Class in com.google.cloud.hadoop.fs.gcs.auth: The secret manager always uses the same secret; the factory for new identifiers is that of the token manager.
append(Path, int, Progressable) - Method in class com.google.cloud.hadoop.fs.gcs.GoogleHadoopFileSystemBase: Appends to an existing file (optional operation).
AUTH_CLIENT_ID - Static variable in class com.google.cloud.hadoop.fs.gcs.GoogleHadoopFileSystemConfiguration: Configuration key for GCS client ID.
AUTH_CLIENT_SECRET - Static variable in class com.google.cloud.hadoop.fs.gcs.GoogleHadoopFileSystemConfiguration: Configuration key for GCS client secret.
AUTH_SERVICE_ACCOUNT_EMAIL - Static variable in class com.google.cloud.hadoop.fs.gcs.GoogleHadoopFileSystemConfiguration: Configuration key specifying the email address of the service-account with which to authenticate.
AUTH_SERVICE_ACCOUNT_ENABLE - Static variable in class com.google.cloud.hadoop.fs.gcs.GoogleHadoopFileSystemConfiguration: Configuration key for enabling GCE service account authentication.
AUTH_SERVICE_ACCOUNT_KEY_FILE - Static variable in class com.google.cloud.hadoop.fs.gcs.GoogleHadoopFileSystemConfiguration: Configuration key specifying local file containing a service-account private .p12 keyfile.
AUTHENTICATION_PREFIX - Static variable in class com.google.cloud.hadoop.fs.gcs.GoogleHadoopFileSystemBase: Prefix to use for common authentication keys.

B

bindToAnyDelegationToken() - Method in class com.google.cloud.hadoop.fs.gcs.auth.GcsDelegationTokens: Attempt to bind to any existing DT, including unmarshalling its contents and creating the GCP credential provider used to authenticate the client.
bindToDelegationToken(Token<DelegationTokenIdentifier>) - Method in class com.google.cloud.hadoop.fs.gcs.auth.GcsDelegationTokens: Bind to a delegation token retrieved for this filesystem.
bindToFileSystem(GoogleHadoopFileSystemBase, Text) - Method in class com.google.cloud.hadoop.fs.gcs.auth.AbstractDelegationTokenBinding: Bind to the filesystem.
bindToFileSystem(GoogleHadoopFileSystemBase, Text) - Method in class com.google.cloud.hadoop.fs.gcs.auth.GcsDelegationTokens: Bind to the filesystem.
bindToTokenIdentifier(DelegationTokenIdentifier) - Method in class com.google.cloud.hadoop.fs.gcs.auth.AbstractDelegationTokenBinding: Bind to the token identifier, returning the credential providers to use for the owner to talk to GCP services.
BLOCK_SIZE - Static variable in class com.google.cloud.hadoop.fs.gcs.GoogleHadoopFileSystemConfiguration: Configuration key for default block size of a file.

C

checkPath(Path) - Method in class com.google.cloud.hadoop.fs.gcs.GoogleHadoopFileSystem
checkPath(Path) - Method in class com.google.cloud.hadoop.fs.gcs.GoogleHadoopFileSystemBase
checkPath(Path) - Method in class com.google.cloud.hadoop.fs.gcs.GoogleHadoopFS: Only accept valid AbstractFileSystem and GoogleHadoopFileSystem Paths.
close() - Method in class com.google.cloud.hadoop.fs.gcs.GoogleHadoopFileSystemBase
close() - Method in class com.google.cloud.hadoop.fs.gcs.GoogleHadoopSyncableOutputStream
com.google.cloud.hadoop.fs.gcs - package com.google.cloud.hadoop.fs.gcs
com.google.cloud.hadoop.fs.gcs.auth - package com.google.cloud.hadoop.fs.gcs.auth
completeLocalOutput(Path, Path) - Method in class com.google.cloud.hadoop.fs.gcs.GoogleHadoopFileSystemBase
concat(Path, Path[]) - Method in class com.google.cloud.hadoop.fs.gcs.GoogleHadoopFileSystemBase: Concat existing files into one file.
configureBuckets(GoogleCloudStorageFileSystem) - Method in class com.google.cloud.hadoop.fs.gcs.GoogleHadoopFileSystem: Sets and validates the root bucket.
configureBuckets(GoogleCloudStorageFileSystem) - Method in class com.google.cloud.hadoop.fs.gcs.GoogleHadoopFileSystemBase: Validates and possibly creates buckets needed by subclass.
convertTokenIdentifier(DelegationTokenIdentifier, Class<T>) - Method in class com.google.cloud.hadoop.fs.gcs.auth.AbstractDelegationTokenBinding: Verify that a token identifier is of a specific class.
CoopLockFsck - Class in com.google.cloud.hadoop.fs.gcs: FSCK tool to recover failed directory mutations guarded by GCS Connector Cooperative Locking feature.
CoopLockFsck() - Constructor for class com.google.cloud.hadoop.fs.gcs.CoopLockFsck
copyFromLocalFile(boolean, boolean, Path[], Path) - Method in class com.google.cloud.hadoop.fs.gcs.GoogleHadoopFileSystemBase
copyFromLocalFile(boolean, boolean, Path, Path) - Method in class com.google.cloud.hadoop.fs.gcs.GoogleHadoopFileSystemBase
copyToLocalFile(boolean, Path, Path) - Method in class com.google.cloud.hadoop.fs.gcs.GoogleHadoopFileSystemBase
counters - Variable in class com.google.cloud.hadoop.fs.gcs.GoogleHadoopFileSystemBase: Map of counter values
create(Path, FsPermission, boolean, int, short, long, Progressable) - Method in class com.google.cloud.hadoop.fs.gcs.GoogleHadoopFileSystemBase: Opens the given file for writing.
createCounterMap() - Method in class com.google.cloud.hadoop.fs.gcs.GoogleHadoopFileSystemBase
createDelegationToken(String) - Method in class com.google.cloud.hadoop.fs.gcs.auth.AbstractDelegationTokenBinding: Create a delegation token for the user.
createEmptyIdentifier() - Method in class com.google.cloud.hadoop.fs.gcs.auth.AbstractDelegationTokenBinding: Create a new "empty" token identifier.
createIdentifier() - Method in class com.google.cloud.hadoop.fs.gcs.auth.AbstractDelegationTokenBinding.TokenSecretManager
createInternal(Path, EnumSet<CreateFlag>, FsPermission, int, short, long, Progressable, Options.ChecksumOpt, boolean) - Method in class com.google.cloud.hadoop.fs.gcs.GoogleHadoopFS
createNonRecursive(Path, FsPermission, EnumSet<CreateFlag>, int, short, long, Progressable) - Method in class com.google.cloud.hadoop.fs.gcs.GoogleHadoopFileSystemBase
createPassword(DelegationTokenIdentifier) - Method in class com.google.cloud.hadoop.fs.gcs.auth.AbstractDelegationTokenBinding.TokenSecretManager
createTokenIdentifier(Text) - Method in class com.google.cloud.hadoop.fs.gcs.auth.AbstractDelegationTokenBinding: Create a token identifier with all the information needed to be included in a delegation token.
createTokenIdentifier() - Method in class com.google.cloud.hadoop.fs.gcs.auth.AbstractDelegationTokenBinding: Create a token identifier with all the information needed to be included in a delegation token.

D

DEFAULT_FILTER - Static variable in class com.google.cloud.hadoop.fs.gcs.GoogleHadoopFileSystemBase: Default PathFilter that accepts all paths.
defaultBlockSize - Variable in class com.google.cloud.hadoop.fs.gcs.GoogleHadoopFileSystemBase: Default block size.
DELEGATION_TOKEN_BINDING_CLASS - Static variable in class com.google.cloud.hadoop.fs.gcs.GoogleHadoopFileSystemConfiguration: Configuration key for Delegation Token binding class.
DelegationTokenIOException - Exception in com.google.cloud.hadoop.fs.gcs.auth: General IOException for Delegation Token issues.
DelegationTokenIOException(String) - Constructor for exception com.google.cloud.hadoop.fs.gcs.auth.DelegationTokenIOException
DelegationTokenIOException(String, Throwable) - Constructor for exception com.google.cloud.hadoop.fs.gcs.auth.DelegationTokenIOException
delegationTokens - Variable in class com.google.cloud.hadoop.fs.gcs.GoogleHadoopFileSystemBase: Delegation token support
delete(Path, boolean) - Method in class com.google.cloud.hadoop.fs.gcs.GoogleHadoopFileSystemBase: Deletes the given file or directory.
delete(Path, boolean) - Method in class com.google.cloud.hadoop.fs.gcs.GoogleHadoopFS
deleteOnExit(Path) - Method in class com.google.cloud.hadoop.fs.gcs.GoogleHadoopFileSystemBase
deployUnbonded() - Method in class com.google.cloud.hadoop.fs.gcs.auth.AbstractDelegationTokenBinding: Perform any actions when deploying unbonded, and return a list of credential providers.
deployUnbonded() - Method in class com.google.cloud.hadoop.fs.gcs.auth.GcsDelegationTokens: Perform the unbonded deployment operations.

E

extractIdentifier(Token<? extends DelegationTokenIdentifier>) - Static method in class com.google.cloud.hadoop.fs.gcs.auth.GcsDelegationTokens: From a token, get the session token identifier.

F

FileSystemDescriptor - Interface in com.google.cloud.hadoop.fs.gcs: FileSystemDescriptor defines the interface containing all the methods which are necessary to differentiate the behavior of different Hadoop FileSystem implementations, including the URI scheme with which an implementation is identified.

G

GCE_BUCKET_DELETE_ENABLE - Static variable in class com.google.cloud.hadoop.fs.gcs.GoogleHadoopFileSystemConfiguration: If true, recursive delete on a path that refers to a GCS bucket itself ('/' for any bucket-rooted GoogleHadoopFileSystem) or delete on that path when it's empty will result in fully deleting the GCS bucket.
GCS_APPLICATION_NAME_SUFFIX - Static variable in class com.google.cloud.hadoop.fs.gcs.GoogleHadoopFileSystemConfiguration: Configuration key for adding a suffix to the GHFS application name sent to GCS.
GCS_BATCH_THREADS - Static variable in class com.google.cloud.hadoop.fs.gcs.GoogleHadoopFileSystemConfiguration: Configuration key for a number of threads to execute batch requests.
GCS_CONCURRENT_GLOB_ENABLE - Static variable in class com.google.cloud.hadoop.fs.gcs.GoogleHadoopFileSystemConfiguration: Configuration key for enabling the use of flat and regular glob search algorithms in two parallel threads.
GCS_CONFIG_OVERRIDE_FILE - Static variable in class com.google.cloud.hadoop.fs.gcs.GoogleHadoopFileSystemConfiguration: Override configuration file path.
GCS_COOPERATIVE_LOCKING_ENABLE - Static variable in class com.google.cloud.hadoop.fs.gcs.GoogleHadoopFileSystemConfiguration: Configuration key for using cooperative locking to achieve a directory mutation operations isolation.
GCS_COOPERATIVE_LOCKING_EXPIRATION_TIMEOUT_MS - Static variable in class com.google.cloud.hadoop.fs.gcs.GoogleHadoopFileSystemConfiguration: Configuration key for lock expiration when using cooperative locking.
GCS_COOPERATIVE_LOCKING_MAX_CONCURRENT_OPERATIONS - Static variable in class com.google.cloud.hadoop.fs.gcs.GoogleHadoopFileSystemConfiguration: Configuration key for maximum allowed concurrent operations when using cooperative locking.
GCS_COPY_BATCH_THREADS - Static variable in class com.google.cloud.hadoop.fs.gcs.GoogleHadoopFileSystemConfiguration: Configuration key for a number of threads to execute batch requests for copy operations.
GCS_COPY_MAX_REQUESTS_PER_BATCH - Static variable in class com.google.cloud.hadoop.fs.gcs.GoogleHadoopFileSystemConfiguration: Configuration key for a max number of GCS RPCs in batch request for copy operations.
GCS_COPY_WITH_REWRITE_ENABLE - Static variable in class com.google.cloud.hadoop.fs.gcs.GoogleHadoopFileSystemConfiguration: Configuration key for enabling the use of Rewrite requests for copy operations.
GCS_FILE_CHECKSUM_TYPE - Static variable in class com.google.cloud.hadoop.fs.gcs.GoogleHadoopFileSystemConfiguration: Configuration key for which type of FileChecksum to return; if a particular file doesn't support the requested type, then getFileChecksum() will return null for that file.
GCS_FLAT_GLOB_ENABLE - Static variable in class com.google.cloud.hadoop.fs.gcs.GoogleHadoopFileSystemConfiguration: Configuration key for enabling the use of a large flat listing to pre-populate possible glob matches in a single API call before running the core globbing logic in-memory rather than sequentially and recursively performing API calls.
GCS_GENERATION_READ_CONSISTENCY - Static variable in class com.google.cloud.hadoop.fs.gcs.GoogleHadoopFileSystemConfiguration: Configuration key for the generation consistency read model.
GCS_HTTP_CONNECT_TIMEOUT - Static variable in class com.google.cloud.hadoop.fs.gcs.GoogleHadoopFileSystemConfiguration: Configuration key for the connect timeout (in millisecond) for HTTP request to GCS.
GCS_HTTP_MAX_RETRY - Static variable in class com.google.cloud.hadoop.fs.gcs.GoogleHadoopFileSystemConfiguration: Configuration key for the max number of retries for failed HTTP request to GCS.
GCS_HTTP_READ_TIMEOUT - Static variable in class com.google.cloud.hadoop.fs.gcs.GoogleHadoopFileSystemConfiguration: Configuration key for the connect timeout (in millisecond) for HTTP request to GCS.
GCS_HTTP_TRANSPORT - Static variable in class com.google.cloud.hadoop.fs.gcs.GoogleHadoopFileSystemConfiguration: Configuration key for the name of HttpTransport class to use for connecting to GCS.
GCS_INFER_IMPLICIT_DIRECTORIES_ENABLE - Static variable in class com.google.cloud.hadoop.fs.gcs.GoogleHadoopFileSystemConfiguration: Configuration key for enabling automatic inference of implicit directories.
GCS_INPUT_STREAM_BUFFER_SIZE - Static variable in class com.google.cloud.hadoop.fs.gcs.GoogleHadoopFileSystemConfiguration: Configuration key for setting read buffer size.
GCS_INPUT_STREAM_FADVISE - Static variable in class com.google.cloud.hadoop.fs.gcs.GoogleHadoopFileSystemConfiguration: Tunes reading objects behavior to optimize HTTP GET requests for various use cases.
GCS_INPUT_STREAM_FAST_FAIL_ON_NOT_FOUND_ENABLE - Static variable in class com.google.cloud.hadoop.fs.gcs.GoogleHadoopFileSystemConfiguration: If true, on opening a file we will proactively perform a metadata GET to check whether the object exists, even though the underlying channel will not open a data stream until read() is actually called so that streams can seek to nonzero file positions without incurring an extra stream creation.
GCS_INPUT_STREAM_INPLACE_SEEK_LIMIT - Static variable in class com.google.cloud.hadoop.fs.gcs.GoogleHadoopFileSystemConfiguration: If forward seeks are within this many bytes of the current position, seeks are performed by reading and discarding bytes in-place rather than opening a new underlying stream.
GCS_INPUT_STREAM_MIN_RANGE_REQUEST_SIZE - Static variable in class com.google.cloud.hadoop.fs.gcs.GoogleHadoopFileSystemConfiguration: Minimum size in bytes of the HTTP Range header set in GCS request when opening new stream to read an object.
GCS_INPUT_STREAM_SUPPORT_GZIP_ENCODING_ENABLE - Static variable in class com.google.cloud.hadoop.fs.gcs.GoogleHadoopFileSystemConfiguration: If true, reading a file with GZIP content encoding (HTTP header "Content-Encoding: gzip") will result in failure (IOException is thrown).
GCS_LAZY_INITIALIZATION_ENABLE - Static variable in class com.google.cloud.hadoop.fs.gcs.GoogleHadoopFileSystemConfiguration: Configuration key for enabling lazy initialization of GCS FS instance.
GCS_MARKER_FILE_PATTERN - Static variable in class com.google.cloud.hadoop.fs.gcs.GoogleHadoopFileSystemConfiguration: Configuration key for marker file pattern.
GCS_MAX_LIST_ITEMS_PER_CALL - Static variable in class com.google.cloud.hadoop.fs.gcs.GoogleHadoopFileSystemConfiguration: Configuration key for number of items to return per call to the list* GCS RPCs.
GCS_MAX_REQUESTS_PER_BATCH - Static variable in class com.google.cloud.hadoop.fs.gcs.GoogleHadoopFileSystemConfiguration: Configuration key for a max number of GCS RPCs in batch request.
GCS_MAX_WAIT_MILLIS_EMPTY_OBJECT_CREATE - Static variable in class com.google.cloud.hadoop.fs.gcs.GoogleHadoopFileSystemConfiguration: Configuration key for modifying the maximum amount of time to wait for empty object creation.
GCS_OUTPUT_STREAM_BUFFER_SIZE - Static variable in class com.google.cloud.hadoop.fs.gcs.GoogleHadoopFileSystemConfiguration: Configuration key for setting write buffer size.
GCS_OUTPUT_STREAM_DIRECT_UPLOAD_ENABLE - Static variable in class com.google.cloud.hadoop.fs.gcs.GoogleHadoopFileSystemConfiguration: Configuration key for enabling GCS direct upload.
GCS_OUTPUT_STREAM_PIPE_BUFFER_SIZE - Static variable in class com.google.cloud.hadoop.fs.gcs.GoogleHadoopFileSystemConfiguration: Configuration key for setting pipe buffer size.
GCS_OUTPUT_STREAM_TYPE - Static variable in class com.google.cloud.hadoop.fs.gcs.GoogleHadoopFileSystemConfiguration: Configuration key for which type of output stream to use; different options may have different degrees of support for advanced features like hsync() and different performance characteristics.
GCS_OUTPUT_STREAM_UPLOAD_CHUNK_SIZE - Static variable in class com.google.cloud.hadoop.fs.gcs.GoogleHadoopFileSystemConfiguration: Configuration key for setting GCS upload chunk size.
GCS_PERFORMANCE_CACHE_ENABLE - Static variable in class com.google.cloud.hadoop.fs.gcs.GoogleHadoopFileSystemConfiguration: Configuration key for using a local item cache to supplement GCS API "getFile" results.
GCS_PERFORMANCE_CACHE_LIST_CACHING_ENABLE - Static variable in class com.google.cloud.hadoop.fs.gcs.GoogleHadoopFileSystemConfiguration: Configuration key for whether or not to enable list caching for the performance cache.
GCS_PERFORMANCE_CACHE_MAX_ENTRY_AGE_MILLIS - Static variable in class com.google.cloud.hadoop.fs.gcs.GoogleHadoopFileSystemConfiguration: Configuration key for maximum number of milliseconds a GoogleCloudStorageItemInfo will remain "valid" in the performance cache before it's invalidated.
GCS_PROJECT_ID - Static variable in class com.google.cloud.hadoop.fs.gcs.GoogleHadoopFileSystemConfiguration: Configuration key for GCS project ID.
GCS_PROXY_ADDRESS - Static variable in class com.google.cloud.hadoop.fs.gcs.GoogleHadoopFileSystemConfiguration: Configuration key for setting a proxy for the connector to use to connect to GCS.
GCS_PROXY_PASSWORD - Static variable in class com.google.cloud.hadoop.fs.gcs.GoogleHadoopFileSystemConfiguration: Configuration key for setting a proxy password for the connector to use to authenticate with proxy used to connect to GCS.
GCS_PROXY_USERNAME - Static variable in class com.google.cloud.hadoop.fs.gcs.GoogleHadoopFileSystemConfiguration: Configuration key for setting a proxy username for the connector to use to authenticate with proxy used to connect to GCS.
GCS_REPAIR_IMPLICIT_DIRECTORIES_ENABLE - Static variable in class com.google.cloud.hadoop.fs.gcs.GoogleHadoopFileSystemConfiguration: Configuration key for enabling automatic repair of implicit directories whenever detected inside delete and rename calls.
GCS_REQUESTER_PAYS_BUCKETS - Static variable in class com.google.cloud.hadoop.fs.gcs.GoogleHadoopFileSystemConfiguration: Configuration key for GCS Requester Pays Buckets.
GCS_REQUESTER_PAYS_MODE - Static variable in class com.google.cloud.hadoop.fs.gcs.GoogleHadoopFileSystemConfiguration: Configuration key for GCS project ID.
GCS_REQUESTER_PAYS_PROJECT_ID - Static variable in class com.google.cloud.hadoop.fs.gcs.GoogleHadoopFileSystemConfiguration: Configuration key for GCS Requester Pays Project ID.
GCS_REWRITE_MAX_BYTES_PER_CALL - Static variable in class com.google.cloud.hadoop.fs.gcs.GoogleHadoopFileSystemConfiguration: Configuration key for specifying max number of bytes rewritten in a single rewrite request when fs.gs.copy.with.rewrite.enable is set to 'true'.
GCS_STATUS_PARALLEL_ENABLE - Static variable in class com.google.cloud.hadoop.fs.gcs.GoogleHadoopFileSystemConfiguration: If true, executes GCS requests in listStatus and getFileStatus methods in parallel to reduce latency.
GCS_WORKING_DIRECTORY - Static variable in class com.google.cloud.hadoop.fs.gcs.GoogleHadoopFileSystemConfiguration: Configuration key for initial working directory of a GHFS instance.
GcsDelegationTokens - Class in com.google.cloud.hadoop.fs.gcs.auth: Manages delegation tokens for files system
GcsDelegationTokens() - Constructor for class com.google.cloud.hadoop.fs.gcs.auth.GcsDelegationTokens
getAccessTokenProvider() - Method in class com.google.cloud.hadoop.fs.gcs.auth.GcsDelegationTokens
getAlgorithmName() - Method in enum com.google.cloud.hadoop.fs.gcs.GoogleHadoopFileSystemBase.GcsFileChecksumType
getBoundDT() - Method in class com.google.cloud.hadoop.fs.gcs.auth.GcsDelegationTokens: Get any bound DT.
getBoundOrNewDT(String) - Method in class com.google.cloud.hadoop.fs.gcs.auth.GcsDelegationTokens: Get any bound DT or create a new one.
getByteLength() - Method in enum com.google.cloud.hadoop.fs.gcs.GoogleHadoopFileSystemBase.GcsFileChecksumType
getCanonicalServiceName() - Method in class com.google.cloud.hadoop.fs.gcs.GoogleHadoopFileSystemBase
getContentSummary(Path) - Method in class com.google.cloud.hadoop.fs.gcs.GoogleHadoopFileSystemBase
getDefault() - Method in class com.google.cloud.hadoop.fs.gcs.GoogleHadoopFileSystemConfigurationProperty
getDefaultBlockSize() - Method in class com.google.cloud.hadoop.fs.gcs.GoogleHadoopFileSystemBase
getDefaultPort() - Method in class com.google.cloud.hadoop.fs.gcs.GoogleHadoopFileSystemBase: The default port is listed as -1 as an indication that ports are not used.
getDefaultReplication() - Method in class com.google.cloud.hadoop.fs.gcs.GoogleHadoopFileSystemBase: Gets the default replication factor.
getDefaultWorkingDirectory() - Method in class com.google.cloud.hadoop.fs.gcs.GoogleHadoopFileSystem: Gets the default value of working directory.
getDefaultWorkingDirectory() - Method in class com.google.cloud.hadoop.fs.gcs.GoogleHadoopFileSystemBase: Gets the default value of working directory.
getDelegationToken(String) - Method in class com.google.cloud.hadoop.fs.gcs.GoogleHadoopFileSystemBase
getFileBlockLocations(Path, long, long) - Method in class com.google.cloud.hadoop.fs.gcs.GoogleHadoopFS
getFileChecksum(Path) - Method in class com.google.cloud.hadoop.fs.gcs.GoogleHadoopFileSystemBase
getFileChecksum(Path) - Method in class com.google.cloud.hadoop.fs.gcs.GoogleHadoopFS
getFileStatus(Path) - Method in class com.google.cloud.hadoop.fs.gcs.GoogleHadoopFileSystemBase: Gets status of the given path item.
getFileStatus(Path) - Method in class com.google.cloud.hadoop.fs.gcs.GoogleHadoopFS
getFileSystem() - Method in class com.google.cloud.hadoop.fs.gcs.auth.AbstractDelegationTokenBinding: Returns the bound file system
getFileSystemRoot() - Method in interface com.google.cloud.hadoop.fs.gcs.FileSystemDescriptor: Returns the Hadoop path representing the root of the FileSystem associated with this FileSystemDescriptor.
getFileSystemRoot() - Method in class com.google.cloud.hadoop.fs.gcs.GoogleHadoopFileSystem
getFileSystemRoot() - Method in class com.google.cloud.hadoop.fs.gcs.GoogleHadoopFileSystemBase
getFsStatus() - Method in class com.google.cloud.hadoop.fs.gcs.GoogleHadoopFS
getGcsFs() - Method in class com.google.cloud.hadoop.fs.gcs.GoogleHadoopFileSystemBase: Gets GCS FS instance.
getGcsPath(Path) - Method in class com.google.cloud.hadoop.fs.gcs.GoogleHadoopFileSystem: Translates a "gs:/" style hadoopPath (or relative path which is not fully-qualified) into the appropriate GCS path which is compatible with the underlying GcsFs or gsutil.
getGcsPath(Path) - Method in class com.google.cloud.hadoop.fs.gcs.GoogleHadoopFileSystemBase: Gets GCS path corresponding to the given Hadoop path, which can be relative or absolute, and can have either gs://<path> or gs:/<path> forms.
getHadoopPath(URI) - Method in class com.google.cloud.hadoop.fs.gcs.GoogleHadoopFileSystem: Validates GCS Path belongs to this file system.
getHadoopPath(URI) - Method in class com.google.cloud.hadoop.fs.gcs.GoogleHadoopFileSystemBase: Gets Hadoop path corresponding to the given GCS path.
getHomeDirectory() - Method in class com.google.cloud.hadoop.fs.gcs.GoogleHadoopFileSystemBase: Returns home directory of the current user.
getHomeDirectorySubpath() - Method in class com.google.cloud.hadoop.fs.gcs.GoogleHadoopFileSystem: Override to allow a homedir subpath which sits directly on our FileSystem root.
getHomeDirectorySubpath() - Method in class com.google.cloud.hadoop.fs.gcs.GoogleHadoopFileSystemBase: Returns an unqualified path without any leading slash, relative to the filesystem root, which serves as the home directory of the current user; see getHomeDirectory for a description of what the home directory means.
getKey() - Method in class com.google.cloud.hadoop.fs.gcs.GoogleHadoopFileSystemConfigurationProperty
getKind() - Method in class com.google.cloud.hadoop.fs.gcs.auth.AbstractDelegationTokenBinding
getScheme() - Method in interface com.google.cloud.hadoop.fs.gcs.FileSystemDescriptor: Returns the URI scheme for the Hadoop FileSystem associated with this FileSystemDescriptor.
getScheme() - Method in class com.google.cloud.hadoop.fs.gcs.GoogleHadoopFileSystem: As the global-rooted FileSystem, our hadoop-path "scheme" is exactly equal to the general GCS scheme.
getScheme() - Method in class com.google.cloud.hadoop.fs.gcs.GoogleHadoopFileSystemBase
getServerDefaults() - Method in class com.google.cloud.hadoop.fs.gcs.GoogleHadoopFS
getService() - Method in class com.google.cloud.hadoop.fs.gcs.auth.AbstractDelegationTokenBinding
getService() - Method in class com.google.cloud.hadoop.fs.gcs.auth.GcsDelegationTokens
getUri() - Method in class com.google.cloud.hadoop.fs.gcs.GoogleHadoopFileSystemBase: Returns a URI of the root of this FileSystem.
getUri() - Method in class com.google.cloud.hadoop.fs.gcs.GoogleHadoopFS: This is overridden to use GoogleHadoopFileSystem's URI, because AbstractFileSystem appends the default port to the authority.
getUriDefaultPort() - Method in class com.google.cloud.hadoop.fs.gcs.GoogleHadoopFS
getUsed() - Method in class com.google.cloud.hadoop.fs.gcs.GoogleHadoopFileSystemBase
getWorkingDirectory() - Method in class com.google.cloud.hadoop.fs.gcs.GoogleHadoopFileSystemBase: Gets the current working directory.
getXAttr(Path, String) - Method in class com.google.cloud.hadoop.fs.gcs.GoogleHadoopFileSystemBase
getXAttrs(Path) - Method in class com.google.cloud.hadoop.fs.gcs.GoogleHadoopFileSystemBase
getXAttrs(Path, List<String>) - Method in class com.google.cloud.hadoop.fs.gcs.GoogleHadoopFileSystemBase
GHFS_ID - Static variable in class com.google.cloud.hadoop.fs.gcs.GoogleHadoopFileSystemBase: Identifies this version of the GoogleHadoopFileSystemBase library.
globStatus(Path) - Method in class com.google.cloud.hadoop.fs.gcs.GoogleHadoopFileSystemBase: Returns an array of FileStatus objects whose path names match pathPattern.
globStatus(Path, PathFilter) - Method in class com.google.cloud.hadoop.fs.gcs.GoogleHadoopFileSystemBase: Returns an array of FileStatus objects whose path names match pathPattern and is accepted by the user-supplied path filter.
GoogleHadoopFileSystem - Class in com.google.cloud.hadoop.fs.gcs: GoogleHadoopFileSystem is a version of GoogleHadoopFileSystemBase which is rooted in a single bucket at initialization time; in this case, Hadoop paths no longer correspond directly to general GCS paths, and all Hadoop operations going through this FileSystem will never touch any GCS bucket other than the bucket on which this FileSystem is rooted.
GoogleHadoopFileSystem() - Constructor for class com.google.cloud.hadoop.fs.gcs.GoogleHadoopFileSystem: Constructs an instance of GoogleHadoopFileSystem; the internal GoogleCloudStorageFileSystem will be set up with config settings when initialize() is called.
GoogleHadoopFileSystemBase - Class in com.google.cloud.hadoop.fs.gcs: This class provides a Hadoop compatible File System on top of Google Cloud Storage (GCS).
GoogleHadoopFileSystemBase() - Constructor for class com.google.cloud.hadoop.fs.gcs.GoogleHadoopFileSystemBase: Constructs an instance of GoogleHadoopFileSystemBase; the internal GoogleCloudStorageFileSystem will be set up with config settings when initialize() is called.
GoogleHadoopFileSystemBase.Counter - Enum in com.google.cloud.hadoop.fs.gcs: Defines names of counters we track for each operation.
GoogleHadoopFileSystemBase.GcsFileChecksumType - Enum in com.google.cloud.hadoop.fs.gcs: Available GCS checksum types for use with GoogleHadoopFileSystemConfiguration.GCS_FILE_CHECKSUM_TYPE.
GoogleHadoopFileSystemBase.OutputStreamType - Enum in com.google.cloud.hadoop.fs.gcs: Available types for use with GoogleHadoopFileSystemConfiguration.GCS_OUTPUT_STREAM_TYPE.
GoogleHadoopFileSystemConfiguration - Class in com.google.cloud.hadoop.fs.gcs: This class provides a configuration for the GoogleHadoopFileSystem implementations.
GoogleHadoopFileSystemConfiguration() - Constructor for class com.google.cloud.hadoop.fs.gcs.GoogleHadoopFileSystemConfiguration
GoogleHadoopFileSystemConfigurationProperty<T> - Class in com.google.cloud.hadoop.fs.gcs: GHFS configuration property
GoogleHadoopFileSystemConfigurationProperty(String) - Constructor for class com.google.cloud.hadoop.fs.gcs.GoogleHadoopFileSystemConfigurationProperty
GoogleHadoopFileSystemConfigurationProperty(String, T, String...) - Constructor for class com.google.cloud.hadoop.fs.gcs.GoogleHadoopFileSystemConfigurationProperty
GoogleHadoopFS - Class in com.google.cloud.hadoop.fs.gcs: GoogleHadoopFS provides a YARN compatible Abstract File System on top of Google Cloud Storage (GCS).
GoogleHadoopFS(URI, Configuration) - Constructor for class com.google.cloud.hadoop.fs.gcs.GoogleHadoopFS
GoogleHadoopFS(GoogleHadoopFileSystem, URI, Configuration) - Constructor for class com.google.cloud.hadoop.fs.gcs.GoogleHadoopFS
GoogleHadoopSyncableOutputStream - Class in com.google.cloud.hadoop.fs.gcs: GoogleHadoopSyncableOutputStream implements the Syncable interface by composing objects created in separate underlying streams for each hsync() call.
GoogleHadoopSyncableOutputStream(GoogleHadoopFileSystemBase, URI, FileSystem.Statistics, CreateFileOptions) - Constructor for class com.google.cloud.hadoop.fs.gcs.GoogleHadoopSyncableOutputStream: Creates a new GoogleHadoopSyncableOutputStream with initial stream initialized and expected to begin at file-offset 0.
GoogleHadoopSyncableOutputStream(GoogleHadoopFileSystemBase, URI, FileSystem.Statistics, CreateFileOptions, boolean) - Constructor for class com.google.cloud.hadoop.fs.gcs.GoogleHadoopSyncableOutputStream: Creates a new GoogleHadoopSyncableOutputStream suitable for appending to existing files.

H

hflush() - Method in class com.google.cloud.hadoop.fs.gcs.GoogleHadoopSyncableOutputStream: There is no way to flush data to become available for readers without a full-fledged hsync(), so this method is a no-op.
hsync() - Method in class com.google.cloud.hadoop.fs.gcs.GoogleHadoopSyncableOutputStream

I

init(Configuration) - Method in class com.google.cloud.hadoop.fs.gcs.auth.GcsDelegationTokens
initialize(URI, Configuration) - Method in class com.google.cloud.hadoop.fs.gcs.GoogleHadoopFileSystemBase: See GoogleHadoopFileSystemBase.initialize(URI, Configuration, boolean) for details; calls with third arg defaulting to 'true' for initializing the superclass.
initialize(URI, Configuration, boolean) - Method in class com.google.cloud.hadoop.fs.gcs.GoogleHadoopFileSystemBase: Initializes this file system instance.
initUri - Variable in class com.google.cloud.hadoop.fs.gcs.GoogleHadoopFileSystemBase: The URI the File System is passed in initialize.
isBoundToDT() - Method in class com.google.cloud.hadoop.fs.gcs.auth.GcsDelegationTokens: Predicate: is there a bound DT?
isValidName(String) - Method in class com.google.cloud.hadoop.fs.gcs.GoogleHadoopFS: Follow HDFS conventions except allow for ':' in paths.

L

listStatus(Path) - Method in class com.google.cloud.hadoop.fs.gcs.GoogleHadoopFileSystemBase: Lists file status.
listStatus(Path) - Method in class com.google.cloud.hadoop.fs.gcs.GoogleHadoopFS
listXAttrs(Path) - Method in class com.google.cloud.hadoop.fs.gcs.GoogleHadoopFileSystemBase

M

main(String[]) - Static method in class com.google.cloud.hadoop.fs.gcs.CoopLockFsck
makeQualified(Path) - Method in class com.google.cloud.hadoop.fs.gcs.GoogleHadoopFileSystemBase: Overridden to make root its own parent.
mkdir(Path, FsPermission, boolean) - Method in class com.google.cloud.hadoop.fs.gcs.GoogleHadoopFS
mkdirs(Path, FsPermission) - Method in class com.google.cloud.hadoop.fs.gcs.GoogleHadoopFileSystemBase: Makes the given path and all non-existent parents directories.
MR_JOB_HISTORY_DONE_DIR_KEY - Static variable in class com.google.cloud.hadoop.fs.gcs.GoogleHadoopFileSystemConfiguration: Configuration key of the MR done directory.
MR_JOB_HISTORY_INTERMEDIATE_DONE_DIR_KEY - Static variable in class com.google.cloud.hadoop.fs.gcs.GoogleHadoopFileSystemConfiguration: Configuration key for the MR intermediate done dir.

O

open(Path, int) - Method in class com.google.cloud.hadoop.fs.gcs.GoogleHadoopFileSystemBase: Opens the given file for reading.
open(Path, int) - Method in class com.google.cloud.hadoop.fs.gcs.GoogleHadoopFS

P

PATH_CODEC - Static variable in class com.google.cloud.hadoop.fs.gcs.GoogleHadoopFileSystemConfiguration: Configuration key for changing the path codec from legacy to 'uri path encoding'.
PATH_CODEC_USE_LEGACY_ENCODING - Static variable in class com.google.cloud.hadoop.fs.gcs.GoogleHadoopFileSystemBase: Use LEGACY_PATH_CODEC.
PATH_CODEC_USE_URI_ENCODING - Static variable in class com.google.cloud.hadoop.fs.gcs.GoogleHadoopFileSystemBase: Use new URI_ENCODED_PATH_CODEC.
pathCodec - Variable in class com.google.cloud.hadoop.fs.gcs.GoogleHadoopFileSystemBase
PERMISSIONS_TO_REPORT - Static variable in class com.google.cloud.hadoop.fs.gcs.GoogleHadoopFileSystemConfiguration: Key for the permissions that we report a file or directory to have.
processDeleteOnExit() - Method in class com.google.cloud.hadoop.fs.gcs.GoogleHadoopFileSystemBase
PROPERTIES_FILE - Static variable in class com.google.cloud.hadoop.fs.gcs.GoogleHadoopFileSystemBase: A resource file containing GCS related build properties.

R

removeXAttr(Path, String) - Method in class com.google.cloud.hadoop.fs.gcs.GoogleHadoopFileSystemBase
rename(Path, Path) - Method in class com.google.cloud.hadoop.fs.gcs.GoogleHadoopFileSystemBase: Renames src to dst.
renameInternal(Path, Path) - Method in class com.google.cloud.hadoop.fs.gcs.GoogleHadoopFS
REPLICATION_FACTOR_DEFAULT - Static variable in class com.google.cloud.hadoop.fs.gcs.GoogleHadoopFileSystemBase: Default value of replication factor.
retrievePassword(DelegationTokenIdentifier) - Method in class com.google.cloud.hadoop.fs.gcs.auth.AbstractDelegationTokenBinding.TokenSecretManager
run(String[]) - Method in class com.google.cloud.hadoop.fs.gcs.CoopLockFsck

S

secretManager - Variable in class com.google.cloud.hadoop.fs.gcs.auth.AbstractDelegationTokenBinding
selectTokenFromFsOwner() - Method in class com.google.cloud.hadoop.fs.gcs.auth.GcsDelegationTokens: Find a token for the FS user and service name.
setOwner(Path, String, String) - Method in class com.google.cloud.hadoop.fs.gcs.GoogleHadoopFileSystemBase
setOwner(Path, String, String) - Method in class com.google.cloud.hadoop.fs.gcs.GoogleHadoopFS
setPermission(Path, FsPermission) - Method in class com.google.cloud.hadoop.fs.gcs.GoogleHadoopFileSystemBase
setPermission(Path, FsPermission) - Method in class com.google.cloud.hadoop.fs.gcs.GoogleHadoopFS
setReplication(Path, short) - Method in class com.google.cloud.hadoop.fs.gcs.GoogleHadoopFS
setTimes(Path, long, long) - Method in class com.google.cloud.hadoop.fs.gcs.GoogleHadoopFileSystemBase
setTimes(Path, long, long) - Method in class com.google.cloud.hadoop.fs.gcs.GoogleHadoopFS
setVerifyChecksum(boolean) - Method in class com.google.cloud.hadoop.fs.gcs.GoogleHadoopFileSystemBase
setVerifyChecksum(boolean) - Method in class com.google.cloud.hadoop.fs.gcs.GoogleHadoopFS
setWorkingDirectory(Path) - Method in class com.google.cloud.hadoop.fs.gcs.GoogleHadoopFileSystemBase: Sets the current working directory to the given path.
setXAttr(Path, String, byte[], EnumSet<XAttrSetFlag>) - Method in class com.google.cloud.hadoop.fs.gcs.GoogleHadoopFileSystemBase
startLocalOutput(Path, Path) - Method in class com.google.cloud.hadoop.fs.gcs.GoogleHadoopFileSystemBase
sync() - Method in class com.google.cloud.hadoop.fs.gcs.GoogleHadoopSyncableOutputStream

T

TEMPFILE_PREFIX - Static variable in class com.google.cloud.hadoop.fs.gcs.GoogleHadoopSyncableOutputStream
tokenMismatch(Text, Text, Text) - Static method in exception com.google.cloud.hadoop.fs.gcs.auth.DelegationTokenIOException
TokenSecretManager() - Constructor for class com.google.cloud.hadoop.fs.gcs.auth.AbstractDelegationTokenBinding.TokenSecretManager

U

UNKNOWN_VERSION - Static variable in class com.google.cloud.hadoop.fs.gcs.GoogleHadoopFileSystemBase: The version returned when one cannot be found in properties.

V

valueOf(String) - Static method in enum com.google.cloud.hadoop.fs.gcs.GoogleHadoopFileSystemBase.Counter: Returns the enum constant of this type with the specified name.
valueOf(String) - Static method in enum com.google.cloud.hadoop.fs.gcs.GoogleHadoopFileSystemBase.GcsFileChecksumType: Returns the enum constant of this type with the specified name.
valueOf(String) - Static method in enum com.google.cloud.hadoop.fs.gcs.GoogleHadoopFileSystemBase.OutputStreamType: Returns the enum constant of this type with the specified name.
values() - Static method in enum com.google.cloud.hadoop.fs.gcs.GoogleHadoopFileSystemBase.Counter: Returns an array containing the constants of this enum type, in the order they are declared.
values() - Static method in enum com.google.cloud.hadoop.fs.gcs.GoogleHadoopFileSystemBase.GcsFileChecksumType: Returns an array containing the constants of this enum type, in the order they are declared.
values() - Static method in enum com.google.cloud.hadoop.fs.gcs.GoogleHadoopFileSystemBase.OutputStreamType: Returns an array containing the constants of this enum type, in the order they are declared.
VERSION - Static variable in class com.google.cloud.hadoop.fs.gcs.GoogleHadoopFileSystemBase: Current version.
VERSION_PROPERTY - Static variable in class com.google.cloud.hadoop.fs.gcs.GoogleHadoopFileSystemBase: The key in the PROPERTIES_FILE that contains the version built.

W

write(int) - Method in class com.google.cloud.hadoop.fs.gcs.GoogleHadoopSyncableOutputStream
write(byte[], int, int) - Method in class com.google.cloud.hadoop.fs.gcs.GoogleHadoopSyncableOutputStream
wrongTokenType(Class<? extends DelegationTokenIdentifier>, DelegationTokenIdentifier) - Static method in exception com.google.cloud.hadoop.fs.gcs.auth.DelegationTokenIOException

A B C D E F G H I L M O P R S T U V W