A B C D E F G H I L M O P R S T U V W

A

append(Path, int, Progressable) - Method in class com.google.cloud.hadoop.fs.gcs.GoogleHadoopFileSystemBase

Appends to an existing file (optional operation).

AUTHENTICATION_PREFIX - Static variable in class com.google.cloud.hadoop.fs.gcs.GoogleHadoopFileSystemBase

B

BLOCK_SIZE_DEFAULT - Static variable in class com.google.cloud.hadoop.fs.gcs.GoogleHadoopFileSystemBase

BLOCK_SIZE_KEY - Static variable in class com.google.cloud.hadoop.fs.gcs.GoogleHadoopFileSystemBase

BUFFERSIZE_DEFAULT - Static variable in class com.google.cloud.hadoop.fs.gcs.GoogleHadoopFileSystemBase

BUFFERSIZE_KEY - Static variable in class com.google.cloud.hadoop.fs.gcs.GoogleHadoopFileSystemBase

C

checkPath(Path) - Method in class com.google.cloud.hadoop.fs.gcs.GoogleHadoopFileSystem

checkPath(Path) - Method in class com.google.cloud.hadoop.fs.gcs.GoogleHadoopFileSystemBase

checkPath(Path) - Method in class com.google.cloud.hadoop.fs.gcs.GoogleHadoopFS

Only accept valid AbstractFileSystem and GoogleHadoopFileSystem Paths.

cleanCache(DirectoryListCache) - Static method in class com.google.cloud.hadoop.fs.gcs.GoogleHadoopFileSystemCacheCleaner

Iterates over items in cache, object-first then buckets, allowing the list operations to perform cache-expiration as they run.

close() - Method in class com.google.cloud.hadoop.fs.gcs.GoogleHadoopFileSystemBase

close() - Method in class com.google.cloud.hadoop.fs.gcs.GoogleHadoopSyncableOutputStream

com.google.cloud.hadoop.fs.gcs - package com.google.cloud.hadoop.fs.gcs

completeLocalOutput(Path, Path) - Method in class com.google.cloud.hadoop.fs.gcs.GoogleHadoopFileSystemBase

CompositeLimitExceededException - Exception in com.google.cloud.hadoop.fs.gcs

Throw when an attempted operation is prohibited because it would require exceeding the GCS component limit.

CompositeLimitExceededException() - Constructor for exception com.google.cloud.hadoop.fs.gcs.CompositeLimitExceededException

CompositeLimitExceededException(String) - Constructor for exception com.google.cloud.hadoop.fs.gcs.CompositeLimitExceededException

configureBuckets(String, boolean) - Method in class com.google.cloud.hadoop.fs.gcs.GoogleHadoopFileSystem

Validates and possibly creates the system bucket.

configureBuckets(String, boolean) - Method in class com.google.cloud.hadoop.fs.gcs.GoogleHadoopFileSystemBase

Validates and possibly creates the system bucket.

copyFromLocalFile(boolean, boolean, Path[], Path) - Method in class com.google.cloud.hadoop.fs.gcs.GoogleHadoopFileSystemBase

copyFromLocalFile(boolean, boolean, Path, Path) - Method in class com.google.cloud.hadoop.fs.gcs.GoogleHadoopFileSystemBase

copyToLocalFile(boolean, Path, Path) - Method in class com.google.cloud.hadoop.fs.gcs.GoogleHadoopFileSystemBase

counters - Variable in class com.google.cloud.hadoop.fs.gcs.GoogleHadoopFileSystemBase

create(Path, FsPermission, boolean, int, short, long, Progressable) - Method in class com.google.cloud.hadoop.fs.gcs.GoogleHadoopFileSystemBase

Opens the given file for writing.

create(Configuration) - Static method in class com.google.cloud.hadoop.fs.gcs.GoogleHadoopFileSystemBase.ParentTimestampUpdateIncludePredicate

Create a new ParentTimestampUpdateIncludePredicate from the passed Hadoop configuration object.

createCounterMap() - Method in class com.google.cloud.hadoop.fs.gcs.GoogleHadoopFileSystemBase

createInternal(Path, EnumSet<CreateFlag>, FsPermission, int, short, long, Progressable, Options.ChecksumOpt, boolean) - Method in class com.google.cloud.hadoop.fs.gcs.GoogleHadoopFS

D

DEFAULT_FILTER - Static variable in class com.google.cloud.hadoop.fs.gcs.GoogleHadoopFileSystemBase

defaultBlockSize - Variable in class com.google.cloud.hadoop.fs.gcs.GoogleHadoopFileSystemBase

delete(Path) - Method in class com.google.cloud.hadoop.fs.gcs.GoogleHadoopFileSystemBase

Deprecated.

Use delete(Path, boolean) instead

delete(Path, boolean) - Method in class com.google.cloud.hadoop.fs.gcs.GoogleHadoopFileSystemBase

Deletes the given file or directory.

delete(Path, boolean) - Method in class com.google.cloud.hadoop.fs.gcs.GoogleHadoopFS

deleteOnExit(Path) - Method in class com.google.cloud.hadoop.fs.gcs.GoogleHadoopFileSystemBase

E

ENABLE_GCE_SERVICE_ACCOUNT_AUTH_KEY - Static variable in class com.google.cloud.hadoop.fs.gcs.GoogleHadoopFileSystemBase

F

FileSystemDescriptor - Interface in com.google.cloud.hadoop.fs.gcs

FileSystemDescriptor defines the interface containing all the methods which are necessary to differentiate the behavior of different Hadoop FileSystem implementations, including the URI scheme with which an implementation is identified.

G

GCE_BUCKET_DELETE_ENABLE_DEFAULT - Static variable in class com.google.cloud.hadoop.fs.gcs.GoogleHadoopFileSystemBase

GCE_BUCKET_DELETE_ENABLE_KEY - Static variable in class com.google.cloud.hadoop.fs.gcs.GoogleHadoopFileSystemBase

GCS_APPLICATION_NAME_SUFFIX_DEFAULT - Static variable in class com.google.cloud.hadoop.fs.gcs.GoogleHadoopFileSystemBase

GCS_APPLICATION_NAME_SUFFIX_KEY - Static variable in class com.google.cloud.hadoop.fs.gcs.GoogleHadoopFileSystemBase

GCS_CLIENT_ID_KEY - Static variable in class com.google.cloud.hadoop.fs.gcs.GoogleHadoopFileSystemBase

GCS_CLIENT_SECRET_KEY - Static variable in class com.google.cloud.hadoop.fs.gcs.GoogleHadoopFileSystemBase

GCS_CREATE_SYSTEM_BUCKET_DEFAULT - Static variable in class com.google.cloud.hadoop.fs.gcs.GoogleHadoopFileSystemBase

GCS_CREATE_SYSTEM_BUCKET_KEY - Static variable in class com.google.cloud.hadoop.fs.gcs.GoogleHadoopFileSystemBase

GCS_ENABLE_FLAT_GLOB_DEFAULT - Static variable in class com.google.cloud.hadoop.fs.gcs.GoogleHadoopFileSystemBase

GCS_ENABLE_FLAT_GLOB_KEY - Static variable in class com.google.cloud.hadoop.fs.gcs.GoogleHadoopFileSystemBase

GCS_ENABLE_INFER_IMPLICIT_DIRECTORIES_DEFAULT - Static variable in class com.google.cloud.hadoop.fs.gcs.GoogleHadoopFileSystemBase

GCS_ENABLE_INFER_IMPLICIT_DIRECTORIES_KEY - Static variable in class com.google.cloud.hadoop.fs.gcs.GoogleHadoopFileSystemBase

GCS_ENABLE_MARKER_FILE_CREATION_DEFAULT - Static variable in class com.google.cloud.hadoop.fs.gcs.GoogleHadoopFileSystemBase

GCS_ENABLE_MARKER_FILE_CREATION_KEY - Static variable in class com.google.cloud.hadoop.fs.gcs.GoogleHadoopFileSystemBase

GCS_ENABLE_METADATA_CACHE_DEFAULT - Static variable in class com.google.cloud.hadoop.fs.gcs.GoogleHadoopFileSystemBase

GCS_ENABLE_METADATA_CACHE_KEY - Static variable in class com.google.cloud.hadoop.fs.gcs.GoogleHadoopFileSystemBase

GCS_ENABLE_REPAIR_IMPLICIT_DIRECTORIES_DEFAULT - Static variable in class com.google.cloud.hadoop.fs.gcs.GoogleHadoopFileSystemBase

GCS_ENABLE_REPAIR_IMPLICIT_DIRECTORIES_KEY - Static variable in class com.google.cloud.hadoop.fs.gcs.GoogleHadoopFileSystemBase

GCS_FILE_SIZE_LIMIT_250GB - Static variable in class com.google.cloud.hadoop.fs.gcs.GoogleHadoopFileSystemBase

GCS_FILE_SIZE_LIMIT_250GB_DEFAULT - Static variable in class com.google.cloud.hadoop.fs.gcs.GoogleHadoopFileSystemBase

GCS_HTTP_TRANSPORT_DEFAULT - Static variable in class com.google.cloud.hadoop.fs.gcs.GoogleHadoopFileSystemBase

GCS_HTTP_TRANSPORT_KEY - Static variable in class com.google.cloud.hadoop.fs.gcs.GoogleHadoopFileSystemBase

GCS_INPUTSTREAM_FAST_FAIL_ON_NOT_FOUND_ENABLE_DEFAULT - Static variable in class com.google.cloud.hadoop.fs.gcs.GoogleHadoopFileSystemBase

GCS_INPUTSTREAM_FAST_FAIL_ON_NOT_FOUND_ENABLE_KEY - Static variable in class com.google.cloud.hadoop.fs.gcs.GoogleHadoopFileSystemBase

GCS_INPUTSTREAM_INPLACE_SEEK_LIMIT_DEFAULT - Static variable in class com.google.cloud.hadoop.fs.gcs.GoogleHadoopFileSystemBase

GCS_INPUTSTREAM_INPLACE_SEEK_LIMIT_KEY - Static variable in class com.google.cloud.hadoop.fs.gcs.GoogleHadoopFileSystemBase

GCS_INPUTSTREAM_INTERNALBUFFER_ENABLE_DEFAULT - Static variable in class com.google.cloud.hadoop.fs.gcs.GoogleHadoopFileSystemBase

GCS_INPUTSTREAM_INTERNALBUFFER_ENABLE_KEY - Static variable in class com.google.cloud.hadoop.fs.gcs.GoogleHadoopFileSystemBase

GCS_INPUTSTREAM_SUPPORT_CONTENT_ENCODING_ENABLE_DEFAULT - Static variable in class com.google.cloud.hadoop.fs.gcs.GoogleHadoopFileSystemBase

GCS_INPUTSTREAM_SUPPORT_CONTENT_ENCODING_ENABLE_KEY - Static variable in class com.google.cloud.hadoop.fs.gcs.GoogleHadoopFileSystemBase

GCS_METADATA_CACHE_DIRECTORY_DEFAULT - Static variable in class com.google.cloud.hadoop.fs.gcs.GoogleHadoopFileSystemBase

GCS_METADATA_CACHE_DIRECTORY_KEY - Static variable in class com.google.cloud.hadoop.fs.gcs.GoogleHadoopFileSystemBase

GCS_METADATA_CACHE_MAX_ENTRY_AGE_DEFAULT - Static variable in class com.google.cloud.hadoop.fs.gcs.GoogleHadoopFileSystemBase

GCS_METADATA_CACHE_MAX_ENTRY_AGE_KEY - Static variable in class com.google.cloud.hadoop.fs.gcs.GoogleHadoopFileSystemBase

GCS_METADATA_CACHE_MAX_INFO_AGE_DEFAULT - Static variable in class com.google.cloud.hadoop.fs.gcs.GoogleHadoopFileSystemBase

GCS_METADATA_CACHE_MAX_INFO_AGE_KEY - Static variable in class com.google.cloud.hadoop.fs.gcs.GoogleHadoopFileSystemBase

GCS_METADATA_CACHE_TYPE_DEFAULT - Static variable in class com.google.cloud.hadoop.fs.gcs.GoogleHadoopFileSystemBase

GCS_METADATA_CACHE_TYPE_KEY - Static variable in class com.google.cloud.hadoop.fs.gcs.GoogleHadoopFileSystemBase

GCS_OUTPUTSTREAM_TYPE_DEFAULT - Static variable in class com.google.cloud.hadoop.fs.gcs.GoogleHadoopFileSystemBase

GCS_OUTPUTSTREAM_TYPE_KEY - Static variable in class com.google.cloud.hadoop.fs.gcs.GoogleHadoopFileSystemBase

GCS_PARENT_TIMESTAMP_UPDATE_ENABLE_DEFAULT - Static variable in class com.google.cloud.hadoop.fs.gcs.GoogleHadoopFileSystemBase

GCS_PARENT_TIMESTAMP_UPDATE_ENABLE_KEY - Static variable in class com.google.cloud.hadoop.fs.gcs.GoogleHadoopFileSystemBase

GCS_PARENT_TIMESTAMP_UPDATE_EXCLUDES_DEFAULT - Static variable in class com.google.cloud.hadoop.fs.gcs.GoogleHadoopFileSystemBase

GCS_PARENT_TIMESTAMP_UPDATE_EXCLUDES_KEY - Static variable in class com.google.cloud.hadoop.fs.gcs.GoogleHadoopFileSystemBase

GCS_PARENT_TIMESTAMP_UPDATE_INCLUDES_DEFAULT - Static variable in class com.google.cloud.hadoop.fs.gcs.GoogleHadoopFileSystemBase

GCS_PARENT_TIMESTAMP_UPDATE_INCLUDES_KEY - Static variable in class com.google.cloud.hadoop.fs.gcs.GoogleHadoopFileSystemBase

GCS_PROJECT_ID_KEY - Static variable in class com.google.cloud.hadoop.fs.gcs.GoogleHadoopFileSystemBase

GCS_PROXY_ADDRESS_DEFAULT - Static variable in class com.google.cloud.hadoop.fs.gcs.GoogleHadoopFileSystemBase

GCS_PROXY_ADDRESS_KEY - Static variable in class com.google.cloud.hadoop.fs.gcs.GoogleHadoopFileSystemBase

GCS_SYSTEM_BUCKET_KEY - Static variable in class com.google.cloud.hadoop.fs.gcs.GoogleHadoopFileSystemBase

GCS_WORKING_DIRECTORY_KEY - Static variable in class com.google.cloud.hadoop.fs.gcs.GoogleHadoopFileSystemBase

gcsfs - Variable in class com.google.cloud.hadoop.fs.gcs.GoogleHadoopFileSystemBase

get() - Static method in enum com.google.cloud.hadoop.fs.gcs.GoogleHadoopFileSystemBase.ListStatusFileNotFoundBehavior

Get the ListStatusFileNotFoundBehavior for the currently running Hadoop version.

get(HadoopVersionInfo) - Static method in enum com.google.cloud.hadoop.fs.gcs.GoogleHadoopFileSystemBase.ListStatusFileNotFoundBehavior

Get the ListStatusFileNotFoundBehavior for the given hadoop version/

getCanonicalServiceName() - Method in class com.google.cloud.hadoop.fs.gcs.GoogleHadoopFileSystemBase

Returns null, because GHFS does not use security tokens.

getContentSummary(Path) - Method in class com.google.cloud.hadoop.fs.gcs.GoogleHadoopFileSystemBase

getDefaultBlockSize() - Method in class com.google.cloud.hadoop.fs.gcs.GoogleHadoopFileSystemBase

getDefaultPort() - Method in class com.google.cloud.hadoop.fs.gcs.GoogleHadoopFileSystemBase

The default port is listed as -1 as an indication that ports are not used.

getDefaultReplication() - Method in class com.google.cloud.hadoop.fs.gcs.GoogleHadoopFileSystemBase

Gets the default replication factor.

getDefaultWorkingDirectory() - Method in class com.google.cloud.hadoop.fs.gcs.GoogleHadoopFileSystem

Gets the default value of working directory.

getDefaultWorkingDirectory() - Method in class com.google.cloud.hadoop.fs.gcs.GoogleHadoopFileSystemBase

Gets the default value of working directory.

getDefaultWorkingDirectory() - Method in class com.google.cloud.hadoop.fs.gcs.GoogleHadoopGlobalRootedFileSystem

Deprecated.

Gets the default value of working directory.

getDelegationToken(String) - Method in class com.google.cloud.hadoop.fs.gcs.GoogleHadoopFileSystemBase

getFileBlockLocations(Path, long, long) - Method in class com.google.cloud.hadoop.fs.gcs.GoogleHadoopFS

getFileChecksum(Path) - Method in class com.google.cloud.hadoop.fs.gcs.GoogleHadoopFileSystemBase

getFileChecksum(Path) - Method in class com.google.cloud.hadoop.fs.gcs.GoogleHadoopFS

getFileStatus(Path) - Method in class com.google.cloud.hadoop.fs.gcs.GoogleHadoopFileSystemBase

Gets status of the given path item.

getFileStatus(Path) - Method in class com.google.cloud.hadoop.fs.gcs.GoogleHadoopFS

getFileSystemRoot() - Method in interface com.google.cloud.hadoop.fs.gcs.FileSystemDescriptor

Returns the Hadoop path representing the root of the FileSystem associated with this FileSystemDescriptor.

getFileSystemRoot() - Method in class com.google.cloud.hadoop.fs.gcs.GoogleHadoopFileSystem

getFileSystemRoot() - Method in class com.google.cloud.hadoop.fs.gcs.GoogleHadoopFileSystemBase

getFileSystemRoot() - Method in class com.google.cloud.hadoop.fs.gcs.GoogleHadoopGlobalRootedFileSystem

Deprecated.

getFsStatus() - Method in class com.google.cloud.hadoop.fs.gcs.GoogleHadoopFS

getGcsFs() - Method in class com.google.cloud.hadoop.fs.gcs.GoogleHadoopFileSystemBase

Gets GCS FS instance.

getGcsPath(Path) - Method in class com.google.cloud.hadoop.fs.gcs.GoogleHadoopFileSystem

Translates a "gs:/" style hadoopPath (or relative path which is not fully-qualified) into the appropriate GCS path which is compatible with the underlying GcsFs or gsutil.

getGcsPath(Path) - Method in class com.google.cloud.hadoop.fs.gcs.GoogleHadoopFileSystemBase

Gets GCS path corresponding to the given Hadoop path, which can be relative or absolute, and can have either gs:// or gs:/ forms.

getGcsPath(Path) - Method in class com.google.cloud.hadoop.fs.gcs.GoogleHadoopGlobalRootedFileSystem

Deprecated.

getHadoopPath(URI) - Method in class com.google.cloud.hadoop.fs.gcs.GoogleHadoopFileSystem

Validates GCS Path belongs to this file system.

getHadoopPath(URI) - Method in class com.google.cloud.hadoop.fs.gcs.GoogleHadoopFileSystemBase

Gets Hadoop path corresponding to the given GCS path.

getHadoopPath(URI) - Method in class com.google.cloud.hadoop.fs.gcs.GoogleHadoopGlobalRootedFileSystem

Deprecated.

Gets Hadoop path corresponding to the given GCS path.

getHadoopScheme() - Method in interface com.google.cloud.hadoop.fs.gcs.FileSystemDescriptor

Deprecated.

getHadoopScheme() - Method in class com.google.cloud.hadoop.fs.gcs.GoogleHadoopFileSystemBase

Deprecated.

getHomeDirectory() - Method in class com.google.cloud.hadoop.fs.gcs.GoogleHadoopFileSystemBase

Returns home directory of the current user.

getHomeDirectorySubpath() - Method in class com.google.cloud.hadoop.fs.gcs.GoogleHadoopFileSystem

Override to allow a homedir subpath which sits directly on our FileSystem root.

getHomeDirectorySubpath() - Method in class com.google.cloud.hadoop.fs.gcs.GoogleHadoopFileSystemBase

Returns an unqualified path without any leading slash, relative to the filesystem root, which serves as the home directory of the current user; see getHomeDirectory for a description of what the home directory means.

getHomeDirectorySubpath() - Method in class com.google.cloud.hadoop.fs.gcs.GoogleHadoopGlobalRootedFileSystem

Deprecated.

Returns an unqualified path without any leading slash, relative to the filesystem root, which serves as the home directory of the current user; see getHomeDirectory for a description of what the home directory means.

getScheme() - Method in interface com.google.cloud.hadoop.fs.gcs.FileSystemDescriptor

Returns the URI scheme for the Hadoop FileSystem associated with this FileSystemDescriptor.

getScheme() - Method in class com.google.cloud.hadoop.fs.gcs.GoogleHadoopFileSystem

As the global-rooted FileSystem, our hadoop-path "scheme" is exactly equal to the general GCS scheme.

getScheme() - Method in class com.google.cloud.hadoop.fs.gcs.GoogleHadoopFileSystemBase

getScheme() - Method in class com.google.cloud.hadoop.fs.gcs.GoogleHadoopGlobalRootedFileSystem

Deprecated.

As the global-rooted FileSystem, our hadoop-path "scheme" is distinct from GCS's scheme.

getServerDefaults() - Method in class com.google.cloud.hadoop.fs.gcs.GoogleHadoopFS

getUri() - Method in class com.google.cloud.hadoop.fs.gcs.GoogleHadoopFileSystemBase

Returns a URI of the root of this FileSystem.

getUri() - Method in class com.google.cloud.hadoop.fs.gcs.GoogleHadoopFS

This is overridden to use GoogleHadoopFileSystem's URI, because AbstractFileSystem appends the default port to the authority.

getUriDefaultPort() - Method in class com.google.cloud.hadoop.fs.gcs.GoogleHadoopFS

getUsed() - Method in class com.google.cloud.hadoop.fs.gcs.GoogleHadoopFileSystemBase

getWorkingDirectory() - Method in class com.google.cloud.hadoop.fs.gcs.GoogleHadoopFileSystemBase

Gets the current working directory.

GHFS_ID - Static variable in class com.google.cloud.hadoop.fs.gcs.GoogleHadoopFileSystemBase

globStatus(Path) - Method in class com.google.cloud.hadoop.fs.gcs.GoogleHadoopFileSystemBase

Returns an array of FileStatus objects whose path names match pathPattern.

globStatus(Path, PathFilter) - Method in class com.google.cloud.hadoop.fs.gcs.GoogleHadoopFileSystemBase

Returns an array of FileStatus objects whose path names match pathPattern and is accepted by the user-supplied path filter.

GoogleHadoopFileSystem - Class in com.google.cloud.hadoop.fs.gcs

GoogleHadoopFileSystem is a version of GoogleHadoopFileSystemBase which is rooted in a single bucket at initialization time; in this case, Hadoop paths no longer correspond directly to general GCS paths, and all Hadoop operations going through this FileSystem will never touch any GCS bucket other than the bucket on which this FileSystem is rooted.

GoogleHadoopFileSystem() - Constructor for class com.google.cloud.hadoop.fs.gcs.GoogleHadoopFileSystem

Constructs an instance of GoogleHadoopFileSystem; the internal GoogleCloudStorageFileSystem will be set up with config settings when initialize() is called.

GoogleHadoopFileSystem(GoogleCloudStorageFileSystem) - Constructor for class com.google.cloud.hadoop.fs.gcs.GoogleHadoopFileSystem

Constructs an instance of GoogleHadoopFileSystem using the provided GoogleCloudStorageFileSystem; initialize() will not re-initialize it.

GoogleHadoopFileSystemBase - Class in com.google.cloud.hadoop.fs.gcs

This class provides a Hadoop compatible File System on top of Google Cloud Storage (GCS).

GoogleHadoopFileSystemBase() - Constructor for class com.google.cloud.hadoop.fs.gcs.GoogleHadoopFileSystemBase

Constructs an instance of GoogleHadoopFileSystemBase; the internal GoogleCloudStorageFileSystem will be set up with config settings when initialize() is called.

GoogleHadoopFileSystemBase(GoogleCloudStorageFileSystem) - Constructor for class com.google.cloud.hadoop.fs.gcs.GoogleHadoopFileSystemBase

Constructs an instance of GoogleHadoopFileSystemBase using the provided GoogleCloudStorageFileSystem; initialize() will not re-initialize it.

GoogleHadoopFileSystemBase.Counter - Enum in com.google.cloud.hadoop.fs.gcs

Defines names of counters we track for each operation.

GoogleHadoopFileSystemBase.ListStatusFileNotFoundBehavior - Enum in com.google.cloud.hadoop.fs.gcs

Behavior of listStatus when a path is not found.

GoogleHadoopFileSystemBase.OutputStreamType - Enum in com.google.cloud.hadoop.fs.gcs

Available types for use with fs.gs.outputstream.type.

GoogleHadoopFileSystemBase.ParentTimestampUpdateIncludePredicate - Class in com.google.cloud.hadoop.fs.gcs

A predicate that processes individual directory paths and evaluates the conditions set in fs.gs.parent.timestamp.update.enable, fs.gs.parent.timestamp.update.substrings.include and fs.gs.parent.timestamp.update.substrings.exclude to determine if a path should be ignored when running directory timestamp updates.

GoogleHadoopFileSystemCacheCleaner - Class in com.google.cloud.hadoop.fs.gcs

A tool that will perform GC on FileSystemBackedDirectoryListCache backing stores.

GoogleHadoopFileSystemCacheCleaner() - Constructor for class com.google.cloud.hadoop.fs.gcs.GoogleHadoopFileSystemCacheCleaner

GoogleHadoopFS - Class in com.google.cloud.hadoop.fs.gcs

GoogleHadoopFS provides a YARN compatible Abstract File System on top of Google Cloud Storage (GCS).

GoogleHadoopFS(URI, Configuration) - Constructor for class com.google.cloud.hadoop.fs.gcs.GoogleHadoopFS

GoogleHadoopFS(GoogleHadoopFileSystem, URI, Configuration) - Constructor for class com.google.cloud.hadoop.fs.gcs.GoogleHadoopFS

GoogleHadoopGlobalRootedFileSystem - Class in com.google.cloud.hadoop.fs.gcs

Deprecated.

This implementation is deprecated and relies on the deprecated systemBucket property. Use GoogleHadoopFileSystem instead.

GoogleHadoopGlobalRootedFileSystem() - Constructor for class com.google.cloud.hadoop.fs.gcs.GoogleHadoopGlobalRootedFileSystem

Deprecated.

Constructs an instance of GoogleHadoopGlobalRootedFileSystem; the internal GoogleCloudStorageFileSystem will be set up with config settings when initialize() is called.

GoogleHadoopGlobalRootedFileSystem(GoogleCloudStorageFileSystem) - Constructor for class com.google.cloud.hadoop.fs.gcs.GoogleHadoopGlobalRootedFileSystem

Deprecated.

Constructs an instance of GoogleHadoopGlobalRootedFileSystem using the provided GoogleCloudStorageFileSystem; initialize() will not re-initialize it.

GoogleHadoopSyncableOutputStream - Class in com.google.cloud.hadoop.fs.gcs

GoogleHadoopSyncableOutputStream implements the Syncable interface by composing objects created in separate underlying streams for each hsync() call.

GoogleHadoopSyncableOutputStream(GoogleHadoopFileSystemBase, URI, int, FileSystem.Statistics, CreateFileOptions) - Constructor for class com.google.cloud.hadoop.fs.gcs.GoogleHadoopSyncableOutputStream

Creates a new GoogleHadoopSyncableOutputStream with initial stream initialized and expected to begin at file-offset 0.

H

handle(String) - Method in enum com.google.cloud.hadoop.fs.gcs.GoogleHadoopFileSystemBase.ListStatusFileNotFoundBehavior

Perform version specific handling for a missing path.

hflush() - Method in class com.google.cloud.hadoop.fs.gcs.GoogleHadoopSyncableOutputStream

There is no way to flush data to become available for readers without a full-fledged hsync(), so this method is a no-op.

hsync() - Method in class com.google.cloud.hadoop.fs.gcs.GoogleHadoopSyncableOutputStream

This overrides Syncable.hsync(), but is not annotated as such because the method doesn't exist in Hadoop 1.

I

initialize(URI, Configuration) - Method in class com.google.cloud.hadoop.fs.gcs.GoogleHadoopFileSystemBase

See GoogleHadoopFileSystemBase.initialize(URI, Configuration, boolean) for details; calls with third arg defaulting to 'true' for initializing the superclass.

initialize(URI, Configuration, boolean) - Method in class com.google.cloud.hadoop.fs.gcs.GoogleHadoopFileSystemBase

Initializes this file system instance.

initUri - Variable in class com.google.cloud.hadoop.fs.gcs.GoogleHadoopFileSystemBase

isValidName(String) - Method in class com.google.cloud.hadoop.fs.gcs.GoogleHadoopFS

Follow HDFS conventions except allow for ':' in paths.

L

listStatus(Path) - Method in class com.google.cloud.hadoop.fs.gcs.GoogleHadoopFileSystemBase

Lists file status.

listStatus(Path) - Method in class com.google.cloud.hadoop.fs.gcs.GoogleHadoopFS

listStatusFileNotFoundBehavior - Variable in class com.google.cloud.hadoop.fs.gcs.GoogleHadoopFileSystemBase

LOG - Static variable in class com.google.cloud.hadoop.fs.gcs.GoogleHadoopFileSystemBase

LOG - Static variable in class com.google.cloud.hadoop.fs.gcs.GoogleHadoopFileSystemCacheCleaner

LOG - Static variable in class com.google.cloud.hadoop.fs.gcs.GoogleHadoopFS

M

main(String[]) - Static method in class com.google.cloud.hadoop.fs.gcs.GoogleHadoopFileSystemCacheCleaner

makeQualified(Path) - Method in class com.google.cloud.hadoop.fs.gcs.GoogleHadoopFileSystemBase

Overridden to make root it's own parent.

MAX_COMPOSITE_COMPONENTS - Static variable in class com.google.cloud.hadoop.fs.gcs.GoogleHadoopSyncableOutputStream

mkdir(Path, FsPermission, boolean) - Method in class com.google.cloud.hadoop.fs.gcs.GoogleHadoopFS

mkdirs(Path, FsPermission) - Method in class com.google.cloud.hadoop.fs.gcs.GoogleHadoopFileSystemBase

Makes the given path and all non-existent parents directories.

MR_JOB_HISTORY_DONE_DIR_KEY - Static variable in class com.google.cloud.hadoop.fs.gcs.GoogleHadoopFileSystemBase

MR_JOB_HISTORY_INTERMEDIATE_DONE_DIR_KEY - Static variable in class com.google.cloud.hadoop.fs.gcs.GoogleHadoopFileSystemBase

O

open(Path, int) - Method in class com.google.cloud.hadoop.fs.gcs.GoogleHadoopFileSystemBase

Opens the given file for reading.

open(Path, int) - Method in class com.google.cloud.hadoop.fs.gcs.GoogleHadoopFS

P

ParentTimestampUpdateIncludePredicate(boolean, List<String>, List<String>) - Constructor for class com.google.cloud.hadoop.fs.gcs.GoogleHadoopFileSystemBase.ParentTimestampUpdateIncludePredicate

PATH_CODEC_DEFAULT - Static variable in class com.google.cloud.hadoop.fs.gcs.GoogleHadoopFileSystemBase

PATH_CODEC_KEY - Static variable in class com.google.cloud.hadoop.fs.gcs.GoogleHadoopFileSystemBase

PATH_CODEC_USE_LEGACY_ENCODING - Static variable in class com.google.cloud.hadoop.fs.gcs.GoogleHadoopFileSystemBase

PATH_CODEC_USE_URI_ENCODING - Static variable in class com.google.cloud.hadoop.fs.gcs.GoogleHadoopFileSystemBase

PERMISSIONS_TO_REPORT_DEFAULT - Static variable in class com.google.cloud.hadoop.fs.gcs.GoogleHadoopFileSystemBase

PERMISSIONS_TO_REPORT_KEY - Static variable in class com.google.cloud.hadoop.fs.gcs.GoogleHadoopFileSystemBase

processDeleteOnExit() - Method in class com.google.cloud.hadoop.fs.gcs.GoogleHadoopFileSystemBase

PROPERTIES_FILE - Static variable in class com.google.cloud.hadoop.fs.gcs.GoogleHadoopFileSystemBase

R

rename(Path, Path) - Method in class com.google.cloud.hadoop.fs.gcs.GoogleHadoopFileSystemBase

Renames src to dst.

renameInternal(Path, Path) - Method in class com.google.cloud.hadoop.fs.gcs.GoogleHadoopFS

REPLICATION_FACTOR_DEFAULT - Static variable in class com.google.cloud.hadoop.fs.gcs.GoogleHadoopFileSystemBase

S

SERVICE_ACCOUNT_AUTH_EMAIL_KEY - Static variable in class com.google.cloud.hadoop.fs.gcs.GoogleHadoopFileSystemBase

SERVICE_ACCOUNT_AUTH_KEYFILE_KEY - Static variable in class com.google.cloud.hadoop.fs.gcs.GoogleHadoopFileSystemBase

setListStatusFileNotFoundBehavior(GoogleHadoopFileSystemBase.ListStatusFileNotFoundBehavior) - Method in class com.google.cloud.hadoop.fs.gcs.GoogleHadoopFileSystemBase

setOwner(Path, String, String) - Method in class com.google.cloud.hadoop.fs.gcs.GoogleHadoopFileSystemBase

setOwner(Path, String, String) - Method in class com.google.cloud.hadoop.fs.gcs.GoogleHadoopFS

setPermission(Path, FsPermission) - Method in class com.google.cloud.hadoop.fs.gcs.GoogleHadoopFileSystemBase

setPermission(Path, FsPermission) - Method in class com.google.cloud.hadoop.fs.gcs.GoogleHadoopFS

setReplication(Path, short) - Method in class com.google.cloud.hadoop.fs.gcs.GoogleHadoopFS

setTimes(Path, long, long) - Method in class com.google.cloud.hadoop.fs.gcs.GoogleHadoopFileSystemBase

setTimes(Path, long, long) - Method in class com.google.cloud.hadoop.fs.gcs.GoogleHadoopFS

setVerifyChecksum(boolean) - Method in class com.google.cloud.hadoop.fs.gcs.GoogleHadoopFileSystemBase

setVerifyChecksum(boolean) - Method in class com.google.cloud.hadoop.fs.gcs.GoogleHadoopFS

setWorkingDirectory(Path) - Method in class com.google.cloud.hadoop.fs.gcs.GoogleHadoopFileSystemBase

Sets the current working directory to the given path.

shouldUpdateTimestamp(URI) - Method in class com.google.cloud.hadoop.fs.gcs.GoogleHadoopFileSystemBase.ParentTimestampUpdateIncludePredicate

Determine if updating directory timestamps should be ignored.

startLocalOutput(Path, Path) - Method in class com.google.cloud.hadoop.fs.gcs.GoogleHadoopFileSystemBase

sync() - Method in class com.google.cloud.hadoop.fs.gcs.GoogleHadoopSyncableOutputStream

systemBucket - Variable in class com.google.cloud.hadoop.fs.gcs.GoogleHadoopFileSystemBase

Deprecated.

T

TEMPFILE_PREFIX - Static variable in class com.google.cloud.hadoop.fs.gcs.GoogleHadoopSyncableOutputStream

U

UNKNOWN_VERSION - Static variable in class com.google.cloud.hadoop.fs.gcs.GoogleHadoopFileSystemBase

V

valueOf(String) - Static method in enum com.google.cloud.hadoop.fs.gcs.GoogleHadoopFileSystemBase.Counter

Returns the enum constant of this type with the specified name.

valueOf(String) - Static method in enum com.google.cloud.hadoop.fs.gcs.GoogleHadoopFileSystemBase.ListStatusFileNotFoundBehavior

Returns the enum constant of this type with the specified name.

valueOf(String) - Static method in enum com.google.cloud.hadoop.fs.gcs.GoogleHadoopFileSystemBase.OutputStreamType

Returns the enum constant of this type with the specified name.

values() - Static method in enum com.google.cloud.hadoop.fs.gcs.GoogleHadoopFileSystemBase.Counter

Returns an array containing the constants of this enum type, in the order they are declared.

values() - Static method in enum com.google.cloud.hadoop.fs.gcs.GoogleHadoopFileSystemBase.ListStatusFileNotFoundBehavior

Returns an array containing the constants of this enum type, in the order they are declared.

values() - Static method in enum com.google.cloud.hadoop.fs.gcs.GoogleHadoopFileSystemBase.OutputStreamType

Returns an array containing the constants of this enum type, in the order they are declared.

VERSION - Static variable in class com.google.cloud.hadoop.fs.gcs.GoogleHadoopFileSystemBase

VERSION_PROPERTY - Static variable in class com.google.cloud.hadoop.fs.gcs.GoogleHadoopFileSystemBase

W

write(int) - Method in class com.google.cloud.hadoop.fs.gcs.GoogleHadoopSyncableOutputStream

write(byte[], int, int) - Method in class com.google.cloud.hadoop.fs.gcs.GoogleHadoopSyncableOutputStream

WRITE_BUFFERSIZE_DEFAULT - Static variable in class com.google.cloud.hadoop.fs.gcs.GoogleHadoopFileSystemBase

WRITE_BUFFERSIZE_KEY - Static variable in class com.google.cloud.hadoop.fs.gcs.GoogleHadoopFileSystemBase

A B C D E F G H I L M O P R S T U V W