- GCE_BUCKET_DELETE_ENABLE_DEFAULT - Static variable in class com.google.cloud.hadoop.fs.gcs.GoogleHadoopFileSystemBase
-
- GCE_BUCKET_DELETE_ENABLE_KEY - Static variable in class com.google.cloud.hadoop.fs.gcs.GoogleHadoopFileSystemBase
-
If true, recursive delete on a path that refers to a GCS bucket itself ('/' for any
bucket-rooted GoogleHadoopFileSystem) or delete on that path when it's empty will result in
fully deleting the GCS bucket.
- GCS_APPLICATION_NAME_SUFFIX_DEFAULT - Static variable in class com.google.cloud.hadoop.fs.gcs.GoogleHadoopFileSystemBase
-
Default suffix to add to the application name.
- GCS_APPLICATION_NAME_SUFFIX_KEY - Static variable in class com.google.cloud.hadoop.fs.gcs.GoogleHadoopFileSystemBase
-
Configuration key for adding a suffix to the GHFS application name sent to GCS.
- GCS_CLIENT_ID_KEY - Static variable in class com.google.cloud.hadoop.fs.gcs.GoogleHadoopFileSystemBase
-
Configuration key for GCS client ID.
- GCS_CLIENT_SECRET_KEY - Static variable in class com.google.cloud.hadoop.fs.gcs.GoogleHadoopFileSystemBase
-
Configuration key for GCS client secret.
- GCS_CREATE_SYSTEM_BUCKET_DEFAULT - Static variable in class com.google.cloud.hadoop.fs.gcs.GoogleHadoopFileSystemBase
-
- GCS_CREATE_SYSTEM_BUCKET_KEY - Static variable in class com.google.cloud.hadoop.fs.gcs.GoogleHadoopFileSystemBase
-
Configuration key for flag to indicate whether system bucket should be created if it does not
exist.
- GCS_ENABLE_COPY_WITH_REWRITE_DEFAULT - Static variable in class com.google.cloud.hadoop.fs.gcs.GoogleHadoopFileSystemBase
-
- GCS_ENABLE_COPY_WITH_REWRITE_KEY - Static variable in class com.google.cloud.hadoop.fs.gcs.GoogleHadoopFileSystemBase
-
Configuration key for enabling the use of Rewrite requests for copy operations.
- GCS_ENABLE_FLAT_GLOB_DEFAULT - Static variable in class com.google.cloud.hadoop.fs.gcs.GoogleHadoopFileSystemBase
-
- GCS_ENABLE_FLAT_GLOB_KEY - Static variable in class com.google.cloud.hadoop.fs.gcs.GoogleHadoopFileSystemBase
-
Configuration key for enabling the use of a large flat listing to pre-populate possible glob
matches in a single API call before running the core globbing logic in-memory rather than
sequentially and recursively performing API calls.
- GCS_ENABLE_INFER_IMPLICIT_DIRECTORIES_DEFAULT - Static variable in class com.google.cloud.hadoop.fs.gcs.GoogleHadoopFileSystemBase
-
- GCS_ENABLE_INFER_IMPLICIT_DIRECTORIES_KEY - Static variable in class com.google.cloud.hadoop.fs.gcs.GoogleHadoopFileSystemBase
-
Configuration key for enabling automatic inference of implicit directories.
- GCS_ENABLE_MARKER_FILE_CREATION_DEFAULT - Static variable in class com.google.cloud.hadoop.fs.gcs.GoogleHadoopFileSystemBase
-
- GCS_ENABLE_MARKER_FILE_CREATION_KEY - Static variable in class com.google.cloud.hadoop.fs.gcs.GoogleHadoopFileSystemBase
-
Configuration key for enabling the use of marker files during file creation.
- GCS_ENABLE_METADATA_CACHE_DEFAULT - Static variable in class com.google.cloud.hadoop.fs.gcs.GoogleHadoopFileSystemBase
-
- GCS_ENABLE_METADATA_CACHE_KEY - Static variable in class com.google.cloud.hadoop.fs.gcs.GoogleHadoopFileSystemBase
-
Configuration key for using a local metadata cache to supplement GCS API "list" results; this
allows same-client create() to immediately be visible to a subsequent list() call.
- GCS_ENABLE_PERFORMANCE_CACHE_DEFAULT - Static variable in class com.google.cloud.hadoop.fs.gcs.GoogleHadoopFileSystemBase
-
- GCS_ENABLE_PERFORMANCE_CACHE_KEY - Static variable in class com.google.cloud.hadoop.fs.gcs.GoogleHadoopFileSystemBase
-
Configuration key for using a local item cache to supplement GCS API "getFile" results.
- GCS_ENABLE_REPAIR_IMPLICIT_DIRECTORIES_DEFAULT - Static variable in class com.google.cloud.hadoop.fs.gcs.GoogleHadoopFileSystemBase
-
- GCS_ENABLE_REPAIR_IMPLICIT_DIRECTORIES_KEY - Static variable in class com.google.cloud.hadoop.fs.gcs.GoogleHadoopFileSystemBase
-
Configuration key for enabling automatic repair of implicit directories whenever detected
inside listStatus and globStatus calls, or other methods which may indirectly call listStatus
and/or globaStatus.
- GCS_FILE_SIZE_LIMIT_250GB - Static variable in class com.google.cloud.hadoop.fs.gcs.GoogleHadoopFileSystemBase
-
Configuration key for setting 250GB upper limit on file size to gain higher write throughput.
- GCS_FILE_SIZE_LIMIT_250GB_DEFAULT - Static variable in class com.google.cloud.hadoop.fs.gcs.GoogleHadoopFileSystemBase
-
- GCS_HTTP_TRANSPORT_DEFAULT - Static variable in class com.google.cloud.hadoop.fs.gcs.GoogleHadoopFileSystemBase
-
Default to the default specified in HttpTransportFactory.
- GCS_HTTP_TRANSPORT_KEY - Static variable in class com.google.cloud.hadoop.fs.gcs.GoogleHadoopFileSystemBase
-
Configuration key for the name of HttpTransport class to use for connecting to GCS.
- GCS_INPUTSTREAM_FAST_FAIL_ON_NOT_FOUND_ENABLE_DEFAULT - Static variable in class com.google.cloud.hadoop.fs.gcs.GoogleHadoopFileSystemBase
-
- GCS_INPUTSTREAM_FAST_FAIL_ON_NOT_FOUND_ENABLE_KEY - Static variable in class com.google.cloud.hadoop.fs.gcs.GoogleHadoopFileSystemBase
-
If true, on opening a file we will proactively perform a metadata GET to check whether the
object exists, even though the underlying channel will not open a data stream until read() is
actually called so that streams can seek to nonzero file positions without incurring an extra
stream creation.
- GCS_INPUTSTREAM_INPLACE_SEEK_LIMIT_DEFAULT - Static variable in class com.google.cloud.hadoop.fs.gcs.GoogleHadoopFileSystemBase
-
- GCS_INPUTSTREAM_INPLACE_SEEK_LIMIT_KEY - Static variable in class com.google.cloud.hadoop.fs.gcs.GoogleHadoopFileSystemBase
-
If forward seeks are within this many bytes of the current position, seeks are performed by
reading and discarding bytes in-place rather than opening a new underlying stream.
- GCS_INPUTSTREAM_INTERNALBUFFER_ENABLE_DEFAULT - Static variable in class com.google.cloud.hadoop.fs.gcs.GoogleHadoopFileSystemBase
-
- GCS_INPUTSTREAM_INTERNALBUFFER_ENABLE_KEY - Static variable in class com.google.cloud.hadoop.fs.gcs.GoogleHadoopFileSystemBase
-
If true, the returned FSDataInputStream from the open(Path) method will hold an internal
ByteBuffer of size fs.gs.io.buffersize which it pre-fills on each read, and can efficiently
seek within the internal buffer.
- GCS_INPUTSTREAM_SUPPORT_CONTENT_ENCODING_ENABLE_DEFAULT - Static variable in class com.google.cloud.hadoop.fs.gcs.GoogleHadoopFileSystemBase
-
- GCS_INPUTSTREAM_SUPPORT_CONTENT_ENCODING_ENABLE_KEY - Static variable in class com.google.cloud.hadoop.fs.gcs.GoogleHadoopFileSystemBase
-
If true, input streams will proactively check the "content-encoding" header of underlying
objects during reads for special handling of cases where content-encoding causes the reported
object sizes to not match the actual number of read bytes due to the content being decoded
in-transit; such encoded objects also aren't suitable for splitting or resuming on failure, so
the underlying channel will restart from byte 0 and discard the requisite number of bytes to
seek to a desired position or resume in such cases.
- GCS_MARKER_FILE_PATTERN_KEY - Static variable in class com.google.cloud.hadoop.fs.gcs.GoogleHadoopFileSystemBase
-
Configuration key for marker file pattern.
- GCS_MAX_LIST_ITEMS_PER_CALL - Static variable in class com.google.cloud.hadoop.fs.gcs.GoogleHadoopFileSystemBase
-
Configuration key for number of items to return per call to the list* GCS RPCs.
- GCS_MAX_LIST_ITEMS_PER_CALL_DEFAULT - Static variable in class com.google.cloud.hadoop.fs.gcs.GoogleHadoopFileSystemBase
-
- GCS_MAX_WAIT_MILLIS_EMPTY_OBJECT_CREATE_DEFAULT - Static variable in class com.google.cloud.hadoop.fs.gcs.GoogleHadoopFileSystemBase
-
Default to 3 seconds.
- GCS_MAX_WAIT_MILLIS_EMPTY_OBJECT_CREATE_KEY - Static variable in class com.google.cloud.hadoop.fs.gcs.GoogleHadoopFileSystemBase
-
Configuration key for modifying the maximum amount of time to wait for empty object creation.
- GCS_METADATA_CACHE_DIRECTORY_DEFAULT - Static variable in class com.google.cloud.hadoop.fs.gcs.GoogleHadoopFileSystemBase
-
- GCS_METADATA_CACHE_DIRECTORY_KEY - Static variable in class com.google.cloud.hadoop.fs.gcs.GoogleHadoopFileSystemBase
-
Only used if fs.gs.metadata.cache.type is FILESYSTEM_BACKED, specifies the local path to use as
the base path for storing mirrored GCS metadata.
- GCS_METADATA_CACHE_MAX_ENTRY_AGE_DEFAULT - Static variable in class com.google.cloud.hadoop.fs.gcs.GoogleHadoopFileSystemBase
-
- GCS_METADATA_CACHE_MAX_ENTRY_AGE_KEY - Static variable in class com.google.cloud.hadoop.fs.gcs.GoogleHadoopFileSystemBase
-
Maximum number of milliseconds a cache entry will remain in the list-consistency cache, even as
an id-only entry (no risk of stale GoogleCloudStorageItemInfo).
- GCS_METADATA_CACHE_MAX_INFO_AGE_DEFAULT - Static variable in class com.google.cloud.hadoop.fs.gcs.GoogleHadoopFileSystemBase
-
- GCS_METADATA_CACHE_MAX_INFO_AGE_KEY - Static variable in class com.google.cloud.hadoop.fs.gcs.GoogleHadoopFileSystemBase
-
Maximum number of milliseconds a GoogleCloudStorageItemInfo will remain "valid" in the
list-consistency cache, after which the next attempt to fetch the itemInfo will require
fetching fresh info from a GoogleCloudStorage instance.
- GCS_METADATA_CACHE_TYPE_DEFAULT - Static variable in class com.google.cloud.hadoop.fs.gcs.GoogleHadoopFileSystemBase
-
- GCS_METADATA_CACHE_TYPE_KEY - Static variable in class com.google.cloud.hadoop.fs.gcs.GoogleHadoopFileSystemBase
-
Configuration key for specifying which implementation of DirectoryListCache to use for
supplementing GCS API "list" results.
- GCS_OUTPUTSTREAM_TYPE_DEFAULT - Static variable in class com.google.cloud.hadoop.fs.gcs.GoogleHadoopFileSystemBase
-
- GCS_OUTPUTSTREAM_TYPE_KEY - Static variable in class com.google.cloud.hadoop.fs.gcs.GoogleHadoopFileSystemBase
-
Configuration key for which type of output stream to use; different options may have different
degrees of support for advanced features like hsync() and different performance
characteristics.
- GCS_PARENT_TIMESTAMP_UPDATE_ENABLE_DEFAULT - Static variable in class com.google.cloud.hadoop.fs.gcs.GoogleHadoopFileSystemBase
-
- GCS_PARENT_TIMESTAMP_UPDATE_ENABLE_KEY - Static variable in class com.google.cloud.hadoop.fs.gcs.GoogleHadoopFileSystemBase
-
Configuration key for whether or not we should update timestamps for parent directories when we
create new files in them.
- GCS_PARENT_TIMESTAMP_UPDATE_EXCLUDES_DEFAULT - Static variable in class com.google.cloud.hadoop.fs.gcs.GoogleHadoopFileSystemBase
-
- GCS_PARENT_TIMESTAMP_UPDATE_EXCLUDES_KEY - Static variable in class com.google.cloud.hadoop.fs.gcs.GoogleHadoopFileSystemBase
-
Configuration key containing a comma-separated list of sub-strings that when matched will cause
a particular directory to not have its modification timestamp updated.
- GCS_PARENT_TIMESTAMP_UPDATE_INCLUDES_DEFAULT - Static variable in class com.google.cloud.hadoop.fs.gcs.GoogleHadoopFileSystemBase
-
- GCS_PARENT_TIMESTAMP_UPDATE_INCLUDES_KEY - Static variable in class com.google.cloud.hadoop.fs.gcs.GoogleHadoopFileSystemBase
-
Configuration key containing a comma-separated list of sub-strings that when matched will cause
a particular directory to have its modification timestamp updated.
- GCS_PERFORMANCE_CACHE_LIST_CACHING_ENABLE_DEFAULT - Static variable in class com.google.cloud.hadoop.fs.gcs.GoogleHadoopFileSystemBase
-
- GCS_PERFORMANCE_CACHE_LIST_CACHING_ENABLE_KEY - Static variable in class com.google.cloud.hadoop.fs.gcs.GoogleHadoopFileSystemBase
-
Configuration key for whether or not to enable list caching for the performance cache.
- GCS_PERFORMANCE_CACHE_MAX_ENTRY_AGE_MILLIS_DEFAULT - Static variable in class com.google.cloud.hadoop.fs.gcs.GoogleHadoopFileSystemBase
-
- GCS_PERFORMANCE_CACHE_MAX_ENTRY_AGE_MILLIS_KEY - Static variable in class com.google.cloud.hadoop.fs.gcs.GoogleHadoopFileSystemBase
-
Configuration key for maximum number of milliseconds a GoogleCloudStorageItemInfo will remain
"valid" in the performance cache before it's invalidated.
- GCS_PROJECT_ID_KEY - Static variable in class com.google.cloud.hadoop.fs.gcs.GoogleHadoopFileSystemBase
-
Configuration key for GCS project ID.
- GCS_PROXY_ADDRESS_DEFAULT - Static variable in class com.google.cloud.hadoop.fs.gcs.GoogleHadoopFileSystemBase
-
Default to no proxy.
- GCS_PROXY_ADDRESS_KEY - Static variable in class com.google.cloud.hadoop.fs.gcs.GoogleHadoopFileSystemBase
-
Configuration key for setting a proxy for the connector to use to connect to GCS.
- GCS_REQUESTER_PAYS_BUCKETS_KEY - Static variable in class com.google.cloud.hadoop.fs.gcs.GoogleHadoopFileSystemBase
-
Configuration key for GCS Requester Pays Buckets.
- GCS_REQUESTER_PAYS_MODE_KEY - Static variable in class com.google.cloud.hadoop.fs.gcs.GoogleHadoopFileSystemBase
-
Configuration key for GCS project ID.
- GCS_REQUESTER_PAYS_PROJECT_ID_KEY - Static variable in class com.google.cloud.hadoop.fs.gcs.GoogleHadoopFileSystemBase
-
Configuration key for GCS Requester Pays Project ID.
- GCS_SYSTEM_BUCKET_KEY - Static variable in class com.google.cloud.hadoop.fs.gcs.GoogleHadoopFileSystemBase
-
Configuration key for system bucket name.
- GCS_WORKING_DIRECTORY_KEY - Static variable in class com.google.cloud.hadoop.fs.gcs.GoogleHadoopFileSystemBase
-
Configuration key for initial working directory of a GHFS instance.
- gcsfs - Variable in class com.google.cloud.hadoop.fs.gcs.GoogleHadoopFileSystemBase
-
Underlying GCS file system object.
- get() - Static method in enum com.google.cloud.hadoop.fs.gcs.GoogleHadoopFileSystemBase.ListStatusFileNotFoundBehavior
-
Get the ListStatusFileNotFoundBehavior for the currently running Hadoop version.
- get(HadoopVersionInfo) - Static method in enum com.google.cloud.hadoop.fs.gcs.GoogleHadoopFileSystemBase.ListStatusFileNotFoundBehavior
-
Get the ListStatusFileNotFoundBehavior for the given hadoop version/
- getCanonicalServiceName() - Method in class com.google.cloud.hadoop.fs.gcs.GoogleHadoopFileSystemBase
- getContentSummary(Path) - Method in class com.google.cloud.hadoop.fs.gcs.GoogleHadoopFileSystemBase
-
- getDefaultBlockSize() - Method in class com.google.cloud.hadoop.fs.gcs.GoogleHadoopFileSystemBase
-
- getDefaultPort() - Method in class com.google.cloud.hadoop.fs.gcs.GoogleHadoopFileSystemBase
-
The default port is listed as -1 as an indication that ports are not used.
- getDefaultReplication() - Method in class com.google.cloud.hadoop.fs.gcs.GoogleHadoopFileSystemBase
-
Gets the default replication factor.
- getDefaultWorkingDirectory() - Method in class com.google.cloud.hadoop.fs.gcs.GoogleHadoopFileSystem
-
Gets the default value of working directory.
- getDefaultWorkingDirectory() - Method in class com.google.cloud.hadoop.fs.gcs.GoogleHadoopFileSystemBase
-
Gets the default value of working directory.
- getDefaultWorkingDirectory() - Method in class com.google.cloud.hadoop.fs.gcs.GoogleHadoopGlobalRootedFileSystem
-
Deprecated.
Gets the default value of working directory.
- getDelegationToken(String) - Method in class com.google.cloud.hadoop.fs.gcs.GoogleHadoopFileSystemBase
-
- getFileBlockLocations(Path, long, long) - Method in class com.google.cloud.hadoop.fs.gcs.GoogleHadoopFS
-
- getFileChecksum(Path) - Method in class com.google.cloud.hadoop.fs.gcs.GoogleHadoopFileSystemBase
-
- getFileChecksum(Path) - Method in class com.google.cloud.hadoop.fs.gcs.GoogleHadoopFS
-
- getFileStatus(Path) - Method in class com.google.cloud.hadoop.fs.gcs.GoogleHadoopFileSystemBase
-
Gets status of the given path item.
- getFileStatus(Path) - Method in class com.google.cloud.hadoop.fs.gcs.GoogleHadoopFS
-
- getFileSystemRoot() - Method in interface com.google.cloud.hadoop.fs.gcs.FileSystemDescriptor
-
Returns the Hadoop path representing the root of the FileSystem associated with this
FileSystemDescriptor.
- getFileSystemRoot() - Method in class com.google.cloud.hadoop.fs.gcs.GoogleHadoopFileSystem
-
- getFileSystemRoot() - Method in class com.google.cloud.hadoop.fs.gcs.GoogleHadoopFileSystemBase
-
- getFileSystemRoot() - Method in class com.google.cloud.hadoop.fs.gcs.GoogleHadoopGlobalRootedFileSystem
-
Deprecated.
- getFsStatus() - Method in class com.google.cloud.hadoop.fs.gcs.GoogleHadoopFS
-
- getGcsFs() - Method in class com.google.cloud.hadoop.fs.gcs.GoogleHadoopFileSystemBase
-
Gets GCS FS instance.
- getGcsPath(Path) - Method in class com.google.cloud.hadoop.fs.gcs.GoogleHadoopFileSystem
-
Translates a "gs:/" style hadoopPath (or relative path which is not fully-qualified) into
the appropriate GCS path which is compatible with the underlying GcsFs or gsutil.
- getGcsPath(Path) - Method in class com.google.cloud.hadoop.fs.gcs.GoogleHadoopFileSystemBase
-
Gets GCS path corresponding to the given Hadoop path, which can be relative or absolute,
and can have either gs://
or gs:/ forms.
- getGcsPath(Path) - Method in class com.google.cloud.hadoop.fs.gcs.GoogleHadoopGlobalRootedFileSystem
-
Deprecated.
- getHadoopPath(URI) - Method in class com.google.cloud.hadoop.fs.gcs.GoogleHadoopFileSystem
-
Validates GCS Path belongs to this file system.
- getHadoopPath(URI) - Method in class com.google.cloud.hadoop.fs.gcs.GoogleHadoopFileSystemBase
-
Gets Hadoop path corresponding to the given GCS path.
- getHadoopPath(URI) - Method in class com.google.cloud.hadoop.fs.gcs.GoogleHadoopGlobalRootedFileSystem
-
Deprecated.
Gets Hadoop path corresponding to the given GCS path.
- getHadoopScheme() - Method in interface com.google.cloud.hadoop.fs.gcs.FileSystemDescriptor
-
Deprecated.
- getHadoopScheme() - Method in class com.google.cloud.hadoop.fs.gcs.GoogleHadoopFileSystemBase
-
Deprecated.
- getHomeDirectory() - Method in class com.google.cloud.hadoop.fs.gcs.GoogleHadoopFileSystemBase
-
Returns home directory of the current user.
- getHomeDirectorySubpath() - Method in class com.google.cloud.hadoop.fs.gcs.GoogleHadoopFileSystem
-
Override to allow a homedir subpath which sits directly on our FileSystem root.
- getHomeDirectorySubpath() - Method in class com.google.cloud.hadoop.fs.gcs.GoogleHadoopFileSystemBase
-
Returns an unqualified path without any leading slash, relative to the filesystem root,
which serves as the home directory of the current user; see getHomeDirectory for
a description of what the home directory means.
- getHomeDirectorySubpath() - Method in class com.google.cloud.hadoop.fs.gcs.GoogleHadoopGlobalRootedFileSystem
-
Deprecated.
Returns an unqualified path without any leading slash, relative to the filesystem root,
which serves as the home directory of the current user; see getHomeDirectory for
a description of what the home directory means.
- getScheme() - Method in interface com.google.cloud.hadoop.fs.gcs.FileSystemDescriptor
-
Returns the URI scheme for the Hadoop FileSystem associated with this FileSystemDescriptor.
- getScheme() - Method in class com.google.cloud.hadoop.fs.gcs.GoogleHadoopFileSystem
-
As the global-rooted FileSystem, our hadoop-path "scheme" is exactly equal to the general
GCS scheme.
- getScheme() - Method in class com.google.cloud.hadoop.fs.gcs.GoogleHadoopFileSystemBase
-
- getScheme() - Method in class com.google.cloud.hadoop.fs.gcs.GoogleHadoopGlobalRootedFileSystem
-
Deprecated.
As the global-rooted FileSystem, our hadoop-path "scheme" is distinct from GCS's scheme.
- getServerDefaults() - Method in class com.google.cloud.hadoop.fs.gcs.GoogleHadoopFS
-
- getUri() - Method in class com.google.cloud.hadoop.fs.gcs.GoogleHadoopFileSystemBase
-
Returns a URI of the root of this FileSystem.
- getUri() - Method in class com.google.cloud.hadoop.fs.gcs.GoogleHadoopFS
-
This is overridden to use GoogleHadoopFileSystem's URI, because AbstractFileSystem appends the
default port to the authority.
- getUriDefaultPort() - Method in class com.google.cloud.hadoop.fs.gcs.GoogleHadoopFS
-
- getUsed() - Method in class com.google.cloud.hadoop.fs.gcs.GoogleHadoopFileSystemBase
-
- getWorkingDirectory() - Method in class com.google.cloud.hadoop.fs.gcs.GoogleHadoopFileSystemBase
-
Gets the current working directory.
- GHFS_ID - Static variable in class com.google.cloud.hadoop.fs.gcs.GoogleHadoopFileSystemBase
-
Identifies this version of the GoogleHadoopFileSystemBase library.
- globStatus(Path) - Method in class com.google.cloud.hadoop.fs.gcs.GoogleHadoopFileSystemBase
-
Returns an array of FileStatus objects whose path names match pathPattern.
- globStatus(Path, PathFilter) - Method in class com.google.cloud.hadoop.fs.gcs.GoogleHadoopFileSystemBase
-
Returns an array of FileStatus objects whose path names match pathPattern
and is accepted by the user-supplied path filter.
- GoogleHadoopFileSystem - Class in com.google.cloud.hadoop.fs.gcs
-
GoogleHadoopFileSystem is a version of GoogleHadoopFileSystemBase which is rooted in a single
bucket at initialization time; in this case, Hadoop paths no longer correspond directly to
general GCS paths, and all Hadoop operations going through this FileSystem will never touch
any GCS bucket other than the bucket on which this FileSystem is rooted.
- GoogleHadoopFileSystem() - Constructor for class com.google.cloud.hadoop.fs.gcs.GoogleHadoopFileSystem
-
Constructs an instance of GoogleHadoopFileSystem; the internal
GoogleCloudStorageFileSystem will be set up with config settings when initialize() is called.
- GoogleHadoopFileSystem(GoogleCloudStorageFileSystem) - Constructor for class com.google.cloud.hadoop.fs.gcs.GoogleHadoopFileSystem
-
Constructs an instance of GoogleHadoopFileSystem using the provided
GoogleCloudStorageFileSystem; initialize() will not re-initialize it.
- GoogleHadoopFileSystemBase - Class in com.google.cloud.hadoop.fs.gcs
-
This class provides a Hadoop compatible File System on top of Google Cloud Storage (GCS).
- GoogleHadoopFileSystemBase() - Constructor for class com.google.cloud.hadoop.fs.gcs.GoogleHadoopFileSystemBase
-
Constructs an instance of GoogleHadoopFileSystemBase; the internal
GoogleCloudStorageFileSystem will be set up with config settings when initialize() is called.
- GoogleHadoopFileSystemBase(GoogleCloudStorageFileSystem) - Constructor for class com.google.cloud.hadoop.fs.gcs.GoogleHadoopFileSystemBase
-
Constructs an instance of GoogleHadoopFileSystemBase using the provided
GoogleCloudStorageFileSystem; initialize() will not re-initialize it.
- GoogleHadoopFileSystemBase.Counter - Enum in com.google.cloud.hadoop.fs.gcs
-
Defines names of counters we track for each operation.
- GoogleHadoopFileSystemBase.ListStatusFileNotFoundBehavior - Enum in com.google.cloud.hadoop.fs.gcs
-
Behavior of listStatus when a path is not found.
- GoogleHadoopFileSystemBase.OutputStreamType - Enum in com.google.cloud.hadoop.fs.gcs
-
- GoogleHadoopFileSystemBase.ParentTimestampUpdateIncludePredicate - Class in com.google.cloud.hadoop.fs.gcs
-
A predicate that processes individual directory paths and evaluates the conditions set in
fs.gs.parent.timestamp.update.enable, fs.gs.parent.timestamp.update.substrings.include and
fs.gs.parent.timestamp.update.substrings.exclude to determine if a path should be ignored
when running directory timestamp updates.
- GoogleHadoopFileSystemCacheCleaner - Class in com.google.cloud.hadoop.fs.gcs
-
- GoogleHadoopFileSystemCacheCleaner() - Constructor for class com.google.cloud.hadoop.fs.gcs.GoogleHadoopFileSystemCacheCleaner
-
- GoogleHadoopFS - Class in com.google.cloud.hadoop.fs.gcs
-
GoogleHadoopFS provides a YARN compatible Abstract File System on top of
Google Cloud Storage (GCS).
- GoogleHadoopFS(URI, Configuration) - Constructor for class com.google.cloud.hadoop.fs.gcs.GoogleHadoopFS
-
- GoogleHadoopFS(GoogleHadoopFileSystem, URI, Configuration) - Constructor for class com.google.cloud.hadoop.fs.gcs.GoogleHadoopFS
-
- GoogleHadoopGlobalRootedFileSystem - Class in com.google.cloud.hadoop.fs.gcs
-
- GoogleHadoopGlobalRootedFileSystem() - Constructor for class com.google.cloud.hadoop.fs.gcs.GoogleHadoopGlobalRootedFileSystem
-
Deprecated.
Constructs an instance of GoogleHadoopGlobalRootedFileSystem; the internal
GoogleCloudStorageFileSystem will be set up with config settings when initialize() is called.
- GoogleHadoopGlobalRootedFileSystem(GoogleCloudStorageFileSystem) - Constructor for class com.google.cloud.hadoop.fs.gcs.GoogleHadoopGlobalRootedFileSystem
-
Deprecated.
Constructs an instance of GoogleHadoopGlobalRootedFileSystem using the provided
GoogleCloudStorageFileSystem; initialize() will not re-initialize it.
- GoogleHadoopSyncableOutputStream - Class in com.google.cloud.hadoop.fs.gcs
-
GoogleHadoopSyncableOutputStream implements the Syncable interface by composing
objects created in separate underlying streams for each hsync() call.
- GoogleHadoopSyncableOutputStream(GoogleHadoopFileSystemBase, URI, int, FileSystem.Statistics, CreateFileOptions) - Constructor for class com.google.cloud.hadoop.fs.gcs.GoogleHadoopSyncableOutputStream
-
Creates a new GoogleHadoopSyncableOutputStream with initial stream initialized and expected
to begin at file-offset 0.