- GCE_BUCKET_DELETE_ENABLE - Static variable in class com.google.cloud.hadoop.fs.gcs.GoogleHadoopFileSystemConfiguration
-
If true, recursive delete on a path that refers to a GCS bucket itself ('/' for any
bucket-rooted GoogleHadoopFileSystem) or delete on that path when it's empty will result in
fully deleting the GCS bucket.
- GCE_BUCKET_DELETE_ENABLE_DEFAULT - Static variable in class com.google.cloud.hadoop.fs.gcs.GoogleHadoopFileSystemBase
-
- GCE_BUCKET_DELETE_ENABLE_KEY - Static variable in class com.google.cloud.hadoop.fs.gcs.GoogleHadoopFileSystemBase
-
- GCS_APPLICATION_NAME_SUFFIX - Static variable in class com.google.cloud.hadoop.fs.gcs.GoogleHadoopFileSystemConfiguration
-
Configuration key for adding a suffix to the GHFS application name sent to GCS.
- GCS_APPLICATION_NAME_SUFFIX_DEFAULT - Static variable in class com.google.cloud.hadoop.fs.gcs.GoogleHadoopFileSystemBase
-
- GCS_APPLICATION_NAME_SUFFIX_KEY - Static variable in class com.google.cloud.hadoop.fs.gcs.GoogleHadoopFileSystemBase
-
- GCS_BATCH_THREADS - Static variable in class com.google.cloud.hadoop.fs.gcs.GoogleHadoopFileSystemBase
-
- GCS_BATCH_THREADS - Static variable in class com.google.cloud.hadoop.fs.gcs.GoogleHadoopFileSystemConfiguration
-
Configuration key for a number of threads to execute batch requests.
- GCS_BATCH_THREADS_DEFAULT - Static variable in class com.google.cloud.hadoop.fs.gcs.GoogleHadoopFileSystemBase
-
- GCS_CLIENT_ID_KEY - Static variable in class com.google.cloud.hadoop.fs.gcs.GoogleHadoopFileSystemBase
-
- GCS_CLIENT_SECRET_KEY - Static variable in class com.google.cloud.hadoop.fs.gcs.GoogleHadoopFileSystemBase
-
- GCS_CONCURRENT_GLOB_ENABLE - Static variable in class com.google.cloud.hadoop.fs.gcs.GoogleHadoopFileSystemConfiguration
-
Configuration key for enabling the use of flat and regular glob search algorithms in two
parallel threads.
- GCS_CONFIG_OVERRIDE_FILE - Static variable in class com.google.cloud.hadoop.fs.gcs.GoogleHadoopFileSystemConfiguration
-
Override configuration file path.
- GCS_COPY_BATCH_THREADS - Static variable in class com.google.cloud.hadoop.fs.gcs.GoogleHadoopFileSystemBase
-
- GCS_COPY_BATCH_THREADS - Static variable in class com.google.cloud.hadoop.fs.gcs.GoogleHadoopFileSystemConfiguration
-
Configuration key for a number of threads to execute batch requests for copy operations.
- GCS_COPY_BATCH_THREADS_DEFAULT - Static variable in class com.google.cloud.hadoop.fs.gcs.GoogleHadoopFileSystemBase
-
- GCS_COPY_MAX_REQUESTS_PER_BATCH - Static variable in class com.google.cloud.hadoop.fs.gcs.GoogleHadoopFileSystemBase
-
- GCS_COPY_MAX_REQUESTS_PER_BATCH - Static variable in class com.google.cloud.hadoop.fs.gcs.GoogleHadoopFileSystemConfiguration
-
Configuration key for a max number of GCS RPCs in batch request for copy operations.
- GCS_COPY_MAX_REQUESTS_PER_BATCH_DEFAULT - Static variable in class com.google.cloud.hadoop.fs.gcs.GoogleHadoopFileSystemBase
-
- GCS_COPY_WITH_REWRITE_ENABLE - Static variable in class com.google.cloud.hadoop.fs.gcs.GoogleHadoopFileSystemConfiguration
-
Configuration key for enabling the use of Rewrite requests for copy operations.
- GCS_CREATE_SYSTEM_BUCKET - Static variable in class com.google.cloud.hadoop.fs.gcs.GoogleHadoopFileSystemConfiguration
-
Configuration key for flag to indicate whether system bucket should be created if it does not
exist.
- GCS_CREATE_SYSTEM_BUCKET_DEFAULT - Static variable in class com.google.cloud.hadoop.fs.gcs.GoogleHadoopFileSystemBase
-
- GCS_CREATE_SYSTEM_BUCKET_KEY - Static variable in class com.google.cloud.hadoop.fs.gcs.GoogleHadoopFileSystemBase
-
- GCS_ENABLE_COPY_WITH_REWRITE_DEFAULT - Static variable in class com.google.cloud.hadoop.fs.gcs.GoogleHadoopFileSystemBase
-
- GCS_ENABLE_COPY_WITH_REWRITE_KEY - Static variable in class com.google.cloud.hadoop.fs.gcs.GoogleHadoopFileSystemBase
-
- GCS_ENABLE_FLAT_GLOB_DEFAULT - Static variable in class com.google.cloud.hadoop.fs.gcs.GoogleHadoopFileSystemBase
-
- GCS_ENABLE_FLAT_GLOB_KEY - Static variable in class com.google.cloud.hadoop.fs.gcs.GoogleHadoopFileSystemBase
-
- GCS_ENABLE_INFER_IMPLICIT_DIRECTORIES_DEFAULT - Static variable in class com.google.cloud.hadoop.fs.gcs.GoogleHadoopFileSystemBase
-
- GCS_ENABLE_INFER_IMPLICIT_DIRECTORIES_KEY - Static variable in class com.google.cloud.hadoop.fs.gcs.GoogleHadoopFileSystemBase
-
- GCS_ENABLE_MARKER_FILE_CREATION_DEFAULT - Static variable in class com.google.cloud.hadoop.fs.gcs.GoogleHadoopFileSystemBase
-
- GCS_ENABLE_MARKER_FILE_CREATION_KEY - Static variable in class com.google.cloud.hadoop.fs.gcs.GoogleHadoopFileSystemBase
-
- GCS_ENABLE_PERFORMANCE_CACHE_DEFAULT - Static variable in class com.google.cloud.hadoop.fs.gcs.GoogleHadoopFileSystemBase
-
- GCS_ENABLE_PERFORMANCE_CACHE_KEY - Static variable in class com.google.cloud.hadoop.fs.gcs.GoogleHadoopFileSystemBase
-
- GCS_ENABLE_REPAIR_IMPLICIT_DIRECTORIES_DEFAULT - Static variable in class com.google.cloud.hadoop.fs.gcs.GoogleHadoopFileSystemBase
-
- GCS_ENABLE_REPAIR_IMPLICIT_DIRECTORIES_KEY - Static variable in class com.google.cloud.hadoop.fs.gcs.GoogleHadoopFileSystemBase
-
- GCS_FILE_CHECKSUM_TYPE - Static variable in class com.google.cloud.hadoop.fs.gcs.GoogleHadoopFileSystemConfiguration
-
Configuration key for which type of FileChecksum to return; if a particular file doesn't
support the requested type, then getFileChecksum() will return null for that file.
- GCS_FILE_SIZE_LIMIT_250GB - Static variable in class com.google.cloud.hadoop.fs.gcs.GoogleHadoopFileSystemBase
-
- GCS_FILE_SIZE_LIMIT_250GB - Static variable in class com.google.cloud.hadoop.fs.gcs.GoogleHadoopFileSystemConfiguration
-
Configuration key for setting 250GB upper limit on file size to gain higher write throughput.
- GCS_FILE_SIZE_LIMIT_250GB_DEFAULT - Static variable in class com.google.cloud.hadoop.fs.gcs.GoogleHadoopFileSystemBase
-
- GCS_FLAT_GLOB_ENABLE - Static variable in class com.google.cloud.hadoop.fs.gcs.GoogleHadoopFileSystemConfiguration
-
Configuration key for enabling the use of a large flat listing to pre-populate possible glob
matches in a single API call before running the core globbing logic in-memory rather than
sequentially and recursively performing API calls.
- GCS_GENERATION_READ_CONSISTENCY - Static variable in class com.google.cloud.hadoop.fs.gcs.GoogleHadoopFileSystemConfiguration
-
Configuration key for the generation consistency read model.
- GCS_GENERATION_READ_CONSISTENCY_DEFAULT - Static variable in class com.google.cloud.hadoop.fs.gcs.GoogleHadoopFileSystemBase
-
- GCS_GENERATION_READ_CONSISTENCY_KEY - Static variable in class com.google.cloud.hadoop.fs.gcs.GoogleHadoopFileSystemBase
-
- GCS_HTTP_CONNECT_TIMEOUT - Static variable in class com.google.cloud.hadoop.fs.gcs.GoogleHadoopFileSystemConfiguration
-
Configuration key for the connect timeout (in millisecond) for HTTP request to GCS.
- GCS_HTTP_CONNECT_TIMEOUT_DEFAULT - Static variable in class com.google.cloud.hadoop.fs.gcs.GoogleHadoopFileSystemBase
-
- GCS_HTTP_CONNECT_TIMEOUT_KEY - Static variable in class com.google.cloud.hadoop.fs.gcs.GoogleHadoopFileSystemBase
-
- GCS_HTTP_MAX_RETRY - Static variable in class com.google.cloud.hadoop.fs.gcs.GoogleHadoopFileSystemConfiguration
-
Configuration key for the max number of retries for failed HTTP request to GCS.
- GCS_HTTP_MAX_RETRY_DEFAULT - Static variable in class com.google.cloud.hadoop.fs.gcs.GoogleHadoopFileSystemBase
-
- GCS_HTTP_MAX_RETRY_KEY - Static variable in class com.google.cloud.hadoop.fs.gcs.GoogleHadoopFileSystemBase
-
- GCS_HTTP_READ_TIMEOUT - Static variable in class com.google.cloud.hadoop.fs.gcs.GoogleHadoopFileSystemConfiguration
-
Configuration key for the connect timeout (in millisecond) for HTTP request to GCS.
- GCS_HTTP_READ_TIMEOUT_DEFAULT - Static variable in class com.google.cloud.hadoop.fs.gcs.GoogleHadoopFileSystemBase
-
- GCS_HTTP_READ_TIMEOUT_KEY - Static variable in class com.google.cloud.hadoop.fs.gcs.GoogleHadoopFileSystemBase
-
- GCS_HTTP_TRANSPORT - Static variable in class com.google.cloud.hadoop.fs.gcs.GoogleHadoopFileSystemConfiguration
-
Configuration key for the name of HttpTransport class to use for connecting to GCS.
- GCS_HTTP_TRANSPORT_DEFAULT - Static variable in class com.google.cloud.hadoop.fs.gcs.GoogleHadoopFileSystemBase
-
- GCS_HTTP_TRANSPORT_KEY - Static variable in class com.google.cloud.hadoop.fs.gcs.GoogleHadoopFileSystemBase
-
- GCS_INFER_IMPLICIT_DIRECTORIES_ENABLE - Static variable in class com.google.cloud.hadoop.fs.gcs.GoogleHadoopFileSystemConfiguration
-
Configuration key for enabling automatic inference of implicit directories.
- GCS_INPUT_STREAM_BUFFER_SIZE - Static variable in class com.google.cloud.hadoop.fs.gcs.GoogleHadoopFileSystemConfiguration
-
Configuration key for setting read buffer size.
- GCS_INPUT_STREAM_FADVISE - Static variable in class com.google.cloud.hadoop.fs.gcs.GoogleHadoopFileSystemConfiguration
-
Tunes reading objects behavior to optimize HTTP GET requests for various use cases.
- GCS_INPUT_STREAM_FAST_FAIL_ON_NOT_FOUND_ENABLE - Static variable in class com.google.cloud.hadoop.fs.gcs.GoogleHadoopFileSystemConfiguration
-
If true, on opening a file we will proactively perform a metadata GET to check whether the
object exists, even though the underlying channel will not open a data stream until read() is
actually called so that streams can seek to nonzero file positions without incurring an extra
stream creation.
- GCS_INPUT_STREAM_INPLACE_SEEK_LIMIT - Static variable in class com.google.cloud.hadoop.fs.gcs.GoogleHadoopFileSystemConfiguration
-
If forward seeks are within this many bytes of the current position, seeks are performed by
reading and discarding bytes in-place rather than opening a new underlying stream.
- GCS_INPUT_STREAM_MIN_RANGE_REQUEST_SIZE - Static variable in class com.google.cloud.hadoop.fs.gcs.GoogleHadoopFileSystemConfiguration
-
Minimum size in bytes of the HTTP Range header set in GCS request when opening new stream to
read an object.
- GCS_INPUTSTREAM_FADVISE_DEFAULT - Static variable in class com.google.cloud.hadoop.fs.gcs.GoogleHadoopFileSystemBase
-
- GCS_INPUTSTREAM_FADVISE_KEY - Static variable in class com.google.cloud.hadoop.fs.gcs.GoogleHadoopFileSystemBase
-
- GCS_INPUTSTREAM_FAST_FAIL_ON_NOT_FOUND_ENABLE_DEFAULT - Static variable in class com.google.cloud.hadoop.fs.gcs.GoogleHadoopFileSystemBase
-
- GCS_INPUTSTREAM_FAST_FAIL_ON_NOT_FOUND_ENABLE_KEY - Static variable in class com.google.cloud.hadoop.fs.gcs.GoogleHadoopFileSystemBase
-
- GCS_INPUTSTREAM_INPLACE_SEEK_LIMIT_DEFAULT - Static variable in class com.google.cloud.hadoop.fs.gcs.GoogleHadoopFileSystemBase
-
- GCS_INPUTSTREAM_INPLACE_SEEK_LIMIT_KEY - Static variable in class com.google.cloud.hadoop.fs.gcs.GoogleHadoopFileSystemBase
-
- GCS_INPUTSTREAM_MIN_RANGE_REQUEST_SIZE_DEFAULT - Static variable in class com.google.cloud.hadoop.fs.gcs.GoogleHadoopFileSystemBase
-
- GCS_INPUTSTREAM_MIN_RANGE_REQUEST_SIZE_KEY - Static variable in class com.google.cloud.hadoop.fs.gcs.GoogleHadoopFileSystemBase
-
- GCS_LAZY_INITIALIZATION_ENABLE - Static variable in class com.google.cloud.hadoop.fs.gcs.GoogleHadoopFileSystemConfiguration
-
Configuration key for enabling lazy initialization of GCS FS instance.
- GCS_MARKER_FILE_CREATION_ENABLE - Static variable in class com.google.cloud.hadoop.fs.gcs.GoogleHadoopFileSystemConfiguration
-
Configuration key for enabling the use of marker files during file creation.
- GCS_MARKER_FILE_PATTERN - Static variable in class com.google.cloud.hadoop.fs.gcs.GoogleHadoopFileSystemConfiguration
-
Configuration key for marker file pattern.
- GCS_MARKER_FILE_PATTERN_KEY - Static variable in class com.google.cloud.hadoop.fs.gcs.GoogleHadoopFileSystemBase
-
- GCS_MAX_LIST_ITEMS_PER_CALL - Static variable in class com.google.cloud.hadoop.fs.gcs.GoogleHadoopFileSystemBase
-
- GCS_MAX_LIST_ITEMS_PER_CALL - Static variable in class com.google.cloud.hadoop.fs.gcs.GoogleHadoopFileSystemConfiguration
-
Configuration key for number of items to return per call to the list* GCS RPCs.
- GCS_MAX_LIST_ITEMS_PER_CALL_DEFAULT - Static variable in class com.google.cloud.hadoop.fs.gcs.GoogleHadoopFileSystemBase
-
- GCS_MAX_REQUESTS_PER_BATCH - Static variable in class com.google.cloud.hadoop.fs.gcs.GoogleHadoopFileSystemBase
-
- GCS_MAX_REQUESTS_PER_BATCH - Static variable in class com.google.cloud.hadoop.fs.gcs.GoogleHadoopFileSystemConfiguration
-
Configuration key for a max number of GCS RPCs in batch request.
- GCS_MAX_REQUESTS_PER_BATCH_DEFAULT - Static variable in class com.google.cloud.hadoop.fs.gcs.GoogleHadoopFileSystemBase
-
- GCS_MAX_WAIT_MILLIS_EMPTY_OBJECT_CREATE - Static variable in class com.google.cloud.hadoop.fs.gcs.GoogleHadoopFileSystemConfiguration
-
Configuration key for modifying the maximum amount of time to wait for empty object creation.
- GCS_MAX_WAIT_MILLIS_EMPTY_OBJECT_CREATE_DEFAULT - Static variable in class com.google.cloud.hadoop.fs.gcs.GoogleHadoopFileSystemBase
-
- GCS_MAX_WAIT_MILLIS_EMPTY_OBJECT_CREATE_KEY - Static variable in class com.google.cloud.hadoop.fs.gcs.GoogleHadoopFileSystemBase
-
- GCS_OUTPUT_STREAM_BUFFER_SIZE - Static variable in class com.google.cloud.hadoop.fs.gcs.GoogleHadoopFileSystemConfiguration
-
Configuration key for setting write buffer size.
- GCS_OUTPUT_STREAM_PIPE_BUFFER_SIZE - Static variable in class com.google.cloud.hadoop.fs.gcs.GoogleHadoopFileSystemConfiguration
-
Configuration key for setting pipe buffer size.
- GCS_OUTPUT_STREAM_TYPE - Static variable in class com.google.cloud.hadoop.fs.gcs.GoogleHadoopFileSystemConfiguration
-
Configuration key for which type of output stream to use; different options may have different
degrees of support for advanced features like hsync()
and different performance
characteristics.
- GCS_OUTPUT_STREAM_UPLOAD_CHUNK_SIZE - Static variable in class com.google.cloud.hadoop.fs.gcs.GoogleHadoopFileSystemConfiguration
-
Configuration key for setting GCS upload chunk size.
- GCS_OUTPUTSTREAM_TYPE_DEFAULT - Static variable in class com.google.cloud.hadoop.fs.gcs.GoogleHadoopFileSystemBase
-
- GCS_OUTPUTSTREAM_TYPE_KEY - Static variable in class com.google.cloud.hadoop.fs.gcs.GoogleHadoopFileSystemBase
-
- GCS_PARENT_TIMESTAMP_UPDATE_ENABLE - Static variable in class com.google.cloud.hadoop.fs.gcs.GoogleHadoopFileSystemConfiguration
-
Configuration key for whether or not we should update timestamps for parent directories when we
create new files in them.
- GCS_PARENT_TIMESTAMP_UPDATE_ENABLE_DEFAULT - Static variable in class com.google.cloud.hadoop.fs.gcs.GoogleHadoopFileSystemBase
-
- GCS_PARENT_TIMESTAMP_UPDATE_ENABLE_KEY - Static variable in class com.google.cloud.hadoop.fs.gcs.GoogleHadoopFileSystemBase
-
- GCS_PARENT_TIMESTAMP_UPDATE_EXCLUDES - Static variable in class com.google.cloud.hadoop.fs.gcs.GoogleHadoopFileSystemConfiguration
-
Configuration key containing a comma-separated list of sub-strings that when matched will cause
a particular directory to not have its modification timestamp updated.
- GCS_PARENT_TIMESTAMP_UPDATE_EXCLUDES_DEFAULT - Static variable in class com.google.cloud.hadoop.fs.gcs.GoogleHadoopFileSystemBase
-
- GCS_PARENT_TIMESTAMP_UPDATE_EXCLUDES_KEY - Static variable in class com.google.cloud.hadoop.fs.gcs.GoogleHadoopFileSystemBase
-
- GCS_PARENT_TIMESTAMP_UPDATE_INCLUDES - Static variable in class com.google.cloud.hadoop.fs.gcs.GoogleHadoopFileSystemConfiguration
-
Configuration key containing a comma-separated list of sub-strings that when matched will cause
a particular directory to have its modification timestamp updated.
- GCS_PARENT_TIMESTAMP_UPDATE_INCLUDES_DEFAULT - Static variable in class com.google.cloud.hadoop.fs.gcs.GoogleHadoopFileSystemBase
-
- GCS_PARENT_TIMESTAMP_UPDATE_INCLUDES_KEY - Static variable in class com.google.cloud.hadoop.fs.gcs.GoogleHadoopFileSystemBase
-
- GCS_PERFORMANCE_CACHE_DIR_METADATA_PREFETCH_LIMIT - Static variable in class com.google.cloud.hadoop.fs.gcs.GoogleHadoopFileSystemConfiguration
-
Deprecated.
- GCS_PERFORMANCE_CACHE_DIR_METADATA_PREFETCH_LIMIT_DEFAULT - Static variable in class com.google.cloud.hadoop.fs.gcs.GoogleHadoopFileSystemBase
-
- GCS_PERFORMANCE_CACHE_DIR_METADATA_PREFETCH_LIMIT_KEY - Static variable in class com.google.cloud.hadoop.fs.gcs.GoogleHadoopFileSystemBase
-
- GCS_PERFORMANCE_CACHE_ENABLE - Static variable in class com.google.cloud.hadoop.fs.gcs.GoogleHadoopFileSystemConfiguration
-
Configuration key for using a local item cache to supplement GCS API "getFile" results.
- GCS_PERFORMANCE_CACHE_LIST_CACHING_ENABLE - Static variable in class com.google.cloud.hadoop.fs.gcs.GoogleHadoopFileSystemConfiguration
-
Configuration key for whether or not to enable list caching for the performance cache.
- GCS_PERFORMANCE_CACHE_LIST_CACHING_ENABLE_DEFAULT - Static variable in class com.google.cloud.hadoop.fs.gcs.GoogleHadoopFileSystemBase
-
- GCS_PERFORMANCE_CACHE_LIST_CACHING_ENABLE_KEY - Static variable in class com.google.cloud.hadoop.fs.gcs.GoogleHadoopFileSystemBase
-
- GCS_PERFORMANCE_CACHE_MAX_ENTRY_AGE_MILLIS - Static variable in class com.google.cloud.hadoop.fs.gcs.GoogleHadoopFileSystemConfiguration
-
Configuration key for maximum number of milliseconds a GoogleCloudStorageItemInfo will remain
"valid" in the performance cache before it's invalidated.
- GCS_PERFORMANCE_CACHE_MAX_ENTRY_AGE_MILLIS_DEFAULT - Static variable in class com.google.cloud.hadoop.fs.gcs.GoogleHadoopFileSystemBase
-
- GCS_PERFORMANCE_CACHE_MAX_ENTRY_AGE_MILLIS_KEY - Static variable in class com.google.cloud.hadoop.fs.gcs.GoogleHadoopFileSystemBase
-
- GCS_PROJECT_ID - Static variable in class com.google.cloud.hadoop.fs.gcs.GoogleHadoopFileSystemConfiguration
-
Configuration key for GCS project ID.
- GCS_PROJECT_ID_KEY - Static variable in class com.google.cloud.hadoop.fs.gcs.GoogleHadoopFileSystemBase
-
- GCS_PROXY_ADDRESS - Static variable in class com.google.cloud.hadoop.fs.gcs.GoogleHadoopFileSystemConfiguration
-
Configuration key for setting a proxy for the connector to use to connect to GCS.
- GCS_PROXY_ADDRESS_DEFAULT - Static variable in class com.google.cloud.hadoop.fs.gcs.GoogleHadoopFileSystemBase
-
- GCS_PROXY_ADDRESS_KEY - Static variable in class com.google.cloud.hadoop.fs.gcs.GoogleHadoopFileSystemBase
-
- GCS_PROXY_PASSWORD - Static variable in class com.google.cloud.hadoop.fs.gcs.GoogleHadoopFileSystemConfiguration
-
Configuration key for setting a proxy password for the connector to use to authenticate with
proxy used to connect to GCS.
- GCS_PROXY_USERNAME - Static variable in class com.google.cloud.hadoop.fs.gcs.GoogleHadoopFileSystemConfiguration
-
Configuration key for setting a proxy username for the connector to use to authenticate with
proxy used to connect to GCS.
- GCS_REPAIR_IMPLICIT_DIRECTORIES_ENABLE - Static variable in class com.google.cloud.hadoop.fs.gcs.GoogleHadoopFileSystemConfiguration
-
Configuration key for enabling automatic repair of implicit directories whenever detected
inside listStatus and globStatus calls, or other methods which may indirectly call listStatus
and/or globStatus.
- GCS_REQUESTER_PAYS_BUCKETS - Static variable in class com.google.cloud.hadoop.fs.gcs.GoogleHadoopFileSystemConfiguration
-
Configuration key for GCS Requester Pays Buckets.
- GCS_REQUESTER_PAYS_BUCKETS_KEY - Static variable in class com.google.cloud.hadoop.fs.gcs.GoogleHadoopFileSystemBase
-
- GCS_REQUESTER_PAYS_MODE - Static variable in class com.google.cloud.hadoop.fs.gcs.GoogleHadoopFileSystemConfiguration
-
Configuration key for GCS project ID.
- GCS_REQUESTER_PAYS_MODE_KEY - Static variable in class com.google.cloud.hadoop.fs.gcs.GoogleHadoopFileSystemBase
-
- GCS_REQUESTER_PAYS_PROJECT_ID - Static variable in class com.google.cloud.hadoop.fs.gcs.GoogleHadoopFileSystemConfiguration
-
Configuration key for GCS Requester Pays Project ID.
- GCS_REQUESTER_PAYS_PROJECT_ID_KEY - Static variable in class com.google.cloud.hadoop.fs.gcs.GoogleHadoopFileSystemBase
-
- GCS_REWRITE_MAX_BYTES_PER_CALL - Static variable in class com.google.cloud.hadoop.fs.gcs.GoogleHadoopFileSystemConfiguration
-
- GCS_SYSTEM_BUCKET - Static variable in class com.google.cloud.hadoop.fs.gcs.GoogleHadoopFileSystemConfiguration
-
Deprecated.
- GCS_SYSTEM_BUCKET_KEY - Static variable in class com.google.cloud.hadoop.fs.gcs.GoogleHadoopFileSystemBase
-
- GCS_WORKING_DIRECTORY - Static variable in class com.google.cloud.hadoop.fs.gcs.GoogleHadoopFileSystemConfiguration
-
Configuration key for initial working directory of a GHFS instance.
- GCS_WORKING_DIRECTORY_KEY - Static variable in class com.google.cloud.hadoop.fs.gcs.GoogleHadoopFileSystemBase
-
- get() - Static method in enum com.google.cloud.hadoop.fs.gcs.GoogleHadoopFileSystemBase.ListStatusFileNotFoundBehavior
-
Get the ListStatusFileNotFoundBehavior for the currently running Hadoop version.
- get(HadoopVersionInfo) - Static method in enum com.google.cloud.hadoop.fs.gcs.GoogleHadoopFileSystemBase.ListStatusFileNotFoundBehavior
-
Get the ListStatusFileNotFoundBehavior for the given hadoop version/
- getAlgorithmName() - Method in enum com.google.cloud.hadoop.fs.gcs.GoogleHadoopFileSystemBase.GcsFileChecksumType
-
- getByteLength() - Method in enum com.google.cloud.hadoop.fs.gcs.GoogleHadoopFileSystemBase.GcsFileChecksumType
-
- getCanonicalServiceName() - Method in class com.google.cloud.hadoop.fs.gcs.GoogleHadoopFileSystemBase
- getContentSummary(Path) - Method in class com.google.cloud.hadoop.fs.gcs.GoogleHadoopFileSystemBase
-
- getDefault() - Method in class com.google.cloud.hadoop.fs.gcs.GoogleHadoopFileSystemConfigurationProperty
-
- getDefaultBlockSize() - Method in class com.google.cloud.hadoop.fs.gcs.GoogleHadoopFileSystemBase
-
- getDefaultPort() - Method in class com.google.cloud.hadoop.fs.gcs.GoogleHadoopFileSystemBase
-
The default port is listed as -1 as an indication that ports are not used.
- getDefaultReplication() - Method in class com.google.cloud.hadoop.fs.gcs.GoogleHadoopFileSystemBase
-
Gets the default replication factor.
- getDefaultWorkingDirectory() - Method in class com.google.cloud.hadoop.fs.gcs.GoogleHadoopFileSystem
-
Gets the default value of working directory.
- getDefaultWorkingDirectory() - Method in class com.google.cloud.hadoop.fs.gcs.GoogleHadoopFileSystemBase
-
Gets the default value of working directory.
- getDelegationToken(String) - Method in class com.google.cloud.hadoop.fs.gcs.GoogleHadoopFileSystemBase
-
- getFileBlockLocations(Path, long, long) - Method in class com.google.cloud.hadoop.fs.gcs.GoogleHadoopFS
-
- getFileChecksum(Path) - Method in class com.google.cloud.hadoop.fs.gcs.GoogleHadoopFileSystemBase
-
- getFileChecksum(Path) - Method in class com.google.cloud.hadoop.fs.gcs.GoogleHadoopFS
-
- getFileStatus(Path) - Method in class com.google.cloud.hadoop.fs.gcs.GoogleHadoopFileSystemBase
-
Gets status of the given path item.
- getFileStatus(Path) - Method in class com.google.cloud.hadoop.fs.gcs.GoogleHadoopFS
-
- getFileSystemRoot() - Method in interface com.google.cloud.hadoop.fs.gcs.FileSystemDescriptor
-
Returns the Hadoop path representing the root of the FileSystem associated with this
FileSystemDescriptor.
- getFileSystemRoot() - Method in class com.google.cloud.hadoop.fs.gcs.GoogleHadoopFileSystem
-
- getFileSystemRoot() - Method in class com.google.cloud.hadoop.fs.gcs.GoogleHadoopFileSystemBase
-
- getFsStatus() - Method in class com.google.cloud.hadoop.fs.gcs.GoogleHadoopFS
-
- getGcsFs() - Method in class com.google.cloud.hadoop.fs.gcs.GoogleHadoopFileSystemBase
-
Gets GCS FS instance.
- getGcsPath(Path) - Method in class com.google.cloud.hadoop.fs.gcs.GoogleHadoopFileSystem
-
Translates a "gs:/" style hadoopPath (or relative path which is not fully-qualified) into
the appropriate GCS path which is compatible with the underlying GcsFs or gsutil.
- getGcsPath(Path) - Method in class com.google.cloud.hadoop.fs.gcs.GoogleHadoopFileSystemBase
-
Gets GCS path corresponding to the given Hadoop path, which can be relative or absolute,
and can have either gs://
or gs:/ forms.
- getHadoopPath(URI) - Method in class com.google.cloud.hadoop.fs.gcs.GoogleHadoopFileSystem
-
Validates GCS Path belongs to this file system.
- getHadoopPath(URI) - Method in class com.google.cloud.hadoop.fs.gcs.GoogleHadoopFileSystemBase
-
Gets Hadoop path corresponding to the given GCS path.
- getHadoopScheme() - Method in interface com.google.cloud.hadoop.fs.gcs.FileSystemDescriptor
-
Deprecated.
- getHadoopScheme() - Method in class com.google.cloud.hadoop.fs.gcs.GoogleHadoopFileSystemBase
-
Deprecated.
- getHomeDirectory() - Method in class com.google.cloud.hadoop.fs.gcs.GoogleHadoopFileSystemBase
-
Returns home directory of the current user.
- getHomeDirectorySubpath() - Method in class com.google.cloud.hadoop.fs.gcs.GoogleHadoopFileSystem
-
Override to allow a homedir subpath which sits directly on our FileSystem root.
- getHomeDirectorySubpath() - Method in class com.google.cloud.hadoop.fs.gcs.GoogleHadoopFileSystemBase
-
Returns an unqualified path without any leading slash, relative to the filesystem root,
which serves as the home directory of the current user; see getHomeDirectory
for
a description of what the home directory means.
- getKey() - Method in class com.google.cloud.hadoop.fs.gcs.GoogleHadoopFileSystemConfigurationProperty
-
- getScheme() - Method in interface com.google.cloud.hadoop.fs.gcs.FileSystemDescriptor
-
Returns the URI scheme for the Hadoop FileSystem associated with this FileSystemDescriptor.
- getScheme() - Method in class com.google.cloud.hadoop.fs.gcs.GoogleHadoopFileSystem
-
As the global-rooted FileSystem, our hadoop-path "scheme" is exactly equal to the general
GCS scheme.
- getScheme() - Method in class com.google.cloud.hadoop.fs.gcs.GoogleHadoopFileSystemBase
-
- getServerDefaults() - Method in class com.google.cloud.hadoop.fs.gcs.GoogleHadoopFS
-
- getUri() - Method in class com.google.cloud.hadoop.fs.gcs.GoogleHadoopFileSystemBase
-
Returns a URI of the root of this FileSystem.
- getUri() - Method in class com.google.cloud.hadoop.fs.gcs.GoogleHadoopFS
-
This is overridden to use GoogleHadoopFileSystem's URI, because AbstractFileSystem appends the
default port to the authority.
- getUriDefaultPort() - Method in class com.google.cloud.hadoop.fs.gcs.GoogleHadoopFS
-
- getUsed() - Method in class com.google.cloud.hadoop.fs.gcs.GoogleHadoopFileSystemBase
-
- getWorkingDirectory() - Method in class com.google.cloud.hadoop.fs.gcs.GoogleHadoopFileSystemBase
-
Gets the current working directory.
- getXAttr(Path, String) - Method in class com.google.cloud.hadoop.fs.gcs.GoogleHadoopFileSystemBase
-
Supported starting from Hadoop 2.x
- getXAttrs(Path) - Method in class com.google.cloud.hadoop.fs.gcs.GoogleHadoopFileSystemBase
-
Supported starting from Hadoop 2.x
- getXAttrs(Path, List<String>) - Method in class com.google.cloud.hadoop.fs.gcs.GoogleHadoopFileSystemBase
-
Supported starting from Hadoop 2.x
- GHFS_ID - Static variable in class com.google.cloud.hadoop.fs.gcs.GoogleHadoopFileSystemBase
-
Identifies this version of the GoogleHadoopFileSystemBase library.
- globStatus(Path) - Method in class com.google.cloud.hadoop.fs.gcs.GoogleHadoopFileSystemBase
-
Returns an array of FileStatus objects whose path names match pathPattern.
- globStatus(Path, PathFilter) - Method in class com.google.cloud.hadoop.fs.gcs.GoogleHadoopFileSystemBase
-
Returns an array of FileStatus objects whose path names match pathPattern and is accepted by
the user-supplied path filter.
- GoogleHadoopFileSystem - Class in com.google.cloud.hadoop.fs.gcs
-
GoogleHadoopFileSystem is a version of GoogleHadoopFileSystemBase which is rooted in a single
bucket at initialization time; in this case, Hadoop paths no longer correspond directly to
general GCS paths, and all Hadoop operations going through this FileSystem will never touch any
GCS bucket other than the bucket on which this FileSystem is rooted.
- GoogleHadoopFileSystem() - Constructor for class com.google.cloud.hadoop.fs.gcs.GoogleHadoopFileSystem
-
Constructs an instance of GoogleHadoopFileSystem; the internal
GoogleCloudStorageFileSystem will be set up with config settings when initialize() is called.
- GoogleHadoopFileSystemBase - Class in com.google.cloud.hadoop.fs.gcs
-
This class provides a Hadoop compatible File System on top of Google Cloud Storage (GCS).
- GoogleHadoopFileSystemBase() - Constructor for class com.google.cloud.hadoop.fs.gcs.GoogleHadoopFileSystemBase
-
Constructs an instance of GoogleHadoopFileSystemBase; the internal
GoogleCloudStorageFileSystem
will be set up with config settings when initialize() is called.
- GoogleHadoopFileSystemBase.Counter - Enum in com.google.cloud.hadoop.fs.gcs
-
Defines names of counters we track for each operation.
- GoogleHadoopFileSystemBase.GcsFileChecksumType - Enum in com.google.cloud.hadoop.fs.gcs
-
- GoogleHadoopFileSystemBase.ListStatusFileNotFoundBehavior - Enum in com.google.cloud.hadoop.fs.gcs
-
Behavior of listStatus when a path is not found.
- GoogleHadoopFileSystemBase.OutputStreamType - Enum in com.google.cloud.hadoop.fs.gcs
-
- GoogleHadoopFileSystemBase.ParentTimestampUpdateIncludePredicate - Class in com.google.cloud.hadoop.fs.gcs
-
A predicate that processes individual directory paths and evaluates the conditions set in
fs.gs.parent.timestamp.update.enable, fs.gs.parent.timestamp.update.substrings.include and
fs.gs.parent.timestamp.update.substrings.exclude to determine if a path should be ignored
when running directory timestamp updates.
- GoogleHadoopFileSystemConfiguration - Class in com.google.cloud.hadoop.fs.gcs
-
- GoogleHadoopFileSystemConfiguration() - Constructor for class com.google.cloud.hadoop.fs.gcs.GoogleHadoopFileSystemConfiguration
-
- GoogleHadoopFileSystemConfigurationProperty<T> - Class in com.google.cloud.hadoop.fs.gcs
-
GHFS configuration property
- GoogleHadoopFileSystemConfigurationProperty(String) - Constructor for class com.google.cloud.hadoop.fs.gcs.GoogleHadoopFileSystemConfigurationProperty
-
- GoogleHadoopFileSystemConfigurationProperty(String, T, String...) - Constructor for class com.google.cloud.hadoop.fs.gcs.GoogleHadoopFileSystemConfigurationProperty
-
- GoogleHadoopFS - Class in com.google.cloud.hadoop.fs.gcs
-
GoogleHadoopFS provides a YARN compatible Abstract File System on top of
Google Cloud Storage (GCS).
- GoogleHadoopFS(URI, Configuration) - Constructor for class com.google.cloud.hadoop.fs.gcs.GoogleHadoopFS
-
- GoogleHadoopFS(GoogleHadoopFileSystem, URI, Configuration) - Constructor for class com.google.cloud.hadoop.fs.gcs.GoogleHadoopFS
-
- GoogleHadoopSyncableOutputStream - Class in com.google.cloud.hadoop.fs.gcs
-
GoogleHadoopSyncableOutputStream implements the Syncable
interface by composing objects
created in separate underlying streams for each hsync() call.
- GoogleHadoopSyncableOutputStream(GoogleHadoopFileSystemBase, URI, FileSystem.Statistics, CreateFileOptions) - Constructor for class com.google.cloud.hadoop.fs.gcs.GoogleHadoopSyncableOutputStream
-
Creates a new GoogleHadoopSyncableOutputStream with initial stream initialized and expected to
begin at file-offset 0.