GoogleHadoopFileSystemConfiguration (gcs-connector-hadoop2 hadoop2-2.2.6 API)

java.lang.Object
- com.google.cloud.hadoop.fs.gcs.GoogleHadoopFileSystemConfiguration

```
public class GoogleHadoopFileSystemConfiguration
extends Object
```
This class provides a configuration for the GoogleHadoopFileSystem implementations.

Field Summary

Fields
Modifier and Type	Field and Description
`static HadoopConfigurationProperty<Long>`	`BLOCK_SIZE` Configuration key for default block size of a file.
`static List<String>`	`CONFIG_KEY_PREFIXES`
`static HadoopConfigurationProperty<String>`	`DELEGATION_TOKEN_BINDING_CLASS` Configuration key for Delegation Token binding class.
`static HadoopConfigurationProperty<Boolean>`	`GCE_BUCKET_DELETE_ENABLE` If true, recursive delete on a path that refers to a GCS bucket itself ('/' for any bucket-rooted GoogleHadoopFileSystem) or delete on that path when it's empty will result in fully deleting the GCS bucket.
`static HadoopConfigurationProperty<String>`	`GCS_APPLICATION_NAME_SUFFIX` Configuration key for adding a suffix to the GHFS application name sent to GCS.
`static HadoopConfigurationProperty<Class<? extends AuthorizationHandler>>`	`GCS_AUTHORIZATION_HANDLER_IMPL` Configuration for authorization handler implementation class.
`static HadoopConfigurationProperty<Map<String,String>>`	`GCS_AUTHORIZATION_HANDLER_PROPERTIES_PREFIX` Configuration prefix for custom authorization handler properties.
`static HadoopConfigurationProperty<Integer>`	`GCS_BATCH_THREADS` Configuration key for a number of threads to execute batch requests.
`static String`	`GCS_CONFIG_PREFIX`
`static HadoopConfigurationProperty<Boolean>`	`GCS_COOPERATIVE_LOCKING_ENABLE` Configuration key for using cooperative locking to achieve a directory mutation operations isolation.
`static HadoopConfigurationProperty<Long>`	`GCS_COOPERATIVE_LOCKING_EXPIRATION_TIMEOUT_MS` Configuration key for lock expiration when using cooperative locking.
`static HadoopConfigurationProperty<Integer>`	`GCS_COOPERATIVE_LOCKING_MAX_CONCURRENT_OPERATIONS` Configuration key for maximum allowed concurrent operations when using cooperative locking.
`static HadoopConfigurationProperty<Boolean>`	`GCS_COPY_WITH_REWRITE_ENABLE` Configuration key for enabling the use of Rewrite requests for copy operations.
`static HadoopConfigurationProperty<Boolean>`	`GCS_CREATE_ITEMS_CONFLICT_CHECK_ENABLE` Configuration key for enabling check to ensure that conflicting directories do not exist when creating files and conflicting files do not exist when creating directories.
`static HadoopConfigurationProperty<String>`	`GCS_ENCRYPTION_ALGORITHM` Configuration key for the CSEK encryption algorithm.
`static HadoopConfigurationProperty<RedactedString>`	`GCS_ENCRYPTION_KEY` Configuration key for the CSEK encryption key.
`static HadoopConfigurationProperty<RedactedString>`	`GCS_ENCRYPTION_KEY_HASH` Configuration key for sha256 hash of the CSEK encryption key.
`static HadoopConfigurationProperty<GoogleHadoopFileSystemBase.GcsFileChecksumType>`	`GCS_FILE_CHECKSUM_TYPE` Configuration key for which type of FileChecksum to return; if a particular file doesn't support the requested type, then getFileChecksum() will return null for that file.
`static HadoopConfigurationProperty<GoogleHadoopFileSystemBase.GlobAlgorithm>`	`GCS_GLOB_ALGORITHM` Configuration key for customizing glob search algorithm.
`static HadoopConfigurationProperty<Long>`	`GCS_GRPC_CHECK_INTERVAL_TIMEOUT_MS` Configuration key for check interval (in millisecond) for gRPC request timeout to GCS.
`static HadoopConfigurationProperty<Boolean>`	`GCS_GRPC_CHECKSUMS_ENABLE` Configuration key for enabling checksum validation for the gRPC API.
`static HadoopConfigurationProperty<Boolean>`	`GCS_GRPC_DIRECTPATH_ENABLE` Configuration key for enabling use of directpath gRPC API for read/write.
`static HadoopConfigurationProperty<Boolean>`	`GCS_GRPC_ENABLE` Configuration key for enabling use of the gRPC API for read/write.
`static HadoopConfigurationProperty<Long>`	`GCS_GRPC_READ_MESSAGE_TIMEOUT_MS` Configuration key for the message timeout (in millisecond) for gRPC read requests to GCS.
`static HadoopConfigurationProperty<Long>`	`GCS_GRPC_READ_METADATA_TIMEOUT_MS` Configuration key for the connection timeout (in millisecond) for gRPC metadata requests to GCS.
`static HadoopConfigurationProperty<Long>`	`GCS_GRPC_READ_TIMEOUT_MS` Configuration key for the connection timeout (in millisecond) for gRPC read requests to GCS.
`static HadoopConfigurationProperty<Boolean>`	`GCS_GRPC_READ_ZEROCOPY_ENABLE` Configuration key for enabling the zero-copy deserializer for the gRPC API.
`static HadoopConfigurationProperty<String>`	`GCS_GRPC_SERVER_ADDRESS` Configuration key for the Cloud Storage gRPC server address.
`static HadoopConfigurationProperty<Boolean>`	`GCS_GRPC_TRAFFICDIRECTOR_ENABLE` Configuration key for enabling use of traffic director gRPC API for read/write.
`static HadoopConfigurationProperty<Long>`	`GCS_GRPC_UPLOAD_BUFFERED_REQUESTS` Configuration key for the number of requests to be buffered for uploads to GCS.
`static HadoopConfigurationProperty<Long>`	`GCS_GRPC_WRITE_MESSAGE_TIMEOUT_MS` Configuration key for the message timeout (in millisecond) for gRPC write requests to GCS.
`static HadoopConfigurationProperty<Long>`	`GCS_GRPC_WRITE_TIMEOUT_MS` Configuration key for the connect timeout (in millisecond) for gRPC write requests to GCS.
`static HadoopConfigurationProperty<Integer>`	`GCS_HTTP_CONNECT_TIMEOUT` Configuration key for the connect timeout (in millisecond) for HTTP request to GCS.
`static HadoopConfigurationProperty<Map<String,String>>`	`GCS_HTTP_HEADERS` Configuration key for the headers for HTTP request to GCS.
`static HadoopConfigurationProperty<Integer>`	`GCS_HTTP_MAX_RETRY` Configuration key for the max number of retries for failed HTTP request to GCS.
`static HadoopConfigurationProperty<Integer>`	`GCS_HTTP_READ_TIMEOUT` Configuration key for the connect timeout (in millisecond) for HTTP request to GCS.
`static HadoopConfigurationProperty<GoogleCloudStorageReadOptions.Fadvise>`	`GCS_INPUT_STREAM_FADVISE` Tunes reading objects behavior to optimize HTTP GET requests for various use cases.
`static HadoopConfigurationProperty<Boolean>`	`GCS_INPUT_STREAM_FAST_FAIL_ON_NOT_FOUND_ENABLE` If `true`, on opening a file we will proactively perform a metadata `GET` to check whether the object exists, even though the underlying channel will not open a data stream until `read()` is actually called.
`static HadoopConfigurationProperty<Long>`	`GCS_INPUT_STREAM_INPLACE_SEEK_LIMIT` If forward seeks are within this many bytes of the current position, seeks are performed by reading and discarding bytes in-place rather than opening a new underlying stream.
`static HadoopConfigurationProperty<Integer>`	`GCS_INPUT_STREAM_MIN_RANGE_REQUEST_SIZE` Minimum size in bytes of the HTTP Range header set in GCS request when opening new stream to read an object.
`static HadoopConfigurationProperty<Boolean>`	`GCS_INPUT_STREAM_SUPPORT_GZIP_ENCODING_ENABLE` If true, reading a file with GZIP content encoding (HTTP header "Content-Encoding: gzip") will result in failure (IOException is thrown).
`static HadoopConfigurationProperty<Boolean>`	`GCS_LAZY_INITIALIZATION_ENABLE` Configuration key for enabling lazy initialization of GCS FS instance.
`static HadoopConfigurationProperty<String>`	`GCS_MARKER_FILE_PATTERN` Configuration key for marker file pattern.
`static HadoopConfigurationProperty<Long>`	`GCS_MAX_LIST_ITEMS_PER_CALL` Configuration key for number of items to return per call to the list* GCS RPCs.
`static HadoopConfigurationProperty<Long>`	`GCS_MAX_REQUESTS_PER_BATCH` Configuration key for a max number of GCS RPCs in batch request.
`static HadoopConfigurationProperty<Integer>`	`GCS_MAX_WAIT_MILLIS_EMPTY_OBJECT_CREATE` Configuration key for modifying the maximum amount of time to wait for empty object creation.
`static HadoopConfigurationProperty<GoogleCloudStorageOptions.MetricsSink>`	`GCS_METRICS_SINK` Configuration key to enable publishing metrics to Google cloud monitoring.
`static HadoopConfigurationProperty<Integer>`	`GCS_OUTPUT_STREAM_BUFFER_SIZE` Configuration key for setting write buffer size.
`static HadoopConfigurationProperty<Boolean>`	`GCS_OUTPUT_STREAM_DIRECT_UPLOAD_ENABLE` Configuration key for enabling GCS direct upload.
`static HadoopConfigurationProperty<Integer>`	`GCS_OUTPUT_STREAM_PIPE_BUFFER_SIZE` Configuration key for setting pipe buffer size.
`static HadoopConfigurationProperty<AsyncWriteChannelOptions.PipeType>`	`GCS_OUTPUT_STREAM_PIPE_TYPE` Configuration key for setting pipe type.
`static HadoopConfigurationProperty<Integer>`	`GCS_OUTPUT_STREAM_SYNC_MIN_INTERVAL_MS` Configuration key for the minimal time interval between consecutive sync/hsync/hflush calls.
`static HadoopConfigurationProperty<GoogleHadoopFileSystemBase.OutputStreamType>`	`GCS_OUTPUT_STREAM_TYPE` Configuration key for which type of output stream to use; different options may have different degrees of support for advanced features like `hsync()` and different performance characteristics.
`static HadoopConfigurationProperty<Integer>`	`GCS_OUTPUT_STREAM_UPLOAD_CACHE_SIZE` Configuration for setting GCS upload cache size.
`static HadoopConfigurationProperty<Integer>`	`GCS_OUTPUT_STREAM_UPLOAD_CHUNK_SIZE` Configuration key for setting GCS upload chunk size.
`static HadoopConfigurationProperty<Boolean>`	`GCS_PERFORMANCE_CACHE_ENABLE` Configuration key for using a local item cache to supplement GCS API "getFile" results.
`static HadoopConfigurationProperty<Long>`	`GCS_PERFORMANCE_CACHE_MAX_ENTRY_AGE_MILLIS` Configuration key for maximum number of milliseconds a GoogleCloudStorageItemInfo will remain "valid" in the performance cache before it's invalidated.
`static HadoopConfigurationProperty<String>`	`GCS_PROJECT_ID` Configuration key for GCS project ID.
`static HadoopConfigurationProperty<Boolean>`	`GCS_REPAIR_IMPLICIT_DIRECTORIES_ENABLE` Configuration key for enabling automatic repair of implicit directories whenever detected inside delete and rename calls.
`static HadoopConfigurationProperty<Collection<String>>`	`GCS_REQUESTER_PAYS_BUCKETS` Configuration key for GCS Requester Pays Buckets.
`static HadoopConfigurationProperty<RequesterPaysOptions.RequesterPaysMode>`	`GCS_REQUESTER_PAYS_MODE` Configuration key for GCS project ID.
`static HadoopConfigurationProperty<String>`	`GCS_REQUESTER_PAYS_PROJECT_ID` Configuration key for GCS Requester Pays Project ID.
`static HadoopConfigurationProperty<Long>`	`GCS_REWRITE_MAX_BYTES_PER_CALL` Configuration key for specifying max number of bytes rewritten in a single rewrite request when fs.gs.copy.with.rewrite.enable is set to 'true'.
`static HadoopConfigurationProperty<String>`	`GCS_ROOT_URL` Configuration key for the Cloud Storage API endpoint root URL.
`static HadoopConfigurationProperty<String>`	`GCS_SERVICE_PATH` Configuration key for the Cloud Storage API endpoint service path.
`static HadoopConfigurationProperty<Boolean>`	`GCS_STATUS_PARALLEL_ENABLE` If true, executes GCS requests in `listStatus` and `getFileStatus` methods in parallel to reduce latency.
`static HadoopConfigurationProperty<String>`	`GCS_WORKING_DIRECTORY` Configuration key for initial working directory of a GHFS instance.
`static HadoopConfigurationProperty<String>`	`PERMISSIONS_TO_REPORT` Key for the permissions that we report a file or directory to have.

Constructor Summary

Constructors
Constructor and Description

GoogleHadoopFileSystemConfiguration()

Constructors
Constructor and Description
`GoogleHadoopFileSystemConfiguration()`

Method Summary
- Methods inherited from class java.lang.Object
  clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

- Field Detail
  - GCS_CONFIG_PREFIX
```
public static final String GCS_CONFIG_PREFIX
```
    See Also:
    
    Constant Field Values
  - CONFIG_KEY_PREFIXES
```
public static final List<String> CONFIG_KEY_PREFIXES
```
  - GCS_ROOT_URL
```
public static final HadoopConfigurationProperty<String> GCS_ROOT_URL
```
    Configuration key for the Cloud Storage API endpoint root URL.
  - GCS_SERVICE_PATH
```
public static final HadoopConfigurationProperty<String> GCS_SERVICE_PATH
```
    Configuration key for the Cloud Storage API endpoint service path.
  - PERMISSIONS_TO_REPORT
```
public static final HadoopConfigurationProperty<String> PERMISSIONS_TO_REPORT
```
    Key for the permissions that we report a file or directory to have. Can either be octal or symbolic mode accepted by FsPermission.FsPermission(String)
    Default value for the permissions that we report a file or directory to have. Note: We do not really support file/dir permissions but we need to report some permission value when Hadoop calls getFileStatus(). A MapReduce job fails if we report permissions more relaxed than the value below and this is the default File System.
  - BLOCK_SIZE
```
public static final HadoopConfigurationProperty<Long> BLOCK_SIZE
```
    Configuration key for default block size of a file.
    Note that this is the size that is reported to Hadoop FS clients. It does not modify the actual block size of an underlying GCS object, because GCS JSON API does not allow modifying or querying the value. Modifying this value allows one to control how many mappers are used to process a given file.
  - DELEGATION_TOKEN_BINDING_CLASS
```
public static final HadoopConfigurationProperty<String> DELEGATION_TOKEN_BINDING_CLASS
```
    Configuration key for Delegation Token binding class. Default value: none
  - GCS_PROJECT_ID
```
public static final HadoopConfigurationProperty<String> GCS_PROJECT_ID
```
    Configuration key for GCS project ID. Default value: none
  - GCS_WORKING_DIRECTORY
```
public static final HadoopConfigurationProperty<String> GCS_WORKING_DIRECTORY
```
    Configuration key for initial working directory of a GHFS instance. Default value: '/'
  - GCE_BUCKET_DELETE_ENABLE
```
public static final HadoopConfigurationProperty<Boolean> GCE_BUCKET_DELETE_ENABLE
```
    If true, recursive delete on a path that refers to a GCS bucket itself ('/' for any bucket-rooted GoogleHadoopFileSystem) or delete on that path when it's empty will result in fully deleting the GCS bucket. If false, any operation that normally would have deleted the bucket will be ignored instead. Setting to 'false' preserves the typical behavior of "rm -rf /" which translates to deleting everything inside of root, but without clobbering the filesystem authority corresponding to that root path in the process.
  - GCS_REQUESTER_PAYS_MODE
```
public static final HadoopConfigurationProperty<RequesterPaysOptions.RequesterPaysMode> GCS_REQUESTER_PAYS_MODE
```
    Configuration key for GCS project ID. Default value: "DISABLED"
  - GCS_REQUESTER_PAYS_PROJECT_ID
```
public static final HadoopConfigurationProperty<String> GCS_REQUESTER_PAYS_PROJECT_ID
```
    Configuration key for GCS Requester Pays Project ID. Default value: none
  - GCS_REQUESTER_PAYS_BUCKETS
```
public static final HadoopConfigurationProperty<Collection<String>> GCS_REQUESTER_PAYS_BUCKETS
```
    Configuration key for GCS Requester Pays Buckets. Default value: none
  - GCS_FILE_CHECKSUM_TYPE
```
public static final HadoopConfigurationProperty<GoogleHadoopFileSystemBase.GcsFileChecksumType> GCS_FILE_CHECKSUM_TYPE
```
    Configuration key for which type of FileChecksum to return; if a particular file doesn't support the requested type, then getFileChecksum() will return null for that file.
  - GCS_PERFORMANCE_CACHE_ENABLE
```
public static final HadoopConfigurationProperty<Boolean> GCS_PERFORMANCE_CACHE_ENABLE
```
    Configuration key for using a local item cache to supplement GCS API "getFile" results. This provides faster access to recently queried data. Because the data is cached, modifications made outside of this instance may not be immediately reflected. The performance cache can be used in conjunction with other caching options.
  - GCS_PERFORMANCE_CACHE_MAX_ENTRY_AGE_MILLIS
```
public static final HadoopConfigurationProperty<Long> GCS_PERFORMANCE_CACHE_MAX_ENTRY_AGE_MILLIS
```
    Configuration key for maximum number of milliseconds a GoogleCloudStorageItemInfo will remain "valid" in the performance cache before it's invalidated.
  - GCS_STATUS_PARALLEL_ENABLE
```
public static final HadoopConfigurationProperty<Boolean> GCS_STATUS_PARALLEL_ENABLE
```
    If true, executes GCS requests in listStatus and getFileStatus methods in parallel to reduce latency.
  - GCS_LAZY_INITIALIZATION_ENABLE
```
public static final HadoopConfigurationProperty<Boolean> GCS_LAZY_INITIALIZATION_ENABLE
```
    Configuration key for enabling lazy initialization of GCS FS instance.
  - GCS_REPAIR_IMPLICIT_DIRECTORIES_ENABLE
```
public static final HadoopConfigurationProperty<Boolean> GCS_REPAIR_IMPLICIT_DIRECTORIES_ENABLE
```
    Configuration key for enabling automatic repair of implicit directories whenever detected inside delete and rename calls.
  - GCS_CREATE_ITEMS_CONFLICT_CHECK_ENABLE
```
public static final HadoopConfigurationProperty<Boolean> GCS_CREATE_ITEMS_CONFLICT_CHECK_ENABLE
```
    Configuration key for enabling check to ensure that conflicting directories do not exist when creating files and conflicting files do not exist when creating directories.
  - GCS_GLOB_ALGORITHM
```
public static final HadoopConfigurationProperty<GoogleHadoopFileSystemBase.GlobAlgorithm> GCS_GLOB_ALGORITHM
```
    Configuration key for customizing glob search algorithm.
  - GCS_MARKER_FILE_PATTERN
```
public static final HadoopConfigurationProperty<String> GCS_MARKER_FILE_PATTERN
```
    Configuration key for marker file pattern. Default value: none
  - GCS_MAX_REQUESTS_PER_BATCH
```
public static final HadoopConfigurationProperty<Long> GCS_MAX_REQUESTS_PER_BATCH
```
    Configuration key for a max number of GCS RPCs in batch request.
  - GCS_BATCH_THREADS
```
public static final HadoopConfigurationProperty<Integer> GCS_BATCH_THREADS
```
    Configuration key for a number of threads to execute batch requests.
  - GCS_COPY_WITH_REWRITE_ENABLE
```
public static final HadoopConfigurationProperty<Boolean> GCS_COPY_WITH_REWRITE_ENABLE
```
    Configuration key for enabling the use of Rewrite requests for copy operations. Rewrite request has the same effect as Copy request, but it can handle moving large objects that may potentially timeout a Copy request.
  - GCS_REWRITE_MAX_BYTES_PER_CALL
```
public static final HadoopConfigurationProperty<Long> GCS_REWRITE_MAX_BYTES_PER_CALL
```
    Configuration key for specifying max number of bytes rewritten in a single rewrite request when fs.gs.copy.with.rewrite.enable is set to 'true'.
  - GCS_MAX_LIST_ITEMS_PER_CALL
```
public static final HadoopConfigurationProperty<Long> GCS_MAX_LIST_ITEMS_PER_CALL
```
    Configuration key for number of items to return per call to the list* GCS RPCs.
  - GCS_HTTP_MAX_RETRY
```
public static final HadoopConfigurationProperty<Integer> GCS_HTTP_MAX_RETRY
```
    Configuration key for the max number of retries for failed HTTP request to GCS. Note that the connector will retry *up to* the number of times as specified, using a default ExponentialBackOff strategy.
    Also, note that this number will only control the number of retries in the low level HTTP request implementation.
  - GCS_HTTP_CONNECT_TIMEOUT
```
public static final HadoopConfigurationProperty<Integer> GCS_HTTP_CONNECT_TIMEOUT
```
    Configuration key for the connect timeout (in millisecond) for HTTP request to GCS.
  - GCS_HTTP_READ_TIMEOUT
```
public static final HadoopConfigurationProperty<Integer> GCS_HTTP_READ_TIMEOUT
```
    Configuration key for the connect timeout (in millisecond) for HTTP request to GCS.
  - GCS_APPLICATION_NAME_SUFFIX
```
public static final HadoopConfigurationProperty<String> GCS_APPLICATION_NAME_SUFFIX
```
    Configuration key for adding a suffix to the GHFS application name sent to GCS.
  - GCS_MAX_WAIT_MILLIS_EMPTY_OBJECT_CREATE
```
public static final HadoopConfigurationProperty<Integer> GCS_MAX_WAIT_MILLIS_EMPTY_OBJECT_CREATE
```
    Configuration key for modifying the maximum amount of time to wait for empty object creation.
  - GCS_OUTPUT_STREAM_TYPE
```
public static final HadoopConfigurationProperty<GoogleHadoopFileSystemBase.OutputStreamType> GCS_OUTPUT_STREAM_TYPE
```
    Configuration key for which type of output stream to use; different options may have different degrees of support for advanced features like hsync() and different performance characteristics. Options:
    BASIC: Stream is closest analogue to direct wrapper around low-level HTTP stream into GCS.
    SYNCABLE_COMPOSITE: Stream behaves similarly to BASIC when used with basic create/write/close patterns, but supports hsync() by creating discrete temporary GCS objects which are composed onto the destination object.
    FLUSHABLE_COMPOSITE: Stream behaves similarly to SYNCABLE_COMPOSITE, except hflush() is also supported. It will use the same implementation of hsync().
  - GCS_OUTPUT_STREAM_BUFFER_SIZE
```
public static final HadoopConfigurationProperty<Integer> GCS_OUTPUT_STREAM_BUFFER_SIZE
```
    Configuration key for setting write buffer size.
  - GCS_OUTPUT_STREAM_PIPE_BUFFER_SIZE
```
public static final HadoopConfigurationProperty<Integer> GCS_OUTPUT_STREAM_PIPE_BUFFER_SIZE
```
    Configuration key for setting pipe buffer size.
  - GCS_OUTPUT_STREAM_PIPE_TYPE
```
public static final HadoopConfigurationProperty<AsyncWriteChannelOptions.PipeType> GCS_OUTPUT_STREAM_PIPE_TYPE
```
    Configuration key for setting pipe type.
  - GCS_OUTPUT_STREAM_UPLOAD_CHUNK_SIZE
```
public static final HadoopConfigurationProperty<Integer> GCS_OUTPUT_STREAM_UPLOAD_CHUNK_SIZE
```
    Configuration key for setting GCS upload chunk size.
  - GCS_OUTPUT_STREAM_UPLOAD_CACHE_SIZE
```
public static final HadoopConfigurationProperty<Integer> GCS_OUTPUT_STREAM_UPLOAD_CACHE_SIZE
```
    Configuration for setting GCS upload cache size.
  - GCS_OUTPUT_STREAM_DIRECT_UPLOAD_ENABLE
```
public static final HadoopConfigurationProperty<Boolean> GCS_OUTPUT_STREAM_DIRECT_UPLOAD_ENABLE
```
    Configuration key for enabling GCS direct upload.
  - GCS_OUTPUT_STREAM_SYNC_MIN_INTERVAL_MS
```
public static final HadoopConfigurationProperty<Integer> GCS_OUTPUT_STREAM_SYNC_MIN_INTERVAL_MS
```
    Configuration key for the minimal time interval between consecutive sync/hsync/hflush calls.
  - GCS_INPUT_STREAM_FAST_FAIL_ON_NOT_FOUND_ENABLE
```
public static final HadoopConfigurationProperty<Boolean> GCS_INPUT_STREAM_FAST_FAIL_ON_NOT_FOUND_ENABLE
```
    If true, on opening a file we will proactively perform a metadata GET to check whether the object exists, even though the underlying channel will not open a data stream until read() is actually called. This is necessary to technically match the expected behavior of Hadoop filesystems, but incurs an extra latency overhead on open(). If the calling code can handle late failures on not-found errors, or has independently already ensured that a file exists before calling open(), then you can set this to false for more efficient reads.
    Note, this is known to not work with YARN CommonNodeLabelsManager and potentially other Hadoop components. That's why it's not recommended to set this property to false cluster-wide, instead set it for a specific job/application that is compatible with it.
  - GCS_INPUT_STREAM_SUPPORT_GZIP_ENCODING_ENABLE
```
public static final HadoopConfigurationProperty<Boolean> GCS_INPUT_STREAM_SUPPORT_GZIP_ENCODING_ENABLE
```
    If true, reading a file with GZIP content encoding (HTTP header "Content-Encoding: gzip") will result in failure (IOException is thrown).
  - GCS_INPUT_STREAM_INPLACE_SEEK_LIMIT
```
public static final HadoopConfigurationProperty<Long> GCS_INPUT_STREAM_INPLACE_SEEK_LIMIT
```
    If forward seeks are within this many bytes of the current position, seeks are performed by reading and discarding bytes in-place rather than opening a new underlying stream.
  - GCS_INPUT_STREAM_FADVISE
```
public static final HadoopConfigurationProperty<GoogleCloudStorageReadOptions.Fadvise> GCS_INPUT_STREAM_FADVISE
```
    Tunes reading objects behavior to optimize HTTP GET requests for various use cases.
  - GCS_INPUT_STREAM_MIN_RANGE_REQUEST_SIZE
```
public static final HadoopConfigurationProperty<Integer> GCS_INPUT_STREAM_MIN_RANGE_REQUEST_SIZE
```
    Minimum size in bytes of the HTTP Range header set in GCS request when opening new stream to read an object.
  - GCS_GRPC_ENABLE
```
public static final HadoopConfigurationProperty<Boolean> GCS_GRPC_ENABLE
```
    Configuration key for enabling use of the gRPC API for read/write.
  - GCS_GRPC_CHECKSUMS_ENABLE
```
public static final HadoopConfigurationProperty<Boolean> GCS_GRPC_CHECKSUMS_ENABLE
```
    Configuration key for enabling checksum validation for the gRPC API.
  - GCS_GRPC_SERVER_ADDRESS
```
public static final HadoopConfigurationProperty<String> GCS_GRPC_SERVER_ADDRESS
```
    Configuration key for the Cloud Storage gRPC server address.
  - GCS_GRPC_CHECK_INTERVAL_TIMEOUT_MS
```
public static final HadoopConfigurationProperty<Long> GCS_GRPC_CHECK_INTERVAL_TIMEOUT_MS
```
    Configuration key for check interval (in millisecond) for gRPC request timeout to GCS.
  - GCS_GRPC_READ_TIMEOUT_MS
```
public static final HadoopConfigurationProperty<Long> GCS_GRPC_READ_TIMEOUT_MS
```
    Configuration key for the connection timeout (in millisecond) for gRPC read requests to GCS.
  - GCS_GRPC_READ_MESSAGE_TIMEOUT_MS
```
public static final HadoopConfigurationProperty<Long> GCS_GRPC_READ_MESSAGE_TIMEOUT_MS
```
    Configuration key for the message timeout (in millisecond) for gRPC read requests to GCS.
  - GCS_GRPC_READ_METADATA_TIMEOUT_MS
```
public static final HadoopConfigurationProperty<Long> GCS_GRPC_READ_METADATA_TIMEOUT_MS
```
    Configuration key for the connection timeout (in millisecond) for gRPC metadata requests to GCS.
  - GCS_GRPC_READ_ZEROCOPY_ENABLE
```
public static final HadoopConfigurationProperty<Boolean> GCS_GRPC_READ_ZEROCOPY_ENABLE
```
    Configuration key for enabling the zero-copy deserializer for the gRPC API.
  - GCS_GRPC_UPLOAD_BUFFERED_REQUESTS
```
public static final HadoopConfigurationProperty<Long> GCS_GRPC_UPLOAD_BUFFERED_REQUESTS
```
    Configuration key for the number of requests to be buffered for uploads to GCS.
  - GCS_GRPC_WRITE_TIMEOUT_MS
```
public static final HadoopConfigurationProperty<Long> GCS_GRPC_WRITE_TIMEOUT_MS
```
    Configuration key for the connect timeout (in millisecond) for gRPC write requests to GCS.
  - GCS_GRPC_WRITE_MESSAGE_TIMEOUT_MS
```
public static final HadoopConfigurationProperty<Long> GCS_GRPC_WRITE_MESSAGE_TIMEOUT_MS
```
    Configuration key for the message timeout (in millisecond) for gRPC write requests to GCS.
  - GCS_GRPC_DIRECTPATH_ENABLE
```
public static final HadoopConfigurationProperty<Boolean> GCS_GRPC_DIRECTPATH_ENABLE
```
    Configuration key for enabling use of directpath gRPC API for read/write.
  - GCS_GRPC_TRAFFICDIRECTOR_ENABLE
```
public static final HadoopConfigurationProperty<Boolean> GCS_GRPC_TRAFFICDIRECTOR_ENABLE
```
    Configuration key for enabling use of traffic director gRPC API for read/write.
  - GCS_COOPERATIVE_LOCKING_ENABLE
```
public static final HadoopConfigurationProperty<Boolean> GCS_COOPERATIVE_LOCKING_ENABLE
```
    Configuration key for using cooperative locking to achieve a directory mutation operations isolation.
  - GCS_COOPERATIVE_LOCKING_EXPIRATION_TIMEOUT_MS
```
public static final HadoopConfigurationProperty<Long> GCS_COOPERATIVE_LOCKING_EXPIRATION_TIMEOUT_MS
```
    Configuration key for lock expiration when using cooperative locking.
  - GCS_COOPERATIVE_LOCKING_MAX_CONCURRENT_OPERATIONS
```
public static final HadoopConfigurationProperty<Integer> GCS_COOPERATIVE_LOCKING_MAX_CONCURRENT_OPERATIONS
```
    Configuration key for maximum allowed concurrent operations when using cooperative locking.
  - GCS_HTTP_HEADERS
```
public static final HadoopConfigurationProperty<Map<String,String>> GCS_HTTP_HEADERS
```
    Configuration key for the headers for HTTP request to GCS.
  - GCS_ENCRYPTION_ALGORITHM
```
public static final HadoopConfigurationProperty<String> GCS_ENCRYPTION_ALGORITHM
```
    Configuration key for the CSEK encryption algorithm.
  - GCS_ENCRYPTION_KEY
```
public static final HadoopConfigurationProperty<RedactedString> GCS_ENCRYPTION_KEY
```
    Configuration key for the CSEK encryption key.
  - GCS_ENCRYPTION_KEY_HASH
```
public static final HadoopConfigurationProperty<RedactedString> GCS_ENCRYPTION_KEY_HASH
```
    Configuration key for sha256 hash of the CSEK encryption key.
  - GCS_AUTHORIZATION_HANDLER_IMPL
```
public static final HadoopConfigurationProperty<Class<? extends AuthorizationHandler>> GCS_AUTHORIZATION_HANDLER_IMPL
```
    Configuration for authorization handler implementation class.
  - GCS_AUTHORIZATION_HANDLER_PROPERTIES_PREFIX
```
public static final HadoopConfigurationProperty<Map<String,String>> GCS_AUTHORIZATION_HANDLER_PROPERTIES_PREFIX
```
    Configuration prefix for custom authorization handler properties.
  - GCS_METRICS_SINK
```
public static final HadoopConfigurationProperty<GoogleCloudStorageOptions.MetricsSink> GCS_METRICS_SINK
```
    Configuration key to enable publishing metrics to Google cloud monitoring.
- Constructor Detail
  - GoogleHadoopFileSystemConfiguration
```
public GoogleHadoopFileSystemConfiguration()
```

Class GoogleHadoopFileSystemConfiguration

Field Summary

Constructor Summary

Method Summary

Methods inherited from class java.lang.Object

Field Detail

GCS_CONFIG_PREFIX

CONFIG_KEY_PREFIXES

GCS_ROOT_URL

GCS_SERVICE_PATH

PERMISSIONS_TO_REPORT

BLOCK_SIZE

DELEGATION_TOKEN_BINDING_CLASS

GCS_PROJECT_ID

GCS_WORKING_DIRECTORY

GCE_BUCKET_DELETE_ENABLE

GCS_REQUESTER_PAYS_MODE

GCS_REQUESTER_PAYS_PROJECT_ID

GCS_REQUESTER_PAYS_BUCKETS

GCS_FILE_CHECKSUM_TYPE

GCS_PERFORMANCE_CACHE_ENABLE

GCS_PERFORMANCE_CACHE_MAX_ENTRY_AGE_MILLIS

GCS_STATUS_PARALLEL_ENABLE

GCS_LAZY_INITIALIZATION_ENABLE

GCS_REPAIR_IMPLICIT_DIRECTORIES_ENABLE

GCS_CREATE_ITEMS_CONFLICT_CHECK_ENABLE

GCS_GLOB_ALGORITHM

GCS_MARKER_FILE_PATTERN

GCS_MAX_REQUESTS_PER_BATCH

GCS_BATCH_THREADS

GCS_COPY_WITH_REWRITE_ENABLE

GCS_REWRITE_MAX_BYTES_PER_CALL

GCS_MAX_LIST_ITEMS_PER_CALL

GCS_HTTP_MAX_RETRY

GCS_HTTP_CONNECT_TIMEOUT

GCS_HTTP_READ_TIMEOUT

GCS_APPLICATION_NAME_SUFFIX

GCS_MAX_WAIT_MILLIS_EMPTY_OBJECT_CREATE

GCS_OUTPUT_STREAM_TYPE

GCS_OUTPUT_STREAM_BUFFER_SIZE

GCS_OUTPUT_STREAM_PIPE_BUFFER_SIZE

GCS_OUTPUT_STREAM_PIPE_TYPE

GCS_OUTPUT_STREAM_UPLOAD_CHUNK_SIZE

GCS_OUTPUT_STREAM_UPLOAD_CACHE_SIZE

GCS_OUTPUT_STREAM_DIRECT_UPLOAD_ENABLE

GCS_OUTPUT_STREAM_SYNC_MIN_INTERVAL_MS

GCS_INPUT_STREAM_FAST_FAIL_ON_NOT_FOUND_ENABLE

GCS_INPUT_STREAM_SUPPORT_GZIP_ENCODING_ENABLE

GCS_INPUT_STREAM_INPLACE_SEEK_LIMIT

GCS_INPUT_STREAM_FADVISE

GCS_INPUT_STREAM_MIN_RANGE_REQUEST_SIZE

GCS_GRPC_ENABLE

GCS_GRPC_CHECKSUMS_ENABLE

GCS_GRPC_SERVER_ADDRESS

GCS_GRPC_CHECK_INTERVAL_TIMEOUT_MS

GCS_GRPC_READ_TIMEOUT_MS

GCS_GRPC_READ_MESSAGE_TIMEOUT_MS

GCS_GRPC_READ_METADATA_TIMEOUT_MS

GCS_GRPC_READ_ZEROCOPY_ENABLE

GCS_GRPC_UPLOAD_BUFFERED_REQUESTS

GCS_GRPC_WRITE_TIMEOUT_MS

GCS_GRPC_WRITE_MESSAGE_TIMEOUT_MS

GCS_GRPC_DIRECTPATH_ENABLE

GCS_GRPC_TRAFFICDIRECTOR_ENABLE

GCS_COOPERATIVE_LOCKING_ENABLE

GCS_COOPERATIVE_LOCKING_EXPIRATION_TIMEOUT_MS

GCS_COOPERATIVE_LOCKING_MAX_CONCURRENT_OPERATIONS

GCS_HTTP_HEADERS

GCS_ENCRYPTION_ALGORITHM

GCS_ENCRYPTION_KEY

GCS_ENCRYPTION_KEY_HASH

GCS_AUTHORIZATION_HANDLER_IMPL

GCS_AUTHORIZATION_HANDLER_PROPERTIES_PREFIX

GCS_METRICS_SINK

Constructor Detail

GoogleHadoopFileSystemConfiguration