public class GoogleHadoopFileSystemConfiguration extends Object
GoogleHadoopFileSystem
implementations.Modifier and Type | Field and Description |
---|---|
static HadoopConfigurationProperty<Long> |
BLOCK_SIZE
Configuration key for default block size of a file.
|
static List<String> |
CONFIG_KEY_PREFIXES |
static HadoopConfigurationProperty<String> |
DELEGATION_TOKEN_BINDING_CLASS
Configuration key for Delegation Token binding class.
|
static HadoopConfigurationProperty<Boolean> |
GCE_BUCKET_DELETE_ENABLE
If true, recursive delete on a path that refers to a GCS bucket itself ('/' for any
bucket-rooted GoogleHadoopFileSystem) or delete on that path when it's empty will result in
fully deleting the GCS bucket.
|
static HadoopConfigurationProperty<String> |
GCS_APPLICATION_NAME_SUFFIX
Configuration key for adding a suffix to the GHFS application name sent to GCS.
|
static HadoopConfigurationProperty<Class<? extends AuthorizationHandler>> |
GCS_AUTHORIZATION_HANDLER_IMPL
Configuration for authorization handler implementation class.
|
static HadoopConfigurationProperty<Map<String,String>> |
GCS_AUTHORIZATION_HANDLER_PROPERTIES_PREFIX
Configuration prefix for custom authorization handler properties.
|
static HadoopConfigurationProperty<Integer> |
GCS_BATCH_THREADS
Configuration key for a number of threads to execute batch requests.
|
static HadoopConfigurationProperty<GoogleCloudStorageFileSystemOptions.ClientType> |
GCS_CLIENT_TYPE
Configuration key to configure client to use for GCS access.
|
static HadoopConfigurationProperty<AsyncWriteChannelOptions.UploadType> |
GCS_CLIENT_UPLOAD_TYPE
Configuration key to configure the properties to optimize gcs-write.
|
static String |
GCS_CONFIG_PREFIX |
static HadoopConfigurationProperty<Boolean> |
GCS_COOPERATIVE_LOCKING_ENABLE
Configuration key for using cooperative locking to achieve a directory mutation operations
isolation.
|
static HadoopConfigurationProperty<Long> |
GCS_COOPERATIVE_LOCKING_EXPIRATION_TIMEOUT_MS
Configuration key for lock expiration when using cooperative locking.
|
static HadoopConfigurationProperty<Integer> |
GCS_COOPERATIVE_LOCKING_MAX_CONCURRENT_OPERATIONS
Configuration key for maximum allowed concurrent operations when using cooperative locking.
|
static HadoopConfigurationProperty<Boolean> |
GCS_COPY_WITH_REWRITE_ENABLE
Configuration key for enabling the use of Rewrite requests for copy operations.
|
static HadoopConfigurationProperty<Boolean> |
GCS_CREATE_ITEMS_CONFLICT_CHECK_ENABLE
Configuration key for enabling check to ensure that conflicting directories do not exist when
creating files and conflicting files do not exist when creating directories.
|
static HadoopConfigurationProperty<String> |
GCS_ENCRYPTION_ALGORITHM
Configuration key for the CSEK encryption algorithm.
|
static HadoopConfigurationProperty<RedactedString> |
GCS_ENCRYPTION_KEY
Configuration key for the CSEK encryption key.
|
static HadoopConfigurationProperty<RedactedString> |
GCS_ENCRYPTION_KEY_HASH
Configuration key for sha256 hash of the CSEK encryption key.
|
static HadoopConfigurationProperty<GoogleHadoopFileSystemBase.GcsFileChecksumType> |
GCS_FILE_CHECKSUM_TYPE
Configuration key for which type of FileChecksum to return; if a particular file doesn't
support the requested type, then getFileChecksum() will return null for that file.
|
static HadoopConfigurationProperty<GoogleHadoopFileSystemBase.GlobAlgorithm> |
GCS_GLOB_ALGORITHM
Configuration key for customizing glob search algorithm.
|
static HadoopConfigurationProperty<Long> |
GCS_GRPC_CHECK_INTERVAL_TIMEOUT_MS
Configuration key for check interval (in millisecond) for gRPC request timeout to GCS.
|
static HadoopConfigurationProperty<Boolean> |
GCS_GRPC_CHECKSUMS_ENABLE
Configuration key for enabling checksum validation for the gRPC API.
|
static HadoopConfigurationProperty<Boolean> |
GCS_GRPC_DIRECTPATH_ENABLE
Configuration key for enabling use of directpath gRPC API for read/write.
|
static HadoopConfigurationProperty<Boolean> |
GCS_GRPC_ENABLE
Configuration key for enabling use of the gRPC API for read/write.
|
static HadoopConfigurationProperty<Long> |
GCS_GRPC_READ_MESSAGE_TIMEOUT_MS
Configuration key for the message timeout (in millisecond) for gRPC read requests to GCS.
|
static HadoopConfigurationProperty<Long> |
GCS_GRPC_READ_METADATA_TIMEOUT_MS
Configuration key for the connection timeout (in millisecond) for gRPC metadata requests to
GCS.
|
static HadoopConfigurationProperty<Long> |
GCS_GRPC_READ_TIMEOUT_MS
Configuration key for the connection timeout (in millisecond) for gRPC read requests to GCS.
|
static HadoopConfigurationProperty<Boolean> |
GCS_GRPC_READ_ZEROCOPY_ENABLE
Configuration key for enabling the zero-copy deserializer for the gRPC API.
|
static HadoopConfigurationProperty<String> |
GCS_GRPC_SERVER_ADDRESS
Configuration key for the Cloud Storage gRPC server address.
|
static HadoopConfigurationProperty<Boolean> |
GCS_GRPC_TRAFFICDIRECTOR_ENABLE
Configuration key for enabling use of traffic director gRPC API for read/write.
|
static HadoopConfigurationProperty<Long> |
GCS_GRPC_UPLOAD_BUFFERED_REQUESTS
Configuration key for the number of requests to be buffered for uploads to GCS.
|
static HadoopConfigurationProperty<Boolean> |
GCS_GRPC_WRITE_ENABLE
Configuration key to configure client to use for GCS access.
|
static HadoopConfigurationProperty<Long> |
GCS_GRPC_WRITE_MESSAGE_TIMEOUT_MS
Configuration key for the message timeout (in millisecond) for gRPC write requests to GCS.
|
static HadoopConfigurationProperty<Long> |
GCS_GRPC_WRITE_TIMEOUT_MS
Configuration key for the connect timeout (in millisecond) for gRPC write requests to GCS.
|
static HadoopConfigurationProperty<Boolean> |
GCS_HIERARCHICAL_NAMESPACE_ENABLE
Configuration key for enabling hierarchical namespace buckets.
|
static HadoopConfigurationProperty<Integer> |
GCS_HTTP_CONNECT_TIMEOUT
Configuration key for the connect timeout (in millisecond) for HTTP request to GCS.
|
static HadoopConfigurationProperty<Map<String,String>> |
GCS_HTTP_HEADERS
Configuration key for the headers for HTTP request to GCS.
|
static HadoopConfigurationProperty<Integer> |
GCS_HTTP_MAX_RETRY
Configuration key for the max number of retries for failed HTTP request to GCS.
|
static HadoopConfigurationProperty<Integer> |
GCS_HTTP_READ_TIMEOUT
Configuration key for the connect timeout (in millisecond) for HTTP request to GCS.
|
static HadoopConfigurationProperty<GoogleCloudStorageReadOptions.Fadvise> |
GCS_INPUT_STREAM_FADVISE
Tunes reading objects behavior to optimize HTTP GET requests for various use cases.
|
static HadoopConfigurationProperty<Boolean> |
GCS_INPUT_STREAM_FAST_FAIL_ON_NOT_FOUND_ENABLE
If
true , on opening a file we will proactively perform a metadata GET to check
whether the object exists, even though the underlying channel will not open a data stream until
read() is actually called. |
static HadoopConfigurationProperty<Long> |
GCS_INPUT_STREAM_INPLACE_SEEK_LIMIT
If forward seeks are within this many bytes of the current position, seeks are performed by
reading and discarding bytes in-place rather than opening a new underlying stream.
|
static HadoopConfigurationProperty<Integer> |
GCS_INPUT_STREAM_MIN_RANGE_REQUEST_SIZE
Minimum size in bytes of the HTTP Range header set in GCS request when opening new stream to
read an object.
|
static HadoopConfigurationProperty<Boolean> |
GCS_INPUT_STREAM_SUPPORT_GZIP_ENCODING_ENABLE
If true, reading a file with GZIP content encoding (HTTP header "Content-Encoding: gzip") will
result in failure (IOException is thrown).
|
static HadoopConfigurationProperty<Boolean> |
GCS_LAZY_INITIALIZATION_ENABLE
Configuration key for enabling lazy initialization of GCS FS instance.
|
static HadoopConfigurationProperty<String> |
GCS_MARKER_FILE_PATTERN
Configuration key for marker file pattern.
|
static HadoopConfigurationProperty<Long> |
GCS_MAX_LIST_ITEMS_PER_CALL
Configuration key for number of items to return per call to the list* GCS RPCs.
|
static HadoopConfigurationProperty<Long> |
GCS_MAX_REQUESTS_PER_BATCH
Configuration key for a max number of GCS RPCs in batch request.
|
static HadoopConfigurationProperty<Integer> |
GCS_MAX_WAIT_MILLIS_EMPTY_OBJECT_CREATE
Configuration key for modifying the maximum amount of time to wait for empty object creation.
|
static HadoopConfigurationProperty<GoogleCloudStorageOptions.MetricsSink> |
GCS_METRICS_SINK
Configuration key to enable publishing metrics to Google cloud monitoring.
|
static HadoopConfigurationProperty<Boolean> |
GCS_OPERATION_TRACE_LOG_ENABLE
Configuration key to enable operational level traces
|
static HadoopConfigurationProperty<Integer> |
GCS_OUTPUT_STREAM_BUFFER_SIZE
Configuration key for setting write buffer size.
|
static HadoopConfigurationProperty<Boolean> |
GCS_OUTPUT_STREAM_DIRECT_UPLOAD_ENABLE
Configuration key for enabling GCS direct upload.
|
static HadoopConfigurationProperty<Integer> |
GCS_OUTPUT_STREAM_PIPE_BUFFER_SIZE
Configuration key for setting pipe buffer size.
|
static HadoopConfigurationProperty<AsyncWriteChannelOptions.PipeType> |
GCS_OUTPUT_STREAM_PIPE_TYPE
Configuration key for setting pipe type.
|
static HadoopConfigurationProperty<Integer> |
GCS_OUTPUT_STREAM_SYNC_MIN_INTERVAL_MS
Configuration key for the minimal time interval between consecutive sync/hsync/hflush calls.
|
static HadoopConfigurationProperty<GoogleHadoopFileSystemBase.OutputStreamType> |
GCS_OUTPUT_STREAM_TYPE
Configuration key for which type of output stream to use; different options may have different
degrees of support for advanced features like
hsync() and different performance
characteristics. |
static HadoopConfigurationProperty<Integer> |
GCS_OUTPUT_STREAM_UPLOAD_CACHE_SIZE
Configuration for setting GCS upload cache size.
|
static HadoopConfigurationProperty<Integer> |
GCS_OUTPUT_STREAM_UPLOAD_CHUNK_SIZE
Configuration key for setting GCS upload chunk size.
|
static HadoopConfigurationProperty<Integer> |
GCS_PCU_BUFFER_CAPACITY
Configuration key to configure the buffer capacity for UploadType.PARALLEL_COMPOSITE_UPLOAD.
|
static HadoopConfigurationProperty<Integer> |
GCS_PCU_BUFFER_COUNT
Configuration key to configure the Buffers for UploadType.PARALLEL_COMPOSITE_UPLOAD.
|
static HadoopConfigurationProperty<AsyncWriteChannelOptions.PartFileCleanupType> |
GCS_PCU_PART_FILE_CLEANUP_TYPE
Configuration key to clean up strategy of part files created via
UploadType.PARALLEL_COMPOSITE_UPLOAD.
|
static HadoopConfigurationProperty<String> |
GCS_PCU_PART_FILE_NAME_PREFIX
Configuration key to set up the naming strategy of part files created via
UploadType.PARALLEL_COMPOSITE_UPLOAD.
|
static HadoopConfigurationProperty<Boolean> |
GCS_PERFORMANCE_CACHE_ENABLE
Configuration key for using a local item cache to supplement GCS API "getFile" results.
|
static HadoopConfigurationProperty<Long> |
GCS_PERFORMANCE_CACHE_MAX_ENTRY_AGE_MILLIS
Configuration key for maximum number of milliseconds a GoogleCloudStorageItemInfo will remain
"valid" in the performance cache before it's invalidated.
|
static HadoopConfigurationProperty<String> |
GCS_PROJECT_ID
Configuration key for GCS project ID.
|
static HadoopConfigurationProperty<Boolean> |
GCS_REPAIR_IMPLICIT_DIRECTORIES_ENABLE
Configuration key for enabling automatic repair of implicit directories whenever detected
inside delete and rename calls.
|
static HadoopConfigurationProperty<Collection<String>> |
GCS_REQUESTER_PAYS_BUCKETS
Configuration key for GCS Requester Pays Buckets.
|
static HadoopConfigurationProperty<RequesterPaysOptions.RequesterPaysMode> |
GCS_REQUESTER_PAYS_MODE
Configuration key for GCS project ID.
|
static HadoopConfigurationProperty<String> |
GCS_REQUESTER_PAYS_PROJECT_ID
Configuration key for GCS Requester Pays Project ID.
|
static HadoopConfigurationProperty<Long> |
GCS_REWRITE_MAX_BYTES_PER_CALL
Configuration key for specifying max number of bytes rewritten in a single rewrite request when
fs.gs.copy.with.rewrite.enable is set to 'true'.
|
static HadoopConfigurationProperty<String> |
GCS_ROOT_URL
Configuration key for the Cloud Storage API endpoint root URL.
|
static HadoopConfigurationProperty<String> |
GCS_SERVICE_PATH
Configuration key for the Cloud Storage API endpoint service path.
|
static HadoopConfigurationProperty<Boolean> |
GCS_STATUS_PARALLEL_ENABLE
If true, executes GCS requests in
listStatus and getFileStatus methods in
parallel to reduce latency. |
static HadoopConfigurationProperty<Boolean> |
GCS_TRACE_LOG_ENABLE
Configuration key to enable logging of additional trace details.
|
static HadoopConfigurationProperty<Collection<String>> |
GCS_TRACE_LOG_EXCLUDE_PROPERTIES
Configuration key to control the properties to log for a given trace.
|
static HadoopConfigurationProperty<Long> |
GCS_TRACE_LOG_TIME_THRESHOLD_MS
Configuration key to control trace logging of operations which exceeded the provided threshold.
|
static HadoopConfigurationProperty<String> |
GCS_WORKING_DIRECTORY
Configuration key for initial working directory of a GHFS instance.
|
static HadoopConfigurationProperty<Collection<String>> |
GCS_WRITE_TEMPORARY_FILES_PATH
Configuration key to configure the Path where uploads will be parked on disk.
|
static HadoopConfigurationProperty<String> |
PERMISSIONS_TO_REPORT
Key for the permissions that we report a file or directory to have.
|
Constructor and Description |
---|
GoogleHadoopFileSystemConfiguration() |
public static final String GCS_CONFIG_PREFIX
public static final HadoopConfigurationProperty<String> GCS_ROOT_URL
public static final HadoopConfigurationProperty<String> GCS_SERVICE_PATH
public static final HadoopConfigurationProperty<String> PERMISSIONS_TO_REPORT
FsPermission(String)
Default value for the permissions that we report a file or directory to have. Note: We do not really support file/dir permissions but we need to report some permission value when Hadoop calls getFileStatus(). A MapReduce job fails if we report permissions more relaxed than the value below and this is the default File System.
public static final HadoopConfigurationProperty<Long> BLOCK_SIZE
Note that this is the size that is reported to Hadoop FS clients. It does not modify the actual block size of an underlying GCS object, because GCS JSON API does not allow modifying or querying the value. Modifying this value allows one to control how many mappers are used to process a given file.
public static final HadoopConfigurationProperty<Boolean> GCS_HIERARCHICAL_NAMESPACE_ENABLE
If this is enabled, rename folder operation on a Hierarchical namespace enabled bucket will be performed by calling the rename API.
public static final HadoopConfigurationProperty<String> DELEGATION_TOKEN_BINDING_CLASS
public static final HadoopConfigurationProperty<String> GCS_PROJECT_ID
public static final HadoopConfigurationProperty<String> GCS_WORKING_DIRECTORY
public static final HadoopConfigurationProperty<Boolean> GCE_BUCKET_DELETE_ENABLE
public static final HadoopConfigurationProperty<RequesterPaysOptions.RequesterPaysMode> GCS_REQUESTER_PAYS_MODE
public static final HadoopConfigurationProperty<String> GCS_REQUESTER_PAYS_PROJECT_ID
public static final HadoopConfigurationProperty<Collection<String>> GCS_REQUESTER_PAYS_BUCKETS
public static final HadoopConfigurationProperty<GoogleHadoopFileSystemBase.GcsFileChecksumType> GCS_FILE_CHECKSUM_TYPE
public static final HadoopConfigurationProperty<Boolean> GCS_PERFORMANCE_CACHE_ENABLE
public static final HadoopConfigurationProperty<Long> GCS_PERFORMANCE_CACHE_MAX_ENTRY_AGE_MILLIS
public static final HadoopConfigurationProperty<Boolean> GCS_STATUS_PARALLEL_ENABLE
listStatus
and getFileStatus
methods in
parallel to reduce latency.public static final HadoopConfigurationProperty<Boolean> GCS_LAZY_INITIALIZATION_ENABLE
public static final HadoopConfigurationProperty<Boolean> GCS_REPAIR_IMPLICIT_DIRECTORIES_ENABLE
public static final HadoopConfigurationProperty<Boolean> GCS_CREATE_ITEMS_CONFLICT_CHECK_ENABLE
public static final HadoopConfigurationProperty<GoogleHadoopFileSystemBase.GlobAlgorithm> GCS_GLOB_ALGORITHM
public static final HadoopConfigurationProperty<String> GCS_MARKER_FILE_PATTERN
public static final HadoopConfigurationProperty<Long> GCS_MAX_REQUESTS_PER_BATCH
public static final HadoopConfigurationProperty<Integer> GCS_BATCH_THREADS
public static final HadoopConfigurationProperty<Boolean> GCS_COPY_WITH_REWRITE_ENABLE
public static final HadoopConfigurationProperty<Long> GCS_REWRITE_MAX_BYTES_PER_CALL
public static final HadoopConfigurationProperty<Long> GCS_MAX_LIST_ITEMS_PER_CALL
public static final HadoopConfigurationProperty<Integer> GCS_HTTP_MAX_RETRY
Also, note that this number will only control the number of retries in the low level HTTP request implementation.
public static final HadoopConfigurationProperty<Integer> GCS_HTTP_CONNECT_TIMEOUT
public static final HadoopConfigurationProperty<Integer> GCS_HTTP_READ_TIMEOUT
public static final HadoopConfigurationProperty<String> GCS_APPLICATION_NAME_SUFFIX
public static final HadoopConfigurationProperty<Integer> GCS_MAX_WAIT_MILLIS_EMPTY_OBJECT_CREATE
public static final HadoopConfigurationProperty<GoogleHadoopFileSystemBase.OutputStreamType> GCS_OUTPUT_STREAM_TYPE
hsync()
and different performance
characteristics. Options:
BASIC: Stream is closest analogue to direct wrapper around low-level HTTP stream into GCS.
SYNCABLE_COMPOSITE: Stream behaves similarly to BASIC when used with basic create/write/close patterns, but supports hsync() by creating discrete temporary GCS objects which are composed onto the destination object.
FLUSHABLE_COMPOSITE: Stream behaves similarly to SYNCABLE_COMPOSITE, except hflush() is also supported. It will use the same implementation of hsync().
public static final HadoopConfigurationProperty<Integer> GCS_OUTPUT_STREAM_BUFFER_SIZE
public static final HadoopConfigurationProperty<Integer> GCS_OUTPUT_STREAM_PIPE_BUFFER_SIZE
public static final HadoopConfigurationProperty<AsyncWriteChannelOptions.PipeType> GCS_OUTPUT_STREAM_PIPE_TYPE
public static final HadoopConfigurationProperty<Integer> GCS_OUTPUT_STREAM_UPLOAD_CHUNK_SIZE
public static final HadoopConfigurationProperty<Integer> GCS_OUTPUT_STREAM_UPLOAD_CACHE_SIZE
public static final HadoopConfigurationProperty<Boolean> GCS_OUTPUT_STREAM_DIRECT_UPLOAD_ENABLE
public static final HadoopConfigurationProperty<Integer> GCS_OUTPUT_STREAM_SYNC_MIN_INTERVAL_MS
public static final HadoopConfigurationProperty<Boolean> GCS_INPUT_STREAM_FAST_FAIL_ON_NOT_FOUND_ENABLE
true
, on opening a file we will proactively perform a metadata GET
to check
whether the object exists, even though the underlying channel will not open a data stream until
read()
is actually called. This is necessary to technically match the expected behavior
of Hadoop filesystems, but incurs an extra latency overhead on open()
. If the calling
code can handle late failures on not-found errors, or has independently already ensured that a
file exists before calling open()
, then you can set this to false
for more
efficient reads.
Note, this is known to not work with YARN CommonNodeLabelsManager
and potentially
other Hadoop components. That's why it's not recommended to set this property to false
cluster-wide, instead set it for a specific job/application that is compatible with it.
public static final HadoopConfigurationProperty<Boolean> GCS_INPUT_STREAM_SUPPORT_GZIP_ENCODING_ENABLE
public static final HadoopConfigurationProperty<Long> GCS_INPUT_STREAM_INPLACE_SEEK_LIMIT
public static final HadoopConfigurationProperty<GoogleCloudStorageReadOptions.Fadvise> GCS_INPUT_STREAM_FADVISE
public static final HadoopConfigurationProperty<Integer> GCS_INPUT_STREAM_MIN_RANGE_REQUEST_SIZE
public static final HadoopConfigurationProperty<Boolean> GCS_GRPC_ENABLE
public static final HadoopConfigurationProperty<Boolean> GCS_GRPC_CHECKSUMS_ENABLE
public static final HadoopConfigurationProperty<String> GCS_GRPC_SERVER_ADDRESS
public static final HadoopConfigurationProperty<Long> GCS_GRPC_CHECK_INTERVAL_TIMEOUT_MS
public static final HadoopConfigurationProperty<Long> GCS_GRPC_READ_TIMEOUT_MS
public static final HadoopConfigurationProperty<Long> GCS_GRPC_READ_MESSAGE_TIMEOUT_MS
public static final HadoopConfigurationProperty<Long> GCS_GRPC_READ_METADATA_TIMEOUT_MS
public static final HadoopConfigurationProperty<Boolean> GCS_GRPC_READ_ZEROCOPY_ENABLE
public static final HadoopConfigurationProperty<Long> GCS_GRPC_UPLOAD_BUFFERED_REQUESTS
public static final HadoopConfigurationProperty<Long> GCS_GRPC_WRITE_TIMEOUT_MS
public static final HadoopConfigurationProperty<Long> GCS_GRPC_WRITE_MESSAGE_TIMEOUT_MS
public static final HadoopConfigurationProperty<Boolean> GCS_GRPC_DIRECTPATH_ENABLE
public static final HadoopConfigurationProperty<Boolean> GCS_GRPC_TRAFFICDIRECTOR_ENABLE
public static final HadoopConfigurationProperty<Boolean> GCS_COOPERATIVE_LOCKING_ENABLE
public static final HadoopConfigurationProperty<Long> GCS_COOPERATIVE_LOCKING_EXPIRATION_TIMEOUT_MS
public static final HadoopConfigurationProperty<Integer> GCS_COOPERATIVE_LOCKING_MAX_CONCURRENT_OPERATIONS
public static final HadoopConfigurationProperty<Map<String,String>> GCS_HTTP_HEADERS
public static final HadoopConfigurationProperty<String> GCS_ENCRYPTION_ALGORITHM
public static final HadoopConfigurationProperty<RedactedString> GCS_ENCRYPTION_KEY
public static final HadoopConfigurationProperty<RedactedString> GCS_ENCRYPTION_KEY_HASH
public static final HadoopConfigurationProperty<Class<? extends AuthorizationHandler>> GCS_AUTHORIZATION_HANDLER_IMPL
public static final HadoopConfigurationProperty<Map<String,String>> GCS_AUTHORIZATION_HANDLER_PROPERTIES_PREFIX
public static final HadoopConfigurationProperty<GoogleCloudStorageOptions.MetricsSink> GCS_METRICS_SINK
public static final HadoopConfigurationProperty<Boolean> GCS_OPERATION_TRACE_LOG_ENABLE
public static final HadoopConfigurationProperty<Boolean> GCS_TRACE_LOG_ENABLE
public static final HadoopConfigurationProperty<Long> GCS_TRACE_LOG_TIME_THRESHOLD_MS
public static final HadoopConfigurationProperty<Collection<String>> GCS_TRACE_LOG_EXCLUDE_PROPERTIES
public static final HadoopConfigurationProperty<GoogleCloudStorageFileSystemOptions.ClientType> GCS_CLIENT_TYPE
public static final HadoopConfigurationProperty<Boolean> GCS_GRPC_WRITE_ENABLE
public static final HadoopConfigurationProperty<AsyncWriteChannelOptions.UploadType> GCS_CLIENT_UPLOAD_TYPE
public static final HadoopConfigurationProperty<Collection<String>> GCS_WRITE_TEMPORARY_FILES_PATH
public static final HadoopConfigurationProperty<Integer> GCS_PCU_BUFFER_COUNT
public static final HadoopConfigurationProperty<Integer> GCS_PCU_BUFFER_CAPACITY
public static final HadoopConfigurationProperty<AsyncWriteChannelOptions.PartFileCleanupType> GCS_PCU_PART_FILE_CLEANUP_TYPE
public static final HadoopConfigurationProperty<String> GCS_PCU_PART_FILE_NAME_PREFIX
Copyright © 2024. All rights reserved.