Interface | Description |
---|---|
FileSystemDescriptor |
FileSystemDescriptor defines the interface containing all the methods which are necessary to
differentiate the behavior of different Hadoop FileSystem implementations, including the URI
scheme with which an implementation is identified.
|
Class | Description |
---|---|
GoogleHadoopFileSystem |
GoogleHadoopFileSystem is a version of GoogleHadoopFileSystemBase which is rooted in a single
bucket at initialization time; in this case, Hadoop paths no longer correspond directly to
general GCS paths, and all Hadoop operations going through this FileSystem will never touch
any GCS bucket other than the bucket on which this FileSystem is rooted.
|
GoogleHadoopFileSystemBase |
This class provides a Hadoop compatible File System on top of Google Cloud Storage (GCS).
|
GoogleHadoopFileSystemBase.ParentTimestampUpdateIncludePredicate |
A predicate that processes individual directory paths and evaluates the conditions set in
fs.gs.parent.timestamp.update.enable, fs.gs.parent.timestamp.update.substrings.include and
fs.gs.parent.timestamp.update.substrings.exclude to determine if a path should be ignored
when running directory timestamp updates.
|
GoogleHadoopFS |
GoogleHadoopFS provides a YARN compatible Abstract File System on top of
Google Cloud Storage (GCS).
|
GoogleHadoopSyncableOutputStream |
GoogleHadoopSyncableOutputStream implements the
Syncable interface by composing
objects created in separate underlying streams for each hsync() call. |
Enum | Description |
---|---|
GoogleHadoopFileSystemBase.Counter |
Defines names of counters we track for each operation.
|
GoogleHadoopFileSystemBase.ListStatusFileNotFoundBehavior |
Behavior of listStatus when a path is not found.
|
GoogleHadoopFileSystemBase.OutputStreamType |
Available types for use with
GoogleHadoopFileSystemBase.GCS_OUTPUTSTREAM_TYPE_KEY . |
Exception | Description |
---|---|
CompositeLimitExceededException |
Throw when an attempted operation is prohibited because it would require exceeding the GCS
component limit.
|
Copyright © 2018. All rights reserved.