Package | Description |
---|---|
org.apache.hadoop.conf |
Configuration of system parameters.
|
org.apache.hadoop.fs |
An abstract file system API.
|
org.apache.hadoop.fs.ftp | |
org.apache.hadoop.fs.kfs |
A client for the Kosmos filesystem (KFS)
|
org.apache.hadoop.fs.s3 |
A distributed, block-based implementation of
FileSystem that uses Amazon S3
as a backing store. |
org.apache.hadoop.fs.s3native |
A distributed implementation of
FileSystem for reading and writing files on
Amazon S3. |
org.apache.hadoop.fs.shell | |
org.apache.hadoop.fs.viewfs | |
org.apache.hadoop.io |
Generic i/o code for use when reading and writing data to the network,
to databases, and to files.
|
org.apache.hadoop.io.compress | |
org.apache.hadoop.util |
Common utilities.
|
Modifier and Type | Method and Description |
---|---|
Path |
Configuration.getLocalPath(String dirsProp,
String path)
Get a local file under a directory named by dirsProp with
the given path.
|
Modifier and Type | Method and Description |
---|---|
void |
Configuration.addResource(Path file)
Add a configuration resource.
|
Modifier and Type | Field and Description |
---|---|
protected Path |
TrashPolicy.trash |
Modifier and Type | Method and Description |
---|---|
Path |
ChecksumFileSystem.getChecksumFile(Path file)
Return the name of the checksum file associated with a file.
|
abstract Path |
TrashPolicy.getCurrentTrashDir()
Get the current working directory of the Trash Policy
|
Path |
RawLocalFileSystem.getHomeDirectory() |
Path |
AbstractFileSystem.getHomeDirectory()
Return the current user's home directory in this file system.
|
Path |
FileContext.getHomeDirectory()
Return the current user's home directory in this file system.
|
Path |
HarFileSystem.getHomeDirectory()
return the top level archive path.
|
Path |
FileSystem.getHomeDirectory()
Return the current user's home directory in this filesystem.
|
Path |
FilterFileSystem.getHomeDirectory() |
protected Path |
RawLocalFileSystem.getInitialWorkingDirectory() |
Path |
AbstractFileSystem.getInitialWorkingDirectory()
Some file systems like LocalFileSystem have an initial workingDir
that is used as the starting workingDir.
|
protected Path |
FileSystem.getInitialWorkingDirectory()
Note: with the new FilesContext class, getWorkingDirectory()
will be removed.
|
protected Path |
FilterFileSystem.getInitialWorkingDirectory() |
Path |
AbstractFileSystem.getLinkTarget(Path f)
The specification of this method matches that of
FileContext.getLinkTarget(Path) ; |
Path |
FileContext.getLinkTarget(Path f)
Returns the target of the given symbolic link as it was specified
when the link was created.
|
Path |
Path.getParent()
Returns the parent of a path or null if at root.
|
Path |
FileStatus.getPath() |
Path |
FileStatus.getSymlink() |
Path |
RawLocalFileSystem.getWorkingDirectory() |
Path |
FileContext.getWorkingDirectory()
Gets the working directory for wd-relative names (such a "foo/bar").
|
Path |
HarFileSystem.getWorkingDirectory()
return the top level archive.
|
abstract Path |
FileSystem.getWorkingDirectory()
Get the current working directory for the given file system
|
Path |
FilterFileSystem.getWorkingDirectory()
Get the current working directory for the given file system
|
Path |
Path.makeQualified(FileSystem fs)
Deprecated.
|
Path |
AbstractFileSystem.makeQualified(Path path)
Make the path fully qualified to this file system
|
Path |
FileContext.makeQualified(Path path)
Make the path fully qualified if it is isn't.
|
Path |
HarFileSystem.makeQualified(Path path) |
Path |
FileSystem.makeQualified(Path path)
Make sure that a path specifies a FileSystem.
|
Path |
FilterFileSystem.makeQualified(Path path)
Make sure that a path specifies a FileSystem.
|
Path |
Path.makeQualified(URI defaultUri,
Path workingDir)
Returns a qualified path object.
|
protected Path |
FileContext.resolve(Path f)
Resolves all symbolic links in the specified path.
|
protected Path |
FileContext.resolveIntermediate(Path f)
Resolves all symbolic links in the specified path leading up
to, but not including the final path component.
|
Path |
AbstractFileSystem.resolvePath(Path p)
Return the fully-qualified path of path f resolving the path
through any internal symlinks or mount point
|
Path |
FileContext.resolvePath(Path f)
Resolve the path following any symlinks or mount points
|
Path |
FileSystem.resolvePath(Path p)
Return the fully-qualified path of path f resolving the path
through any symlinks or mount point
|
Path |
FilterFileSystem.resolvePath(Path p) |
Path |
RawLocalFileSystem.startLocalOutput(Path fsOutputFile,
Path tmpLocalFile) |
Path |
HarFileSystem.startLocalOutput(Path fsOutputFile,
Path tmpLocalFile)
not implemented.
|
Path |
FileSystem.startLocalOutput(Path fsOutputFile,
Path tmpLocalFile)
Returns a local File that the user can write output to.
|
Path |
FilterFileSystem.startLocalOutput(Path fsOutputFile,
Path tmpLocalFile)
Returns a local File that the user can write output to.
|
Path |
ChecksumFileSystem.startLocalOutput(Path fsOutputFile,
Path tmpLocalFile) |
static Path[] |
FileUtil.stat2Paths(FileStatus[] stats)
convert an array of FileStatus to an array of Path
|
static Path[] |
FileUtil.stat2Paths(FileStatus[] stats,
Path path)
convert an array of FileStatus to an array of Path.
|
Path |
Path.suffix(String suffix)
Adds a suffix to the final name in the path.
|
Modifier and Type | Method and Description |
---|---|
RemoteIterator<Path> |
AbstractFileSystem.listCorruptFileBlocks(Path path) |
RemoteIterator<Path> |
FileContext.listCorruptFileBlocks(Path path) |
RemoteIterator<Path> |
FileSystem.listCorruptFileBlocks(Path path) |
RemoteIterator<Path> |
FilterFileSystem.listCorruptFileBlocks(Path path) |
Modifier and Type | Method and Description |
---|---|
boolean |
PathFilter.accept(Path path)
Tests whether or not the specified abstract pathname should be
included in a pathname list.
|
boolean |
GlobFilter.accept(Path path) |
FSDataOutputStream |
FileSystem.append(Path f)
Append to an existing file (optional operation).
|
FSDataOutputStream |
FileSystem.append(Path f,
int bufferSize)
Append to an existing file (optional operation).
|
FSDataOutputStream |
RawLocalFileSystem.append(Path f,
int bufferSize,
Progressable progress)
Append to an existing file (optional operation).
|
abstract FSDataOutputStream |
FileSystem.append(Path f,
int bufferSize,
Progressable progress)
Append to an existing file (optional operation).
|
FSDataOutputStream |
FilterFileSystem.append(Path f,
int bufferSize,
Progressable progress)
Append to an existing file (optional operation).
|
FSDataOutputStream |
ChecksumFileSystem.append(Path f,
int bufferSize,
Progressable progress)
Append to an existing file (optional operation).
|
boolean |
FileSystem.cancelDeleteOnExit(Path f)
Cancel the deletion of the path when the FileSystem is closed
|
void |
AbstractFileSystem.checkPath(Path path)
Check that a Path belongs to this FileSystem.
|
protected void |
FileSystem.checkPath(Path path)
Check that a Path belongs to this FileSystem.
|
protected void |
FilterFileSystem.checkPath(Path path)
Check that a Path belongs to this FileSystem.
|
void |
RawLocalFileSystem.completeLocalOutput(Path fsWorkingFile,
Path tmpLocalFile) |
void |
HarFileSystem.completeLocalOutput(Path fsOutputFile,
Path tmpLocalFile)
not implemented.
|
void |
FileSystem.completeLocalOutput(Path fsOutputFile,
Path tmpLocalFile)
Called when we're all done writing to the target.
|
void |
FilterFileSystem.completeLocalOutput(Path fsOutputFile,
Path tmpLocalFile)
Called when we're all done writing to the target.
|
void |
ChecksumFileSystem.completeLocalOutput(Path fsOutputFile,
Path tmpLocalFile) |
static boolean |
FileUtil.copy(File src,
FileSystem dstFS,
Path dst,
boolean deleteSource,
Configuration conf)
Copy local files to a FileSystem.
|
static boolean |
FileUtil.copy(FileSystem srcFS,
Path[] srcs,
FileSystem dstFS,
Path dst,
boolean deleteSource,
boolean overwrite,
Configuration conf) |
static boolean |
FileUtil.copy(FileSystem srcFS,
Path[] srcs,
FileSystem dstFS,
Path dst,
boolean deleteSource,
boolean overwrite,
Configuration conf) |
static boolean |
FileUtil.copy(FileSystem srcFS,
Path src,
File dst,
boolean deleteSource,
Configuration conf)
Copy FileSystem files to local files.
|
static boolean |
FileUtil.copy(FileSystem srcFS,
Path src,
FileSystem dstFS,
Path dst,
boolean deleteSource,
boolean overwrite,
Configuration conf)
Copy files between FileSystems.
|
static boolean |
FileUtil.copy(FileSystem srcFS,
Path src,
FileSystem dstFS,
Path dst,
boolean deleteSource,
Configuration conf)
Copy files between FileSystems.
|
boolean |
FileContext.Util.copy(Path src,
Path dst)
Copy file from src to dest.
|
boolean |
FileContext.Util.copy(Path src,
Path dst,
boolean deleteSource,
boolean overwrite)
Copy from src to dst, optionally deleting src and overwriting dst.
|
void |
FileSystem.copyFromLocalFile(boolean delSrc,
boolean overwrite,
Path[] srcs,
Path dst)
The src files are on the local disk.
|
void |
FileSystem.copyFromLocalFile(boolean delSrc,
boolean overwrite,
Path[] srcs,
Path dst)
The src files are on the local disk.
|
void |
FilterFileSystem.copyFromLocalFile(boolean delSrc,
boolean overwrite,
Path[] srcs,
Path dst)
The src files are on the local disk.
|
void |
FilterFileSystem.copyFromLocalFile(boolean delSrc,
boolean overwrite,
Path[] srcs,
Path dst)
The src files are on the local disk.
|
void |
FileSystem.copyFromLocalFile(boolean delSrc,
boolean overwrite,
Path src,
Path dst)
The src file is on the local disk.
|
void |
FilterFileSystem.copyFromLocalFile(boolean delSrc,
boolean overwrite,
Path src,
Path dst)
The src file is on the local disk.
|
void |
HarFileSystem.copyFromLocalFile(boolean delSrc,
Path src,
Path dst)
not implemented.
|
void |
FileSystem.copyFromLocalFile(boolean delSrc,
Path src,
Path dst)
The src file is on the local disk.
|
void |
LocalFileSystem.copyFromLocalFile(boolean delSrc,
Path src,
Path dst) |
void |
FilterFileSystem.copyFromLocalFile(boolean delSrc,
Path src,
Path dst)
The src file is on the local disk.
|
void |
ChecksumFileSystem.copyFromLocalFile(boolean delSrc,
Path src,
Path dst) |
void |
FileSystem.copyFromLocalFile(Path src,
Path dst)
The src file is on the local disk.
|
static boolean |
FileUtil.copyMerge(FileSystem srcFS,
Path srcDir,
FileSystem dstFS,
Path dstFile,
boolean deleteSource,
Configuration conf,
String addString)
Copy all files in a directory to one output file (merge).
|
void |
HarFileSystem.copyToLocalFile(boolean delSrc,
Path src,
Path dst)
copies the file in the har filesystem to a local file.
|
void |
FileSystem.copyToLocalFile(boolean delSrc,
Path src,
Path dst)
The src file is under FS, and the dst is on the local disk.
|
void |
LocalFileSystem.copyToLocalFile(boolean delSrc,
Path src,
Path dst) |
void |
FilterFileSystem.copyToLocalFile(boolean delSrc,
Path src,
Path dst)
The src file is under FS, and the dst is on the local disk.
|
void |
ChecksumFileSystem.copyToLocalFile(boolean delSrc,
Path src,
Path dst)
The src file is under FS, and the dst is on the local disk.
|
void |
FileSystem.copyToLocalFile(boolean delSrc,
Path src,
Path dst,
boolean useRawLocalFileSystem)
The src file is under FS, and the dst is on the local disk.
|
void |
FileSystem.copyToLocalFile(Path src,
Path dst)
The src file is under FS, and the dst is on the local disk.
|
void |
ChecksumFileSystem.copyToLocalFile(Path src,
Path dst,
boolean copyCrc)
The src file is under FS, and the dst is on the local disk.
|
static FSDataOutputStream |
FileSystem.create(FileSystem fs,
Path file,
FsPermission permission)
create a file with the provided permission
The permission of the file is set to be the provided permission as in
setPermission, not permission&~umask
It is implemented using two RPCs.
|
FSDataOutputStream |
FileSystem.create(Path f)
Create an FSDataOutputStream at the indicated Path.
|
FSDataOutputStream |
FileSystem.create(Path f,
boolean overwrite)
Create an FSDataOutputStream at the indicated Path.
|
FSDataOutputStream |
FileSystem.create(Path f,
boolean overwrite,
int bufferSize)
Create an FSDataOutputStream at the indicated Path.
|
FSDataOutputStream |
FileSystem.create(Path f,
boolean overwrite,
int bufferSize,
Progressable progress)
Create an FSDataOutputStream at the indicated Path with write-progress
reporting.
|
FSDataOutputStream |
FileSystem.create(Path f,
boolean overwrite,
int bufferSize,
short replication,
long blockSize)
Create an FSDataOutputStream at the indicated Path.
|
FSDataOutputStream |
RawLocalFileSystem.create(Path f,
boolean overwrite,
int bufferSize,
short replication,
long blockSize,
Progressable progress)
Create an FSDataOutputStream at the indicated Path with write-progress
reporting.
|
FSDataOutputStream |
FileSystem.create(Path f,
boolean overwrite,
int bufferSize,
short replication,
long blockSize,
Progressable progress)
Create an FSDataOutputStream at the indicated Path with write-progress
reporting.
|
FSDataOutputStream |
AbstractFileSystem.create(Path f,
EnumSet<CreateFlag> createFlag,
Options.CreateOpts... opts)
The specification of this method matches that of
FileContext.create(Path, EnumSet, Options.CreateOpts...) except
that the Path f must be fully qualified and the permission is absolute
(i.e. |
FSDataOutputStream |
FileContext.create(Path f,
EnumSet<CreateFlag> createFlag,
Options.CreateOpts... opts)
Create or overwrite file on indicated path and returns an output stream for
writing into the file.
|
FSDataOutputStream |
RawLocalFileSystem.create(Path f,
FsPermission permission,
boolean overwrite,
int bufferSize,
short replication,
long blockSize,
Progressable progress)
Create an FSDataOutputStream at the indicated Path with write-progress
reporting.
|
FSDataOutputStream |
HarFileSystem.create(Path f,
FsPermission permission,
boolean overwrite,
int bufferSize,
short replication,
long blockSize,
Progressable progress) |
abstract FSDataOutputStream |
FileSystem.create(Path f,
FsPermission permission,
boolean overwrite,
int bufferSize,
short replication,
long blockSize,
Progressable progress)
Create an FSDataOutputStream at the indicated Path with write-progress
reporting.
|
FSDataOutputStream |
FilterFileSystem.create(Path f,
FsPermission permission,
boolean overwrite,
int bufferSize,
short replication,
long blockSize,
Progressable progress)
Create an FSDataOutputStream at the indicated Path with write-progress
reporting.
|
FSDataOutputStream |
ChecksumFileSystem.create(Path f,
FsPermission permission,
boolean overwrite,
int bufferSize,
short replication,
long blockSize,
Progressable progress)
Create an FSDataOutputStream at the indicated Path with write-progress
reporting.
|
FSDataOutputStream |
FileSystem.create(Path f,
FsPermission permission,
EnumSet<CreateFlag> flags,
int bufferSize,
short replication,
long blockSize,
Progressable progress,
Options.ChecksumOpt checksumOpt)
Create an FSDataOutputStream at the indicated Path with a custom
checksum option.
|
FSDataOutputStream |
FileSystem.create(Path f,
Progressable progress)
Create an FSDataOutputStream at the indicated Path with write-progress
reporting.
|
FSDataOutputStream |
FileSystem.create(Path f,
short replication)
Create an FSDataOutputStream at the indicated Path.
|
FSDataOutputStream |
FileSystem.create(Path f,
short replication,
Progressable progress)
Create an FSDataOutputStream at the indicated Path with write-progress
reporting.
|
abstract FSDataOutputStream |
AbstractFileSystem.createInternal(Path f,
EnumSet<CreateFlag> flag,
FsPermission absolutePermission,
int bufferSize,
short replication,
long blockSize,
Progressable progress,
Options.ChecksumOpt checksumOpt,
boolean createParent)
The specification of this method matches that of
AbstractFileSystem.create(Path, EnumSet, Options.CreateOpts...) except that the opts
have been declared explicitly. |
boolean |
FileSystem.createNewFile(Path f)
Creates the given Path as a brand-new zero-length file.
|
FSDataOutputStream |
FileSystem.createNonRecursive(Path f,
boolean overwrite,
int bufferSize,
short replication,
long blockSize,
Progressable progress)
Deprecated.
API only for 0.20-append
|
FSDataOutputStream |
RawLocalFileSystem.createNonRecursive(Path f,
FsPermission permission,
boolean overwrite,
int bufferSize,
short replication,
long blockSize,
Progressable progress)
Opens an FSDataOutputStream at the indicated Path with write-progress
reporting.
|
FSDataOutputStream |
FileSystem.createNonRecursive(Path f,
FsPermission permission,
boolean overwrite,
int bufferSize,
short replication,
long blockSize,
Progressable progress)
Deprecated.
API only for 0.20-append
|
FSDataOutputStream |
ChecksumFileSystem.createNonRecursive(Path f,
FsPermission permission,
boolean overwrite,
int bufferSize,
short replication,
long blockSize,
Progressable progress)
Opens an FSDataOutputStream at the indicated Path with write-progress
reporting.
|
void |
AbstractFileSystem.createSymlink(Path target,
Path link,
boolean createParent)
The specification of this method matches that of
FileContext.createSymlink(Path, Path, boolean) ; |
void |
FileContext.createSymlink(Path target,
Path link,
boolean createParent)
Creates a symbolic link to an existing file.
|
boolean |
FileSystem.delete(Path f)
Deprecated.
Use
FileSystem.delete(Path, boolean) instead. |
boolean |
RawLocalFileSystem.delete(Path p,
boolean recursive)
Delete the given path to a file or directory.
|
abstract boolean |
AbstractFileSystem.delete(Path f,
boolean recursive)
The specification of this method matches that of
FileContext.delete(Path, boolean) except that Path f must be for
this file system. |
boolean |
FileContext.delete(Path f,
boolean recursive)
Delete a file.
|
boolean |
HarFileSystem.delete(Path f,
boolean recursive)
Not implemented.
|
abstract boolean |
FileSystem.delete(Path f,
boolean recursive)
Delete a file.
|
boolean |
FilterFileSystem.delete(Path f,
boolean recursive)
Delete a file
|
boolean |
ChecksumFileSystem.delete(Path f,
boolean recursive)
Implement the delete(Path, boolean) in checksum
file system.
|
boolean |
FileContext.deleteOnExit(Path f)
Mark a path to be deleted on JVM shutdown.
|
boolean |
FileSystem.deleteOnExit(Path f)
Mark a path to be deleted when FileSystem is closed.
|
boolean |
FileContext.Util.exists(Path f)
Does the file exist?
Note: Avoid using this method if you already have FileStatus in hand.
|
boolean |
FileSystem.exists(Path f)
Check if exists.
|
static void |
FileUtil.fullyDelete(FileSystem fs,
Path dir)
Deprecated.
|
long |
FileSystem.getBlockSize(Path f)
Deprecated.
Use getFileStatus() instead
|
Path |
ChecksumFileSystem.getChecksumFile(Path file)
Return the name of the checksum file associated with a file.
|
long |
ChecksumFileSystem.getChecksumFileLength(Path file,
long fileSize)
Return the length of the checksum file given the size of the
actual file.
|
ContentSummary |
FileContext.Util.getContentSummary(Path f)
Return the
ContentSummary of path f. |
ContentSummary |
FileSystem.getContentSummary(Path f)
Return the
ContentSummary of a given Path . |
ContentSummary |
FilterFileSystem.getContentSummary(Path f) |
long |
FileSystem.getDefaultBlockSize(Path f)
Return the number of bytes that large input files should be optimally
be split into to minimize i/o time.
|
long |
FilterFileSystem.getDefaultBlockSize(Path f) |
short |
FileSystem.getDefaultReplication(Path path)
Get the default replication for a path.
|
short |
FilterFileSystem.getDefaultReplication(Path f) |
List<org.apache.hadoop.security.token.Token<?>> |
FileContext.getDelegationTokens(Path p,
String renewer)
Get delegation tokens for the file systems accessed for a given
path.
|
abstract BlockLocation[] |
AbstractFileSystem.getFileBlockLocations(Path f,
long start,
long len)
The specification of this method matches that of
FileContext.getFileBlockLocations(Path, long, long) except that
Path f must be for this file system. |
BlockLocation[] |
FileContext.getFileBlockLocations(Path f,
long start,
long len)
Return blockLocation of the given file for the given offset and len.
|
BlockLocation[] |
FileSystem.getFileBlockLocations(Path p,
long start,
long len)
Return an array containing hostnames, offset and size of
portions of the given file.
|
abstract FileChecksum |
AbstractFileSystem.getFileChecksum(Path f)
The specification of this method matches that of
FileContext.getFileChecksum(Path) except that Path f must be for
this file system. |
FileChecksum |
FileContext.getFileChecksum(Path f)
Get the checksum of a file.
|
FileChecksum |
HarFileSystem.getFileChecksum(Path f) |
FileChecksum |
FileSystem.getFileChecksum(Path f)
Get the checksum of a file.
|
FileChecksum |
FilterFileSystem.getFileChecksum(Path f)
Get the checksum of a file.
|
FileStatus |
AbstractFileSystem.getFileLinkStatus(Path f)
The specification of this method matches that of
FileContext.getFileLinkStatus(Path)
except that an UnresolvedLinkException may be thrown if a symlink is
encountered in the path leading up to the final path component. |
FileStatus |
FileContext.getFileLinkStatus(Path f)
Return a file status object that represents the path.
|
FileStatus |
RawLocalFileSystem.getFileStatus(Path f) |
abstract FileStatus |
AbstractFileSystem.getFileStatus(Path f)
The specification of this method matches that of
FileContext.getFileStatus(Path)
except that an UnresolvedLinkException may be thrown if a symlink is
encountered in the path. |
FileStatus |
FileContext.getFileStatus(Path f)
Return a file status object that represents the path.
|
FileStatus |
HarFileSystem.getFileStatus(Path f)
return the filestatus of files in har archive.
|
abstract FileStatus |
FileSystem.getFileStatus(Path f)
Return a file status object that represents the path.
|
FileStatus |
FilterFileSystem.getFileStatus(Path f)
Get file status.
|
FsStatus |
AbstractFileSystem.getFsStatus(Path f)
The specification of this method matches that of
FileContext.getFsStatus(Path) except that Path f must be for this
file system. |
FsStatus |
FileContext.getFsStatus(Path f)
Returns a status object describing the use and capacity of the
file system denoted by the Parh argument p.
|
static int |
HarFileSystem.getHarHash(Path p)
the hash of the path p inside iniside
the filesystem
|
static TrashPolicy |
TrashPolicy.getInstance(Configuration conf,
FileSystem fs,
Path home)
Get an instance of the configured TrashPolicy based on the value
of the configuration paramater fs.trash.classname.
|
long |
FileSystem.getLength(Path f)
Deprecated.
Use getFileStatus() instead
|
Path |
AbstractFileSystem.getLinkTarget(Path f)
The specification of this method matches that of
FileContext.getLinkTarget(Path) ; |
Path |
FileContext.getLinkTarget(Path f)
Returns the target of the given symbolic link as it was specified
when the link was created.
|
short |
FileSystem.getReplication(Path src)
Deprecated.
Use getFileStatus() instead
|
FsServerDefaults |
FileSystem.getServerDefaults(Path p)
Return a set of server default configuration values
|
FsServerDefaults |
FilterFileSystem.getServerDefaults(Path f) |
FsStatus |
RawLocalFileSystem.getStatus(Path p)
Returns a status object describing the use and capacity of the
file system.
|
FsStatus |
FileSystem.getStatus(Path p)
Returns a status object describing the use and capacity of the
file system.
|
FsStatus |
FilterFileSystem.getStatus(Path p)
Returns a status object describing the use and capacity of the
file system.
|
String |
AbstractFileSystem.getUriPath(Path p)
Get the path-part of a pathname.
|
FileStatus[] |
FileContext.Util.globStatus(Path pathPattern)
Return all the files that match filePattern and are not checksum
files.
|
FileStatus[] |
FileSystem.globStatus(Path pathPattern)
Return all the files that match filePattern and are not checksum
files.
|
FileStatus[] |
FileContext.Util.globStatus(Path pathPattern,
PathFilter filter)
Return an array of FileStatus objects whose path names match pathPattern
and is accepted by the user-supplied path filter.
|
FileStatus[] |
FileSystem.globStatus(Path pathPattern,
PathFilter filter)
Return an array of FileStatus objects whose path names match pathPattern
and is accepted by the user-supplied path filter.
|
abstract void |
TrashPolicy.initialize(Configuration conf,
FileSystem fs,
Path home)
Used to setup the trash policy.
|
static boolean |
ChecksumFileSystem.isChecksumFile(Path file)
Return true iff file is a checksum file name.
|
boolean |
FileSystem.isDirectory(Path f)
True iff the named path is a directory.
|
boolean |
FileSystem.isFile(Path f)
True iff the named path is a regular file.
|
RemoteIterator<Path> |
AbstractFileSystem.listCorruptFileBlocks(Path path) |
RemoteIterator<Path> |
FileContext.listCorruptFileBlocks(Path path) |
RemoteIterator<Path> |
FileSystem.listCorruptFileBlocks(Path path) |
RemoteIterator<Path> |
FilterFileSystem.listCorruptFileBlocks(Path path) |
RemoteIterator<LocatedFileStatus> |
FileContext.Util.listFiles(Path f,
boolean recursive)
List the statuses and block locations of the files in the given path.
|
RemoteIterator<LocatedFileStatus> |
FileSystem.listFiles(Path f,
boolean recursive)
List the statuses and block locations of the files in the given path.
|
RemoteIterator<LocatedFileStatus> |
AbstractFileSystem.listLocatedStatus(Path f)
The specification of this method matches that of
FileContext.listLocatedStatus(Path) except that Path f
must be for this file system. |
RemoteIterator<LocatedFileStatus> |
FileContext.listLocatedStatus(Path f)
List the statuses of the files/directories in the given path if the path is
a directory.
|
RemoteIterator<LocatedFileStatus> |
HarFileSystem.listLocatedStatus(Path f) |
RemoteIterator<LocatedFileStatus> |
FileSystem.listLocatedStatus(Path f)
List the statuses of the files/directories in the given path if the path is
a directory.
|
RemoteIterator<LocatedFileStatus> |
FilterFileSystem.listLocatedStatus(Path f)
List files and its block locations in a directory.
|
RemoteIterator<LocatedFileStatus> |
ChecksumFileSystem.listLocatedStatus(Path f)
List the statuses of the files/directories in the given path if the path is
a directory.
|
protected RemoteIterator<LocatedFileStatus> |
FileSystem.listLocatedStatus(Path f,
PathFilter filter)
Listing a directory
The returned results include its block location if it is a file
The results are filtered by the given path filter
|
FileStatus[] |
RawLocalFileSystem.listStatus(Path f) |
abstract FileStatus[] |
AbstractFileSystem.listStatus(Path f)
The specification of this method matches that of
FileContext.Util.listStatus(Path) except that Path f must be
for this file system. |
RemoteIterator<FileStatus> |
FileContext.listStatus(Path f)
List the statuses of the files/directories in the given path if the path is
a directory.
|
FileStatus[] |
FileContext.Util.listStatus(Path f)
List the statuses of the files/directories in the given path
if the path is a directory.
|
FileStatus[] |
HarFileSystem.listStatus(Path f)
liststatus returns the children of a directory
after looking up the index files.
|
abstract FileStatus[] |
FileSystem.listStatus(Path f)
List the statuses of the files/directories in the given path if the path is
a directory.
|
FileStatus[] |
FilterFileSystem.listStatus(Path f)
List files in a directory.
|
FileStatus[] |
ChecksumFileSystem.listStatus(Path f)
List the statuses of the files/directories in the given path if the path is
a directory.
|
FileStatus[] |
FileContext.Util.listStatus(Path[] files)
|
FileStatus[] |
FileSystem.listStatus(Path[] files)
Filter files/directories in the given list of paths using default
path filter.
|
FileStatus[] |
FileContext.Util.listStatus(Path[] files,
PathFilter filter)
Filter files/directories in the given list of paths using user-supplied
path filter.
|
FileStatus[] |
FileSystem.listStatus(Path[] files,
PathFilter filter)
Filter files/directories in the given list of paths using user-supplied
path filter.
|
FileStatus[] |
FileContext.Util.listStatus(Path f,
PathFilter filter)
Filter files/directories in the given path using the user-supplied path
filter.
|
FileStatus[] |
FileSystem.listStatus(Path f,
PathFilter filter)
Filter files/directories in the given path using the user-supplied path
filter.
|
RemoteIterator<FileStatus> |
AbstractFileSystem.listStatusIterator(Path f)
The specification of this method matches that of
FileContext.listStatus(Path) except that Path f must be for this
file system. |
Path |
AbstractFileSystem.makeQualified(Path path)
Make the path fully qualified to this file system
|
Path |
FileContext.makeQualified(Path path)
Make the path fully qualified if it is isn't.
|
Path |
HarFileSystem.makeQualified(Path path) |
Path |
FileSystem.makeQualified(Path path)
Make sure that a path specifies a FileSystem.
|
Path |
FilterFileSystem.makeQualified(Path path)
Make sure that a path specifies a FileSystem.
|
Path |
Path.makeQualified(URI defaultUri,
Path workingDir)
Returns a qualified path object.
|
abstract void |
AbstractFileSystem.mkdir(Path dir,
FsPermission permission,
boolean createParent)
The specification of this method matches that of
FileContext.mkdir(Path, FsPermission, boolean) except that the Path
f must be fully qualified and the permission is absolute (i.e. |
void |
FileContext.mkdir(Path dir,
FsPermission permission,
boolean createParent)
Make(create) a directory and all the non-existent parents.
|
static boolean |
FileSystem.mkdirs(FileSystem fs,
Path dir,
FsPermission permission)
create a directory with the provided permission
The permission of the directory is set to be the provided permission as in
setPermission, not permission&~umask
|
boolean |
RawLocalFileSystem.mkdirs(Path f)
Creates the specified directory hierarchy.
|
boolean |
FileSystem.mkdirs(Path f)
Call
FileSystem.mkdirs(Path, FsPermission) with default permission. |
boolean |
ChecksumFileSystem.mkdirs(Path f) |
boolean |
RawLocalFileSystem.mkdirs(Path f,
FsPermission permission)
Make the given file and all non-existent parents into
directories.
|
boolean |
HarFileSystem.mkdirs(Path f,
FsPermission permission)
not implemented.
|
abstract boolean |
FileSystem.mkdirs(Path f,
FsPermission permission)
Make the given file and all non-existent parents into
directories.
|
boolean |
FilterFileSystem.mkdirs(Path f,
FsPermission permission)
Make the given file and all non-existent parents into
directories.
|
void |
FileSystem.moveFromLocalFile(Path[] srcs,
Path dst)
The src files is on the local disk.
|
void |
FileSystem.moveFromLocalFile(Path[] srcs,
Path dst)
The src files is on the local disk.
|
void |
RawLocalFileSystem.moveFromLocalFile(Path src,
Path dst) |
void |
FileSystem.moveFromLocalFile(Path src,
Path dst)
The src file is on the local disk.
|
static boolean |
Trash.moveToAppropriateTrash(FileSystem fs,
Path p,
Configuration conf)
In case of the symlinks or mount points, one has to move the appropriate
trashbin in the actual volume of the path p being deleted.
|
void |
FileSystem.moveToLocalFile(Path src,
Path dst)
The src file is under FS, and the dst is on the local disk.
|
abstract boolean |
TrashPolicy.moveToTrash(Path path)
Move a file or directory to the current trash directory.
|
boolean |
Trash.moveToTrash(Path path)
Move a file or directory to the current trash directory.
|
abstract T |
FileContext.FSLinkResolver.next(AbstractFileSystem fs,
Path p)
Generic helper function overridden on instantiation to perform a
specific operation on the given file system using the given path
which may result in an UnresolvedLinkException.
|
FSDataInputStream |
AbstractFileSystem.open(Path f)
The specification of this method matches that of
FileContext.open(Path) except that Path f must be for this
file system. |
FSDataInputStream |
FileContext.open(Path f)
Opens an FSDataInputStream at the indicated Path using
default buffersize.
|
FSDataInputStream |
FileSystem.open(Path f)
Opens an FSDataInputStream at the indicated Path.
|
FSDataInputStream |
RawLocalFileSystem.open(Path f,
int bufferSize) |
abstract FSDataInputStream |
AbstractFileSystem.open(Path f,
int bufferSize)
The specification of this method matches that of
FileContext.open(Path, int) except that Path f must be for this
file system. |
FSDataInputStream |
FileContext.open(Path f,
int bufferSize)
Opens an FSDataInputStream at the indicated Path.
|
FSDataInputStream |
HarFileSystem.open(Path f,
int bufferSize)
Returns a har input stream which fakes end of
file.
|
abstract FSDataInputStream |
FileSystem.open(Path f,
int bufferSize)
Opens an FSDataInputStream at the indicated Path.
|
FSDataInputStream |
FilterFileSystem.open(Path f,
int bufferSize)
Opens an FSDataInputStream at the indicated Path.
|
FSDataInputStream |
ChecksumFileSystem.open(Path f,
int bufferSize)
Opens an FSDataInputStream at the indicated Path.
|
File |
RawLocalFileSystem.pathToFile(Path path)
Convert a path to a File.
|
File |
LocalFileSystem.pathToFile(Path path)
Convert a path to a File.
|
protected FSDataOutputStream |
FileSystem.primitiveCreate(Path f,
FsPermission absolutePermission,
EnumSet<CreateFlag> flag,
int bufferSize,
short replication,
long blockSize,
Progressable progress,
Options.ChecksumOpt checksumOpt)
Deprecated.
|
protected FSDataOutputStream |
FilterFileSystem.primitiveCreate(Path f,
FsPermission absolutePermission,
EnumSet<CreateFlag> flag,
int bufferSize,
short replication,
long blockSize,
Progressable progress,
Options.ChecksumOpt checksumOpt) |
protected boolean |
RawLocalFileSystem.primitiveMkdir(Path f,
FsPermission absolutePermission) |
protected boolean |
FileSystem.primitiveMkdir(Path f,
FsPermission absolutePermission)
Deprecated.
|
protected boolean |
FilterFileSystem.primitiveMkdir(Path f,
FsPermission abdolutePermission) |
protected void |
FileSystem.primitiveMkdir(Path f,
FsPermission absolutePermission,
boolean createParent)
Deprecated.
|
boolean |
RawLocalFileSystem.rename(Path src,
Path dst) |
abstract boolean |
FileSystem.rename(Path src,
Path dst)
Renames Path src to Path dst.
|
boolean |
FilterFileSystem.rename(Path src,
Path dst)
Renames Path src to Path dst.
|
boolean |
ChecksumFileSystem.rename(Path src,
Path dst)
Rename files/dirs
|
void |
AbstractFileSystem.rename(Path src,
Path dst,
Options.Rename... options)
The specification of this method matches that of
FileContext.rename(Path, Path, Options.Rename...) except that Path
f must be for this file system. |
void |
FileContext.rename(Path src,
Path dst,
Options.Rename... options)
Renames Path src to Path dst
|
protected void |
FileSystem.rename(Path src,
Path dst,
Options.Rename... options)
Deprecated.
|
abstract void |
AbstractFileSystem.renameInternal(Path src,
Path dst)
The specification of this method matches that of
FileContext.rename(Path, Path, Options.Rename...) except that Path
f must be for this file system and NO OVERWRITE is performed. |
void |
AbstractFileSystem.renameInternal(Path src,
Path dst,
boolean overwrite)
The specification of this method matches that of
FileContext.rename(Path, Path, Options.Rename...) except that Path
f must be for this file system. |
boolean |
LocalFileSystem.reportChecksumFailure(Path p,
FSDataInputStream in,
long inPos,
FSDataInputStream sums,
long sumsPos)
Moves files to a bad file directory on the same device, so that their
storage will not be reused.
|
boolean |
ChecksumFileSystem.reportChecksumFailure(Path f,
FSDataInputStream in,
long inPos,
FSDataInputStream sums,
long sumsPos)
Report a checksum error to the file system.
|
T |
FileContext.FSLinkResolver.resolve(FileContext fc,
Path p)
Performs the operation specified by the next function, calling it
repeatedly until all symlinks in the given path are resolved.
|
protected Path |
FileContext.resolve(Path f)
Resolves all symbolic links in the specified path.
|
protected Path |
FileContext.resolveIntermediate(Path f)
Resolves all symbolic links in the specified path leading up
to, but not including the final path component.
|
Path |
AbstractFileSystem.resolvePath(Path p)
Return the fully-qualified path of path f resolving the path
through any internal symlinks or mount point
|
Path |
FileContext.resolvePath(Path f)
Resolve the path following any symlinks or mount points
|
Path |
FileSystem.resolvePath(Path p)
Return the fully-qualified path of path f resolving the path
through any symlinks or mount point
|
Path |
FilterFileSystem.resolvePath(Path p) |
void |
RawLocalFileSystem.setOwner(Path p,
String username,
String groupname)
Use the command chown to set owner.
|
abstract void |
AbstractFileSystem.setOwner(Path f,
String username,
String groupname)
The specification of this method matches that of
FileContext.setOwner(Path, String, String) except that Path f must
be for this file system. |
void |
FileContext.setOwner(Path f,
String username,
String groupname)
Set owner of a path (i.e.
|
void |
HarFileSystem.setOwner(Path p,
String username,
String groupname)
not implemented.
|
void |
FileSystem.setOwner(Path p,
String username,
String groupname)
Set owner of a path (i.e.
|
void |
FilterFileSystem.setOwner(Path p,
String username,
String groupname)
Set owner of a path (i.e.
|
void |
FileStatus.setPath(Path p) |
void |
RawLocalFileSystem.setPermission(Path p,
FsPermission permission)
Use the command chmod to set permission.
|
abstract void |
AbstractFileSystem.setPermission(Path f,
FsPermission permission)
The specification of this method matches that of
FileContext.setPermission(Path, FsPermission) except that Path f
must be for this file system. |
void |
FileContext.setPermission(Path f,
FsPermission permission)
Set permission of a path.
|
void |
HarFileSystem.setPermission(Path p,
FsPermission permisssion)
Not implemented.
|
void |
FileSystem.setPermission(Path p,
FsPermission permission)
Set permission of a path.
|
void |
FilterFileSystem.setPermission(Path p,
FsPermission permission)
Set permission of a path.
|
abstract boolean |
AbstractFileSystem.setReplication(Path f,
short replication)
The specification of this method matches that of
FileContext.setReplication(Path, short) except that Path f must be
for this file system. |
boolean |
FileContext.setReplication(Path f,
short replication)
Set replication for an existing file.
|
boolean |
HarFileSystem.setReplication(Path src,
short replication)
Not implemented.
|
boolean |
FileSystem.setReplication(Path src,
short replication)
Set replication for an existing file.
|
boolean |
FilterFileSystem.setReplication(Path src,
short replication)
Set replication for an existing file.
|
boolean |
ChecksumFileSystem.setReplication(Path src,
short replication)
Set replication for an existing file.
|
void |
FileStatus.setSymlink(Path p) |
abstract void |
AbstractFileSystem.setTimes(Path f,
long mtime,
long atime)
The specification of this method matches that of
FileContext.setTimes(Path, long, long) except that Path f must be
for this file system. |
void |
FileContext.setTimes(Path f,
long mtime,
long atime)
Set access time of a file.
|
void |
FileSystem.setTimes(Path p,
long mtime,
long atime)
Set access time of a file
|
void |
FilterFileSystem.setTimes(Path p,
long mtime,
long atime)
Set access time of a file
|
void |
FileContext.setVerifyChecksum(boolean verifyChecksum,
Path f)
Set the verify checksum flag for the file system denoted by the path.
|
void |
RawLocalFileSystem.setWorkingDirectory(Path newDir)
Set the working directory to the given directory.
|
void |
FileContext.setWorkingDirectory(Path newWDir)
Set the working directory for wd-relative names (such a "foo/bar").
|
void |
HarFileSystem.setWorkingDirectory(Path newDir) |
abstract void |
FileSystem.setWorkingDirectory(Path new_dir)
Set the current working directory for the given file system.
|
void |
FilterFileSystem.setWorkingDirectory(Path newDir)
Set the current working directory for the given file system.
|
Path |
RawLocalFileSystem.startLocalOutput(Path fsOutputFile,
Path tmpLocalFile) |
Path |
HarFileSystem.startLocalOutput(Path fsOutputFile,
Path tmpLocalFile)
not implemented.
|
Path |
FileSystem.startLocalOutput(Path fsOutputFile,
Path tmpLocalFile)
Returns a local File that the user can write output to.
|
Path |
FilterFileSystem.startLocalOutput(Path fsOutputFile,
Path tmpLocalFile)
Returns a local File that the user can write output to.
|
Path |
ChecksumFileSystem.startLocalOutput(Path fsOutputFile,
Path tmpLocalFile) |
static Path[] |
FileUtil.stat2Paths(FileStatus[] stats,
Path path)
convert an array of FileStatus to an array of Path.
|
Constructor and Description |
---|
AvroFSInput(FileContext fc,
Path p)
Construct given a
FileContext and a Path . |
FileStatus(long length,
boolean isdir,
int block_replication,
long blocksize,
long modification_time,
long access_time,
FsPermission permission,
String owner,
String group,
Path path)
Constructor for file systems on which symbolic links are not supported
|
FileStatus(long length,
boolean isdir,
int block_replication,
long blocksize,
long modification_time,
long access_time,
FsPermission permission,
String owner,
String group,
Path symlink,
Path path) |
FileStatus(long length,
boolean isdir,
int block_replication,
long blocksize,
long modification_time,
Path path) |
LocatedFileStatus(long length,
boolean isdir,
int block_replication,
long blocksize,
long modification_time,
long access_time,
FsPermission permission,
String owner,
String group,
Path symlink,
Path path,
BlockLocation[] locations)
Constructor
|
Path(Path parent,
Path child)
Resolve a child path against a parent path.
|
Path(Path parent,
String child)
Resolve a child path against a parent path.
|
Path(String parent,
Path child)
Resolve a child path against a parent path.
|
Modifier and Type | Method and Description |
---|---|
Path |
FTPFileSystem.getHomeDirectory() |
Path |
FTPFileSystem.getWorkingDirectory() |
Modifier and Type | Method and Description |
---|---|
FSDataOutputStream |
FTPFileSystem.append(Path f,
int bufferSize,
Progressable progress)
This optional operation is not yet supported.
|
FSDataOutputStream |
FTPFileSystem.create(Path file,
FsPermission permission,
boolean overwrite,
int bufferSize,
short replication,
long blockSize,
Progressable progress)
A stream obtained via this call must be closed before using other APIs of
this class or else the invocation will block.
|
boolean |
FTPFileSystem.delete(Path file,
boolean recursive) |
FileStatus |
FTPFileSystem.getFileStatus(Path file) |
FileStatus[] |
FTPFileSystem.listStatus(Path file) |
boolean |
FTPFileSystem.mkdirs(Path file,
FsPermission permission) |
FSDataInputStream |
FTPFileSystem.open(Path file,
int bufferSize) |
boolean |
FTPFileSystem.rename(Path src,
Path dst) |
void |
FTPFileSystem.setWorkingDirectory(Path newDir) |
Modifier and Type | Method and Description |
---|---|
Path |
KosmosFileSystem.getWorkingDirectory() |
Path |
KosmosFileSystem.startLocalOutput(Path fsOutputFile,
Path tmpLocalFile) |
Modifier and Type | Method and Description |
---|---|
FSDataOutputStream |
KosmosFileSystem.append(Path f,
int bufferSize,
Progressable progress) |
void |
KosmosFileSystem.completeLocalOutput(Path fsOutputFile,
Path tmpLocalFile) |
void |
KosmosFileSystem.copyFromLocalFile(boolean delSrc,
Path src,
Path dst) |
void |
KosmosFileSystem.copyToLocalFile(boolean delSrc,
Path src,
Path dst) |
FSDataOutputStream |
KosmosFileSystem.create(Path file,
FsPermission permission,
boolean overwrite,
int bufferSize,
short replication,
long blockSize,
Progressable progress) |
boolean |
KosmosFileSystem.delete(Path path,
boolean recursive) |
FileStatus |
KosmosFileSystem.getFileStatus(Path path) |
boolean |
KosmosFileSystem.isDirectory(Path path) |
boolean |
KosmosFileSystem.isFile(Path path) |
FileStatus[] |
KosmosFileSystem.listStatus(Path path) |
void |
KosmosFileSystem.lock(Path path,
boolean shared)
Deprecated.
|
boolean |
KosmosFileSystem.mkdirs(Path path,
FsPermission permission) |
FSDataInputStream |
KosmosFileSystem.open(Path path,
int bufferSize) |
void |
KosmosFileSystem.release(Path path)
Deprecated.
|
boolean |
KosmosFileSystem.rename(Path src,
Path dst) |
boolean |
KosmosFileSystem.setReplication(Path path,
short replication) |
void |
KosmosFileSystem.setWorkingDirectory(Path dir) |
Path |
KosmosFileSystem.startLocalOutput(Path fsOutputFile,
Path tmpLocalFile) |
Modifier and Type | Method and Description |
---|---|
Path |
S3FileSystem.getWorkingDirectory() |
Modifier and Type | Method and Description |
---|---|
FSDataOutputStream |
S3FileSystem.append(Path f,
int bufferSize,
Progressable progress)
This optional operation is not yet supported.
|
FSDataOutputStream |
S3FileSystem.create(Path file,
FsPermission permission,
boolean overwrite,
int bufferSize,
short replication,
long blockSize,
Progressable progress) |
boolean |
S3FileSystem.delete(Path path,
boolean recursive) |
FileStatus |
S3FileSystem.getFileStatus(Path f)
FileStatus for S3 file systems.
|
boolean |
S3FileSystem.isFile(Path path) |
FileStatus[] |
S3FileSystem.listStatus(Path f) |
boolean |
S3FileSystem.mkdirs(Path path,
FsPermission permission) |
FSDataInputStream |
S3FileSystem.open(Path path,
int bufferSize) |
boolean |
S3FileSystem.rename(Path src,
Path dst) |
void |
S3FileSystem.setWorkingDirectory(Path dir) |
Modifier and Type | Method and Description |
---|---|
Path |
NativeS3FileSystem.getWorkingDirectory() |
Modifier and Type | Method and Description |
---|---|
FSDataOutputStream |
NativeS3FileSystem.append(Path f,
int bufferSize,
Progressable progress)
This optional operation is not yet supported.
|
FSDataOutputStream |
NativeS3FileSystem.create(Path f,
FsPermission permission,
boolean overwrite,
int bufferSize,
short replication,
long blockSize,
Progressable progress) |
boolean |
NativeS3FileSystem.delete(Path f,
boolean recurse) |
FileStatus |
NativeS3FileSystem.getFileStatus(Path f) |
FileStatus[] |
NativeS3FileSystem.listStatus(Path f)
If
f is a file, this method will make a single call to S3. |
boolean |
NativeS3FileSystem.mkdirs(Path f,
FsPermission permission) |
FSDataInputStream |
NativeS3FileSystem.open(Path f,
int bufferSize) |
boolean |
NativeS3FileSystem.rename(Path src,
Path dst) |
void |
NativeS3FileSystem.setWorkingDirectory(Path newDir)
Set the working directory to the given directory.
|
Modifier and Type | Method and Description |
---|---|
Path |
PathExceptions.PathIOException.getPath() |
Path |
PathExceptions.PathIOException.getTargetPath() |
Modifier and Type | Method and Description |
---|---|
Path |
ViewFs.getHomeDirectory() |
Path |
ViewFileSystem.getHomeDirectory() |
Path |
ViewFs.getLinkTarget(Path f) |
Path |
ViewFileSystem.getTrashCanLocation(Path f) |
Path |
ViewFileSystem.getWorkingDirectory() |
Path |
ViewFs.resolvePath(Path f) |
Path |
ViewFileSystem.resolvePath(Path f) |
Modifier and Type | Method and Description |
---|---|
FSDataOutputStream |
ViewFileSystem.append(Path f,
int bufferSize,
Progressable progress) |
FSDataOutputStream |
ViewFileSystem.create(Path f,
FsPermission permission,
boolean overwrite,
int bufferSize,
short replication,
long blockSize,
Progressable progress) |
FSDataOutputStream |
ViewFs.createInternal(Path f,
EnumSet<CreateFlag> flag,
FsPermission absolutePermission,
int bufferSize,
short replication,
long blockSize,
Progressable progress,
Options.ChecksumOpt checksumOpt,
boolean createParent) |
void |
ViewFs.createSymlink(Path target,
Path link,
boolean createParent) |
boolean |
ViewFileSystem.delete(Path f) |
boolean |
ViewFs.delete(Path f,
boolean recursive) |
boolean |
ViewFileSystem.delete(Path f,
boolean recursive) |
ContentSummary |
ViewFileSystem.getContentSummary(Path f) |
long |
ViewFileSystem.getDefaultBlockSize(Path f) |
short |
ViewFileSystem.getDefaultReplication(Path f) |
BlockLocation[] |
ViewFs.getFileBlockLocations(Path f,
long start,
long len) |
FileChecksum |
ViewFs.getFileChecksum(Path f) |
FileChecksum |
ViewFileSystem.getFileChecksum(Path f) |
FileStatus |
ViewFs.getFileLinkStatus(Path f) |
FileStatus |
ViewFs.getFileStatus(Path f) |
FileStatus |
ViewFileSystem.getFileStatus(Path f) |
Path |
ViewFs.getLinkTarget(Path f) |
FsServerDefaults |
ViewFileSystem.getServerDefaults(Path f) |
Path |
ViewFileSystem.getTrashCanLocation(Path f) |
FileStatus[] |
ViewFs.listStatus(Path f) |
FileStatus[] |
ViewFileSystem.listStatus(Path f) |
RemoteIterator<FileStatus> |
ViewFs.listStatusIterator(Path f) |
void |
ViewFs.mkdir(Path dir,
FsPermission permission,
boolean createParent) |
boolean |
ViewFileSystem.mkdirs(Path dir,
FsPermission permission) |
FSDataInputStream |
ViewFs.open(Path f,
int bufferSize) |
FSDataInputStream |
ViewFileSystem.open(Path f,
int bufferSize) |
boolean |
ViewFileSystem.rename(Path src,
Path dst) |
void |
ViewFs.renameInternal(Path src,
Path dst) |
void |
ViewFs.renameInternal(Path src,
Path dst,
boolean overwrite) |
Path |
ViewFs.resolvePath(Path f) |
Path |
ViewFileSystem.resolvePath(Path f) |
void |
ViewFs.setOwner(Path f,
String username,
String groupname) |
void |
ViewFileSystem.setOwner(Path f,
String username,
String groupname) |
void |
ViewFs.setPermission(Path f,
FsPermission permission) |
void |
ViewFileSystem.setPermission(Path f,
FsPermission permission) |
boolean |
ViewFs.setReplication(Path f,
short replication) |
boolean |
ViewFileSystem.setReplication(Path f,
short replication) |
void |
ViewFs.setTimes(Path f,
long mtime,
long atime) |
void |
ViewFileSystem.setTimes(Path f,
long mtime,
long atime) |
void |
ViewFileSystem.setWorkingDirectory(Path new_dir) |
Constructor and Description |
---|
NotInMountpointException(Path path,
String operation) |
Modifier and Type | Method and Description |
---|---|
SequenceFile.Writer |
SequenceFile.Sorter.cloneFileAttributes(Path inputFile,
Path outputFile,
Progressable prog)
Clones the attributes (like compression of the input file and creates a
corresponding Writer
|
protected SequenceFile.Reader |
MapFile.Reader.createDataFileReader(Path dataFile,
Configuration conf,
SequenceFile.Reader.Option... options)
Override this method to specialize the type of
SequenceFile.Reader returned. |
static SequenceFile.Writer |
SequenceFile.createWriter(FileContext fc,
Configuration conf,
Path name,
Class keyClass,
Class valClass,
SequenceFile.CompressionType compressionType,
CompressionCodec codec,
SequenceFile.Metadata metadata,
EnumSet<CreateFlag> createFlag,
Options.CreateOpts... opts)
Construct the preferred type of SequenceFile Writer.
|
static SequenceFile.Writer |
SequenceFile.createWriter(FileSystem fs,
Configuration conf,
Path name,
Class keyClass,
Class valClass)
Deprecated.
|
static SequenceFile.Writer |
SequenceFile.createWriter(FileSystem fs,
Configuration conf,
Path name,
Class keyClass,
Class valClass,
int bufferSize,
short replication,
long blockSize,
boolean createParent,
SequenceFile.CompressionType compressionType,
CompressionCodec codec,
SequenceFile.Metadata metadata)
Deprecated.
|
static SequenceFile.Writer |
SequenceFile.createWriter(FileSystem fs,
Configuration conf,
Path name,
Class keyClass,
Class valClass,
int bufferSize,
short replication,
long blockSize,
SequenceFile.CompressionType compressionType,
CompressionCodec codec,
Progressable progress,
SequenceFile.Metadata metadata)
Deprecated.
|
static SequenceFile.Writer |
SequenceFile.createWriter(FileSystem fs,
Configuration conf,
Path name,
Class keyClass,
Class valClass,
SequenceFile.CompressionType compressionType)
Deprecated.
|
static SequenceFile.Writer |
SequenceFile.createWriter(FileSystem fs,
Configuration conf,
Path name,
Class keyClass,
Class valClass,
SequenceFile.CompressionType compressionType,
CompressionCodec codec)
Deprecated.
|
static SequenceFile.Writer |
SequenceFile.createWriter(FileSystem fs,
Configuration conf,
Path name,
Class keyClass,
Class valClass,
SequenceFile.CompressionType compressionType,
CompressionCodec codec,
Progressable progress)
Deprecated.
|
static SequenceFile.Writer |
SequenceFile.createWriter(FileSystem fs,
Configuration conf,
Path name,
Class keyClass,
Class valClass,
SequenceFile.CompressionType compressionType,
CompressionCodec codec,
Progressable progress,
SequenceFile.Metadata metadata)
Deprecated.
|
static SequenceFile.Writer |
SequenceFile.createWriter(FileSystem fs,
Configuration conf,
Path name,
Class keyClass,
Class valClass,
SequenceFile.CompressionType compressionType,
Progressable progress)
Deprecated.
|
static SequenceFile.Writer.Option |
SequenceFile.Writer.file(Path value) |
static SequenceFile.Reader.Option |
SequenceFile.Reader.file(Path value)
Create an option to specify the path name of the sequence file.
|
static long |
MapFile.fix(FileSystem fs,
Path dir,
Class<? extends Writable> keyClass,
Class<? extends Writable> valueClass,
boolean dryrun,
Configuration conf)
This method attempts to fix a corrupt MapFile by re-creating its index.
|
SequenceFile.Sorter.RawKeyValueIterator |
SequenceFile.Sorter.merge(List<SequenceFile.Sorter.SegmentDescriptor> segments,
Path tmpDir)
Merges the list of segments of type
SegmentDescriptor |
SequenceFile.Sorter.RawKeyValueIterator |
SequenceFile.Sorter.merge(Path[] inNames,
boolean deleteInputs,
int factor,
Path tmpDir)
Merges the contents of files passed in Path[]
|
SequenceFile.Sorter.RawKeyValueIterator |
SequenceFile.Sorter.merge(Path[] inNames,
boolean deleteInputs,
int factor,
Path tmpDir)
Merges the contents of files passed in Path[]
|
SequenceFile.Sorter.RawKeyValueIterator |
SequenceFile.Sorter.merge(Path[] inNames,
boolean deleteInputs,
Path tmpDir)
Merges the contents of files passed in Path[] using a max factor value
that is already set
|
SequenceFile.Sorter.RawKeyValueIterator |
SequenceFile.Sorter.merge(Path[] inNames,
boolean deleteInputs,
Path tmpDir)
Merges the contents of files passed in Path[] using a max factor value
that is already set
|
void |
SequenceFile.Sorter.merge(Path[] inFiles,
Path outFile)
Merge the provided files.
|
void |
SequenceFile.Sorter.merge(Path[] inFiles,
Path outFile)
Merge the provided files.
|
SequenceFile.Sorter.RawKeyValueIterator |
SequenceFile.Sorter.merge(Path[] inNames,
Path tempDir,
boolean deleteInputs)
Merges the contents of files passed in Path[]
|
SequenceFile.Sorter.RawKeyValueIterator |
SequenceFile.Sorter.merge(Path[] inNames,
Path tempDir,
boolean deleteInputs)
Merges the contents of files passed in Path[]
|
protected void |
MapFile.Reader.open(Path dir,
WritableComparator comparator,
Configuration conf,
SequenceFile.Reader.Option... options) |
protected FSDataInputStream |
SequenceFile.Reader.openFile(FileSystem fs,
Path file,
int bufferSize,
long length)
Override this method to specialize the type of
FSDataInputStream returned. |
void |
SequenceFile.Sorter.sort(Path[] inFiles,
Path outFile,
boolean deleteInput)
Perform a file sort from a set of input files into an output file.
|
void |
SequenceFile.Sorter.sort(Path[] inFiles,
Path outFile,
boolean deleteInput)
Perform a file sort from a set of input files into an output file.
|
void |
SequenceFile.Sorter.sort(Path inFile,
Path outFile)
The backwards compatible interface to sort.
|
SequenceFile.Sorter.RawKeyValueIterator |
SequenceFile.Sorter.sortAndIterate(Path[] inFiles,
Path tempDir,
boolean deleteInput)
Perform a file sort from a set of input files and return an iterator.
|
SequenceFile.Sorter.RawKeyValueIterator |
SequenceFile.Sorter.sortAndIterate(Path[] inFiles,
Path tempDir,
boolean deleteInput)
Perform a file sort from a set of input files and return an iterator.
|
Constructor and Description |
---|
BloomMapFile.Reader(Path dir,
Configuration conf,
SequenceFile.Reader.Option... options) |
BloomMapFile.Writer(Configuration conf,
Path dir,
SequenceFile.Writer.Option... options) |
MapFile.Reader(Path dir,
Configuration conf,
SequenceFile.Reader.Option... opts) |
MapFile.Writer(Configuration conf,
Path dirName,
SequenceFile.Writer.Option... opts) |
SequenceFile.Reader(FileSystem fs,
Path file,
Configuration conf)
Deprecated.
Use Reader(Configuration, Option...) instead.
|
SequenceFile.Sorter.SegmentDescriptor(long segmentOffset,
long segmentLength,
Path segmentPathName)
Constructs a segment
|
SequenceFile.Writer(FileSystem fs,
Configuration conf,
Path name,
Class keyClass,
Class valClass)
Deprecated.
|
SequenceFile.Writer(FileSystem fs,
Configuration conf,
Path name,
Class keyClass,
Class valClass,
int bufferSize,
short replication,
long blockSize,
Progressable progress,
SequenceFile.Metadata metadata)
Deprecated.
|
SequenceFile.Writer(FileSystem fs,
Configuration conf,
Path name,
Class keyClass,
Class valClass,
Progressable progress,
SequenceFile.Metadata metadata)
Deprecated.
|
Modifier and Type | Method and Description |
---|---|
CompressionCodec |
CompressionCodecFactory.getCodec(Path file)
Find the relevant compression codec for the given file based on its
filename suffix.
|
Modifier and Type | Method and Description |
---|---|
Path |
Options.PathOption.getValue() |
Constructor and Description |
---|
Options.PathOption(Path value) |
Copyright © 2014 Apache Software Foundation. All Rights Reserved.