| Modifier and Type | Method and Description |
|---|---|
Configuration |
Configured.getConf() |
Configuration |
Configurable.getConf()
Return the configuration used by this object.
|
| Modifier and Type | Method and Description |
|---|---|
static void |
Configuration.dumpConfiguration(Configuration config,
Writer out)
Writes out all the parameters and their properties (final and resource) to
the given
Writer
The format of the output would be
{ "properties" : [ {key1,value1,key1.isFinal,key1.resource}, {key2,value2,
key2.isFinal,key2.resource}... |
static Collection<ReconfigurationUtil.PropertyChange> |
ReconfigurationUtil.getChangedProperties(Configuration newConf,
Configuration oldConf) |
void |
Configured.setConf(Configuration conf) |
void |
Configurable.setConf(Configuration conf)
Set the configuration to be used by this object.
|
| Constructor and Description |
|---|
Configuration(Configuration other)
A new configuration with the same settings cloned from another.
|
Configured(Configuration conf)
Construct a Configured.
|
ReconfigurableBase(Configuration conf)
Construct a ReconfigurableBase with the
Configuration
conf. |
| Modifier and Type | Method and Description |
|---|---|
Configuration |
FilterFileSystem.getConf() |
| Modifier and Type | Method and Description |
|---|---|
static boolean |
FileUtil.copy(File src,
FileSystem dstFS,
Path dst,
boolean deleteSource,
Configuration conf)
Copy local files to a FileSystem.
|
static boolean |
FileUtil.copy(FileSystem srcFS,
Path[] srcs,
FileSystem dstFS,
Path dst,
boolean deleteSource,
boolean overwrite,
Configuration conf) |
static boolean |
FileUtil.copy(FileSystem srcFS,
Path src,
File dst,
boolean deleteSource,
Configuration conf)
Copy FileSystem files to local files.
|
static boolean |
FileUtil.copy(FileSystem srcFS,
Path src,
FileSystem dstFS,
Path dst,
boolean deleteSource,
boolean overwrite,
Configuration conf)
Copy files between FileSystems.
|
static boolean |
FileUtil.copy(FileSystem srcFS,
Path src,
FileSystem dstFS,
Path dst,
boolean deleteSource,
Configuration conf)
Copy files between FileSystems.
|
static boolean |
FileUtil.copyMerge(FileSystem srcFS,
Path srcDir,
FileSystem dstFS,
Path dstFile,
boolean deleteSource,
Configuration conf,
String addString)
Copy all files in a directory to one output file (merge).
|
static AbstractFileSystem |
AbstractFileSystem.createFileSystem(URI uri,
Configuration conf)
Create a file system instance for the specified uri using the conf.
|
static FileSystem |
FileSystem.get(Configuration conf)
Returns the configured filesystem implementation.
|
static AbstractFileSystem |
AbstractFileSystem.get(URI uri,
Configuration conf)
The main factory method for creating a file system.
|
static FileSystem |
FileSystem.get(URI uri,
Configuration conf)
Returns the FileSystem for this URI's scheme and authority.
|
static FileSystem |
FileSystem.get(URI uri,
Configuration conf,
String user)
Get a filesystem instance based on the uri, the passed
configuration and the user
|
static URI |
FileSystem.getDefaultUri(Configuration conf)
Get the default filesystem URI from a configuration.
|
static FileContext |
FileContext.getFileContext(AbstractFileSystem defFS,
Configuration aConf)
Create a FileContext with specified FS as default using the specified
config.
|
static FileContext |
FileContext.getFileContext(Configuration aConf)
Create a FileContext using the passed config.
|
static FileContext |
FileContext.getFileContext(URI defaultFsUri,
Configuration aConf)
Create a FileContext for specified default URI using the specified config.
|
FileSystem |
Path.getFileSystem(Configuration conf)
Return the FileSystem that owns this Path.
|
static TrashPolicy |
TrashPolicy.getInstance(Configuration conf,
FileSystem fs,
Path home)
Get an instance of the configured TrashPolicy based on the value
of the configuration paramater fs.trash.classname.
|
static LocalFileSystem |
FileSystem.getLocal(Configuration conf)
Get the local file system.
|
static FileContext |
FileContext.getLocalFSFileContext(Configuration aConf) |
static FileSystem |
FileSystem.getNamed(String name,
Configuration conf)
Deprecated.
call #get(URI,Configuration) instead.
|
abstract void |
TrashPolicy.initialize(Configuration conf,
FileSystem fs,
Path home)
Used to setup the trash policy.
|
void |
RawLocalFileSystem.initialize(URI uri,
Configuration conf) |
void |
FilterFileSystem.initialize(URI name,
Configuration conf)
Called after a new FileSystem instance is constructed.
|
void |
FileSystem.initialize(URI name,
Configuration conf)
Called after a new FileSystem instance is constructed.
|
void |
LocalFileSystem.initialize(URI name,
Configuration conf) |
void |
HarFileSystem.initialize(URI name,
Configuration conf)
Initialize a Har filesystem per har archive.
|
static boolean |
Trash.moveToAppropriateTrash(FileSystem fs,
Path p,
Configuration conf)
In case of the symlinks or mount points, one has to move the appropriate
trashbin in the actual volume of the path p being deleted.
|
static FileSystem |
FileSystem.newInstance(Configuration conf)
Returns a unique configured filesystem implementation.
|
static FileSystem |
FileSystem.newInstance(URI uri,
Configuration conf)
Returns the FileSystem for this URI's scheme and authority.
|
static FileSystem |
FileSystem.newInstance(URI uri,
Configuration conf,
String user)
Returns the FileSystem for this URI's scheme and authority and the
passed user.
|
static LocalFileSystem |
FileSystem.newInstanceLocal(Configuration conf)
Get a unique local file system object
|
void |
ChecksumFileSystem.setConf(Configuration conf) |
static void |
FileSystem.setDefaultUri(Configuration conf,
String uri)
Set the default filesystem URI in a configuration.
|
static void |
FileSystem.setDefaultUri(Configuration conf,
URI uri)
Set the default filesystem URI in a configuration.
|
| Constructor and Description |
|---|
Trash(Configuration conf)
Construct a trash can accessor.
|
Trash(FileSystem fs,
Configuration conf)
Construct a trash can accessor for the FileSystem provided.
|
| Modifier and Type | Method and Description |
|---|---|
void |
FTPFileSystem.initialize(URI uri,
Configuration conf) |
| Modifier and Type | Method and Description |
|---|---|
void |
KosmosFileSystem.initialize(URI uri,
Configuration conf) |
| Modifier and Type | Method and Description |
|---|---|
static FsPermission |
FsPermission.getUMask(Configuration conf)
Get the user file creation mask (umask)
UMASK_LABEL config param has umask value that is either symbolic
or octal. |
static void |
FsPermission.setUMask(Configuration conf,
FsPermission umask)
Set the user file creation mask (umask)
|
| Modifier and Type | Method and Description |
|---|---|
void |
S3FileSystem.initialize(URI uri,
Configuration conf) |
| Modifier and Type | Method and Description |
|---|---|
void |
NativeS3FileSystem.initialize(URI uri,
Configuration conf) |
| Modifier and Type | Method and Description |
|---|---|
static void |
ConfigUtil.addLink(Configuration conf,
String mountTableName,
String src,
URI target)
Add a link to the config for the specified mount table
|
static void |
ConfigUtil.addLink(Configuration conf,
String src,
URI target)
Add a link to the config for the default mount table
|
static String |
ConfigUtil.getHomeDirValue(Configuration conf)
Get the value of the home dir conf value for default mount table
|
static String |
ConfigUtil.getHomeDirValue(Configuration conf,
String mountTableName)
Get the value of the home dir conf value for specfied mount table
|
void |
ViewFileSystem.initialize(URI theUri,
Configuration conf)
Called after a new FileSystem instance is constructed.
|
static void |
ConfigUtil.setHomeDirConf(Configuration conf,
String homedir)
Add config variable for homedir for default mount table
|
static void |
ConfigUtil.setHomeDirConf(Configuration conf,
String mountTableName,
String homedir)
Add config variable for homedir the specified mount table
|
| Constructor and Description |
|---|
ViewFileSystem(Configuration conf)
Convenience Constructor for apps to call directly
|
ViewFs(Configuration conf) |
| Modifier and Type | Method and Description |
|---|---|
abstract void |
FilterInitializer.initFilter(FilterContainer container,
Configuration conf)
Initialize a Filter to a FilterContainer.
|
| Modifier and Type | Method and Description |
|---|---|
void |
StaticUserWebFilter.initFilter(FilterContainer container,
Configuration conf) |
| Modifier and Type | Method and Description |
|---|---|
Configuration |
EnumSetWritable.getConf()
Return the configuration used by this object.
|
Configuration |
AbstractMapWritable.getConf() |
Configuration |
GenericWritable.getConf() |
Configuration |
ObjectWritable.getConf() |
| Modifier and Type | Method and Description |
|---|---|
static <T extends Writable> |
WritableUtils.clone(T orig,
Configuration conf)
Make a copy of a writable object using serialization to a buffer.
|
static void |
IOUtils.copyBytes(InputStream in,
OutputStream out,
Configuration conf)
Copies from one stream to another.
|
static void |
IOUtils.copyBytes(InputStream in,
OutputStream out,
Configuration conf,
boolean close)
Copies from one stream to another.
|
protected SequenceFile.Reader |
MapFile.Reader.createDataFileReader(Path dataFile,
Configuration conf,
SequenceFile.Reader.Option... options)
Override this method to specialize the type of
SequenceFile.Reader returned. |
static SequenceFile.Writer |
SequenceFile.createWriter(Configuration conf,
FSDataOutputStream out,
Class keyClass,
Class valClass,
SequenceFile.CompressionType compressionType,
CompressionCodec codec)
Deprecated.
|
static SequenceFile.Writer |
SequenceFile.createWriter(Configuration conf,
FSDataOutputStream out,
Class keyClass,
Class valClass,
SequenceFile.CompressionType compressionType,
CompressionCodec codec,
SequenceFile.Metadata metadata)
Deprecated.
|
static SequenceFile.Writer |
SequenceFile.createWriter(Configuration conf,
SequenceFile.Writer.Option... opts)
Create a new Writer with the given options.
|
static SequenceFile.Writer |
SequenceFile.createWriter(FileContext fc,
Configuration conf,
Path name,
Class keyClass,
Class valClass,
SequenceFile.CompressionType compressionType,
CompressionCodec codec,
SequenceFile.Metadata metadata,
EnumSet<CreateFlag> createFlag,
Options.CreateOpts... opts)
Construct the preferred type of SequenceFile Writer.
|
static SequenceFile.Writer |
SequenceFile.createWriter(FileSystem fs,
Configuration conf,
Path name,
Class keyClass,
Class valClass)
Deprecated.
|
static SequenceFile.Writer |
SequenceFile.createWriter(FileSystem fs,
Configuration conf,
Path name,
Class keyClass,
Class valClass,
int bufferSize,
short replication,
long blockSize,
boolean createParent,
SequenceFile.CompressionType compressionType,
CompressionCodec codec,
SequenceFile.Metadata metadata)
Deprecated.
|
static SequenceFile.Writer |
SequenceFile.createWriter(FileSystem fs,
Configuration conf,
Path name,
Class keyClass,
Class valClass,
int bufferSize,
short replication,
long blockSize,
SequenceFile.CompressionType compressionType,
CompressionCodec codec,
Progressable progress,
SequenceFile.Metadata metadata)
Deprecated.
|
static SequenceFile.Writer |
SequenceFile.createWriter(FileSystem fs,
Configuration conf,
Path name,
Class keyClass,
Class valClass,
SequenceFile.CompressionType compressionType)
Deprecated.
|
static SequenceFile.Writer |
SequenceFile.createWriter(FileSystem fs,
Configuration conf,
Path name,
Class keyClass,
Class valClass,
SequenceFile.CompressionType compressionType,
CompressionCodec codec)
Deprecated.
|
static SequenceFile.Writer |
SequenceFile.createWriter(FileSystem fs,
Configuration conf,
Path name,
Class keyClass,
Class valClass,
SequenceFile.CompressionType compressionType,
CompressionCodec codec,
Progressable progress)
Deprecated.
|
static SequenceFile.Writer |
SequenceFile.createWriter(FileSystem fs,
Configuration conf,
Path name,
Class keyClass,
Class valClass,
SequenceFile.CompressionType compressionType,
CompressionCodec codec,
Progressable progress,
SequenceFile.Metadata metadata)
Deprecated.
|
static SequenceFile.Writer |
SequenceFile.createWriter(FileSystem fs,
Configuration conf,
Path name,
Class keyClass,
Class valClass,
SequenceFile.CompressionType compressionType,
Progressable progress)
Deprecated.
|
static long |
MapFile.fix(FileSystem fs,
Path dir,
Class<? extends Writable> keyClass,
Class<? extends Writable> valueClass,
boolean dryrun,
Configuration conf)
This method attempts to fix a corrupt MapFile by re-creating its index.
|
static SequenceFile.CompressionType |
SequenceFile.getDefaultCompressionType(Configuration job)
Get the compression type for the reduce outputs
|
static <K> K |
DefaultStringifier.load(Configuration conf,
String keyName,
Class<K> itemClass)
Restores the object from the configuration.
|
static <K> K[] |
DefaultStringifier.loadArray(Configuration conf,
String keyName,
Class<K> itemClass)
Restores the array of objects from the configuration.
|
static Class<?> |
ObjectWritable.loadClass(Configuration conf,
String className)
Find and load the class with given name className by first finding
it in the specified conf.
|
static Writable |
WritableFactories.newInstance(Class<? extends Writable> c,
Configuration conf)
Create a new instance of a class with a defined factory.
|
protected void |
MapFile.Reader.open(Path dir,
WritableComparator comparator,
Configuration conf,
SequenceFile.Reader.Option... options) |
static Object |
ObjectWritable.readObject(DataInput in,
Configuration conf)
|
static Object |
ObjectWritable.readObject(DataInput in,
ObjectWritable objectWritable,
Configuration conf)
|
void |
EnumSetWritable.setConf(Configuration conf)
Set the configuration to be used by this object.
|
void |
AbstractMapWritable.setConf(Configuration conf) |
void |
GenericWritable.setConf(Configuration conf) |
void |
ObjectWritable.setConf(Configuration conf) |
static void |
SequenceFile.setDefaultCompressionType(Configuration job,
SequenceFile.CompressionType val)
Set the default compression type for sequence files.
|
static void |
MapFile.Writer.setIndexInterval(Configuration conf,
int interval)
Sets the index interval and stores it in conf
|
static <K> void |
DefaultStringifier.store(Configuration conf,
K item,
String keyName)
Stores the item in the configuration with the given keyName.
|
static <K> void |
DefaultStringifier.storeArray(Configuration conf,
K[] items,
String keyName)
Stores the array of items in the configuration with the given keyName.
|
static void |
ObjectWritable.writeObject(DataOutput out,
Object instance,
Class declaredClass,
Configuration conf)
|
static void |
ObjectWritable.writeObject(DataOutput out,
Object instance,
Class declaredClass,
Configuration conf,
boolean allowCompactArrays)
|
| Constructor and Description |
|---|
ArrayFile.Reader(FileSystem fs,
String file,
Configuration conf)
Construct an array reader for the named file.
|
ArrayFile.Writer(Configuration conf,
FileSystem fs,
String file,
Class<? extends Writable> valClass)
Create the named file for values of the named class.
|
ArrayFile.Writer(Configuration conf,
FileSystem fs,
String file,
Class<? extends Writable> valClass,
SequenceFile.CompressionType compress,
Progressable progress)
Create the named file for values of the named class.
|
BloomMapFile.Reader(FileSystem fs,
String dirName,
Configuration conf)
Deprecated.
|
BloomMapFile.Reader(FileSystem fs,
String dirName,
WritableComparator comparator,
Configuration conf)
Deprecated.
|
BloomMapFile.Reader(FileSystem fs,
String dirName,
WritableComparator comparator,
Configuration conf,
boolean open)
Deprecated.
|
BloomMapFile.Reader(Path dir,
Configuration conf,
SequenceFile.Reader.Option... options) |
BloomMapFile.Writer(Configuration conf,
FileSystem fs,
String dirName,
Class<? extends WritableComparable> keyClass,
Class valClass)
Deprecated.
|
BloomMapFile.Writer(Configuration conf,
FileSystem fs,
String dirName,
Class<? extends WritableComparable> keyClass,
Class<? extends Writable> valClass,
SequenceFile.CompressionType compress,
CompressionCodec codec,
Progressable progress)
Deprecated.
|
BloomMapFile.Writer(Configuration conf,
FileSystem fs,
String dirName,
Class<? extends WritableComparable> keyClass,
Class valClass,
SequenceFile.CompressionType compress)
Deprecated.
|
BloomMapFile.Writer(Configuration conf,
FileSystem fs,
String dirName,
Class<? extends WritableComparable> keyClass,
Class valClass,
SequenceFile.CompressionType compress,
Progressable progress)
Deprecated.
|
BloomMapFile.Writer(Configuration conf,
FileSystem fs,
String dirName,
WritableComparator comparator,
Class valClass)
Deprecated.
|
BloomMapFile.Writer(Configuration conf,
FileSystem fs,
String dirName,
WritableComparator comparator,
Class valClass,
SequenceFile.CompressionType compress)
Deprecated.
|
BloomMapFile.Writer(Configuration conf,
FileSystem fs,
String dirName,
WritableComparator comparator,
Class valClass,
SequenceFile.CompressionType compress,
CompressionCodec codec,
Progressable progress)
Deprecated.
|
BloomMapFile.Writer(Configuration conf,
FileSystem fs,
String dirName,
WritableComparator comparator,
Class valClass,
SequenceFile.CompressionType compress,
Progressable progress)
Deprecated.
|
BloomMapFile.Writer(Configuration conf,
Path dir,
SequenceFile.Writer.Option... options) |
DefaultStringifier(Configuration conf,
Class<T> c) |
MapFile.Reader(FileSystem fs,
String dirName,
Configuration conf)
Deprecated.
|
MapFile.Reader(FileSystem fs,
String dirName,
WritableComparator comparator,
Configuration conf)
Deprecated.
|
MapFile.Reader(Path dir,
Configuration conf,
SequenceFile.Reader.Option... opts) |
MapFile.Writer(Configuration conf,
FileSystem fs,
String dirName,
Class<? extends WritableComparable> keyClass,
Class valClass)
Deprecated.
Use Writer(Configuration, Path, Option...) instead.
|
MapFile.Writer(Configuration conf,
FileSystem fs,
String dirName,
Class<? extends WritableComparable> keyClass,
Class valClass,
SequenceFile.CompressionType compress)
Deprecated.
Use Writer(Configuration, Path, Option...) instead.
|
MapFile.Writer(Configuration conf,
FileSystem fs,
String dirName,
Class<? extends WritableComparable> keyClass,
Class valClass,
SequenceFile.CompressionType compress,
CompressionCodec codec,
Progressable progress)
Deprecated.
Use Writer(Configuration, Path, Option...) instead.
|
MapFile.Writer(Configuration conf,
FileSystem fs,
String dirName,
Class<? extends WritableComparable> keyClass,
Class valClass,
SequenceFile.CompressionType compress,
Progressable progress)
Deprecated.
Use Writer(Configuration, Path, Option...) instead.
|
MapFile.Writer(Configuration conf,
FileSystem fs,
String dirName,
WritableComparator comparator,
Class valClass)
Deprecated.
Use Writer(Configuration, Path, Option...) instead.
|
MapFile.Writer(Configuration conf,
FileSystem fs,
String dirName,
WritableComparator comparator,
Class valClass,
SequenceFile.CompressionType compress)
Deprecated.
Use Writer(Configuration, Path, Option...) instead.
|
MapFile.Writer(Configuration conf,
FileSystem fs,
String dirName,
WritableComparator comparator,
Class valClass,
SequenceFile.CompressionType compress,
CompressionCodec codec,
Progressable progress)
Deprecated.
Use Writer(Configuration, Path, Option...) instead.
|
MapFile.Writer(Configuration conf,
FileSystem fs,
String dirName,
WritableComparator comparator,
Class valClass,
SequenceFile.CompressionType compress,
Progressable progress)
Deprecated.
Use Writer(Configuration, Path, Option...)} instead.
|
MapFile.Writer(Configuration conf,
Path dirName,
SequenceFile.Writer.Option... opts) |
SequenceFile.Reader(Configuration conf,
SequenceFile.Reader.Option... opts) |
SequenceFile.Reader(FileSystem fs,
Path file,
Configuration conf)
Deprecated.
Use Reader(Configuration, Option...) instead.
|
SequenceFile.Reader(FSDataInputStream in,
int buffersize,
long start,
long length,
Configuration conf)
Deprecated.
Use Reader(Configuration, Reader.Option...) instead.
|
SequenceFile.Sorter(FileSystem fs,
Class<? extends WritableComparable> keyClass,
Class valClass,
Configuration conf)
Sort and merge files containing the named classes.
|
SequenceFile.Sorter(FileSystem fs,
RawComparator comparator,
Class keyClass,
Class valClass,
Configuration conf)
Sort and merge using an arbitrary
RawComparator. |
SequenceFile.Sorter(FileSystem fs,
RawComparator comparator,
Class keyClass,
Class valClass,
Configuration conf,
SequenceFile.Metadata metadata)
Sort and merge using an arbitrary
RawComparator. |
SequenceFile.Writer(FileSystem fs,
Configuration conf,
Path name,
Class keyClass,
Class valClass)
Deprecated.
|
SequenceFile.Writer(FileSystem fs,
Configuration conf,
Path name,
Class keyClass,
Class valClass,
int bufferSize,
short replication,
long blockSize,
Progressable progress,
SequenceFile.Metadata metadata)
Deprecated.
|
SequenceFile.Writer(FileSystem fs,
Configuration conf,
Path name,
Class keyClass,
Class valClass,
Progressable progress,
SequenceFile.Metadata metadata)
Deprecated.
|
SetFile.Reader(FileSystem fs,
String dirName,
Configuration conf)
Construct a set reader for the named set.
|
SetFile.Reader(FileSystem fs,
String dirName,
WritableComparator comparator,
Configuration conf)
Construct a set reader for the named set using the named comparator.
|
SetFile.Writer(Configuration conf,
FileSystem fs,
String dirName,
Class<? extends WritableComparable> keyClass,
SequenceFile.CompressionType compress)
Create a set naming the element class and compression type.
|
SetFile.Writer(Configuration conf,
FileSystem fs,
String dirName,
WritableComparator comparator,
SequenceFile.CompressionType compress)
Create a set naming the element comparator and compression type.
|
| Modifier and Type | Method and Description |
|---|---|
Configuration |
Lz4Codec.getConf()
Return the configuration used by this object.
|
Configuration |
BZip2Codec.getConf()
Return the configuration used by this object.
|
Configuration |
SnappyCodec.getConf()
Return the configuration used by this object.
|
Configuration |
DefaultCodec.getConf() |
| Modifier and Type | Method and Description |
|---|---|
static List<Class<? extends CompressionCodec>> |
CompressionCodecFactory.getCodecClasses(Configuration conf)
Get the list of codecs listed in the configuration
|
static Compressor |
CodecPool.getCompressor(CompressionCodec codec,
Configuration conf)
Get a
Compressor for the given CompressionCodec from the
pool or a new one. |
void |
Compressor.reinit(Configuration conf)
Prepare the compressor to be used in a new stream with settings defined in
the given Configuration
|
static void |
CompressionCodecFactory.setCodecClasses(Configuration conf,
List<Class> classes)
Sets a list of codec classes in the configuration.
|
void |
Lz4Codec.setConf(Configuration conf)
Set the configuration to be used by this object.
|
void |
BZip2Codec.setConf(Configuration conf)
Set the configuration to be used by this object.
|
void |
SnappyCodec.setConf(Configuration conf)
Set the configuration to be used by this object.
|
void |
DefaultCodec.setConf(Configuration conf) |
| Constructor and Description |
|---|
CompressionCodecFactory(Configuration conf)
Find the codecs specified in the config value io.compression.codecs
and register them.
|
| Modifier and Type | Method and Description |
|---|---|
static int |
Bzip2Factory.getBlockSize(Configuration conf) |
static Compressor |
Bzip2Factory.getBzip2Compressor(Configuration conf)
Return the appropriate implementation of the bzip2 compressor.
|
static Class<? extends Compressor> |
Bzip2Factory.getBzip2CompressorType(Configuration conf)
Return the appropriate type of the bzip2 compressor.
|
static Decompressor |
Bzip2Factory.getBzip2Decompressor(Configuration conf)
Return the appropriate implementation of the bzip2 decompressor.
|
static Class<? extends Decompressor> |
Bzip2Factory.getBzip2DecompressorType(Configuration conf)
Return the appropriate type of the bzip2 decompressor.
|
static int |
Bzip2Factory.getWorkFactor(Configuration conf) |
static boolean |
Bzip2Factory.isNativeBzip2Loaded(Configuration conf)
Check if native-bzip2 code is loaded & initialized correctly and
can be loaded for this job.
|
void |
BZip2DummyCompressor.reinit(Configuration conf) |
void |
Bzip2Compressor.reinit(Configuration conf)
Prepare the compressor to be used in a new stream with settings defined in
the given Configuration.
|
static void |
Bzip2Factory.setBlockSize(Configuration conf,
int blockSize) |
static void |
Bzip2Factory.setWorkFactor(Configuration conf,
int workFactor) |
| Constructor and Description |
|---|
Bzip2Compressor(Configuration conf)
Creates a new compressor, taking settings from the configuration.
|
| Modifier and Type | Method and Description |
|---|---|
void |
Lz4Compressor.reinit(Configuration conf)
Prepare the compressor to be used in a new stream with settings defined in
the given Configuration
|
| Modifier and Type | Method and Description |
|---|---|
void |
SnappyCompressor.reinit(Configuration conf)
Prepare the compressor to be used in a new stream with settings defined in
the given Configuration
|
| Modifier and Type | Method and Description |
|---|---|
static ZlibCompressor.CompressionLevel |
ZlibFactory.getCompressionLevel(Configuration conf) |
static ZlibCompressor.CompressionStrategy |
ZlibFactory.getCompressionStrategy(Configuration conf) |
static Compressor |
ZlibFactory.getZlibCompressor(Configuration conf)
Return the appropriate implementation of the zlib compressor.
|
static Class<? extends Compressor> |
ZlibFactory.getZlibCompressorType(Configuration conf)
Return the appropriate type of the zlib compressor.
|
static Decompressor |
ZlibFactory.getZlibDecompressor(Configuration conf)
Return the appropriate implementation of the zlib decompressor.
|
static Class<? extends Decompressor> |
ZlibFactory.getZlibDecompressorType(Configuration conf)
Return the appropriate type of the zlib decompressor.
|
static boolean |
ZlibFactory.isNativeZlibLoaded(Configuration conf)
Check if native-zlib code is loaded & initialized correctly and
can be loaded for this job.
|
void |
BuiltInZlibDeflater.reinit(Configuration conf)
reinit the compressor with the given configuration.
|
void |
ZlibCompressor.reinit(Configuration conf)
Prepare the compressor to be used in a new stream with settings defined in
the given Configuration.
|
static void |
ZlibFactory.setCompressionLevel(Configuration conf,
ZlibCompressor.CompressionLevel level) |
static void |
ZlibFactory.setCompressionStrategy(Configuration conf,
ZlibCompressor.CompressionStrategy strategy) |
| Constructor and Description |
|---|
ZlibCompressor(Configuration conf)
Creates a new compressor, taking settings from the configuration.
|
| Constructor and Description |
|---|
TFile.Reader(FSDataInputStream fsdis,
long fileLength,
Configuration conf)
Constructor
|
TFile.Writer(FSDataOutputStream fsdos,
int minBlockSize,
String compressName,
String comparator,
Configuration conf)
Constructor
|
| Modifier and Type | Method and Description |
|---|---|
static void |
Server.bind(ServerSocket socket,
InetSocketAddress address,
int backlog,
Configuration conf,
String rangeConf) |
static Object[] |
RPC.call(Method method,
Object[][] params,
InetSocketAddress[] addrs,
Configuration conf)
Deprecated.
|
Object[] |
WritableRpcEngine.call(Method method,
Object[][] params,
InetSocketAddress[] addrs,
org.apache.hadoop.security.UserGroupInformation ticket,
Configuration conf)
Expert: Make multiple, parallel calls to a set of servers.
|
static Object[] |
RPC.call(Method method,
Object[][] params,
InetSocketAddress[] addrs,
org.apache.hadoop.security.UserGroupInformation ticket,
Configuration conf)
Expert: Make multiple, parallel calls to a set of servers.
|
Object[] |
AvroRpcEngine.call(Method method,
Object[][] params,
InetSocketAddress[] addrs,
org.apache.hadoop.security.UserGroupInformation ticket,
Configuration conf) |
Object[] |
RpcEngine.call(Method method,
Object[][] params,
InetSocketAddress[] addrs,
org.apache.hadoop.security.UserGroupInformation ticket,
Configuration conf)
Expert: Make multiple, parallel calls to a set of servers.
|
Writable[] |
Client.call(Writable[] params,
InetSocketAddress[] addresses,
Class<?> protocol,
org.apache.hadoop.security.UserGroupInformation ticket,
Configuration conf)
Makes a set of calls in parallel.
|
Writable |
Client.call(Writable param,
InetSocketAddress addr,
Class<?> protocol,
org.apache.hadoop.security.UserGroupInformation ticket,
int rpcTimeout,
Configuration conf)
Make a call, passing
param, to the IPC server running at
address which is servicing the protocol protocol,
with the ticket credentials, rpcTimeout as
timeout and conf as conf for this connection, returning the
value. |
static <T> ProtocolProxy<T> |
RPC.getProtocolProxy(Class<T> protocol,
long clientVersion,
InetSocketAddress addr,
Configuration conf)
Get a protocol proxy that contains a proxy connection to a remote server
and a set of methods that are supported by the server
|
static <T> ProtocolProxy<T> |
RPC.getProtocolProxy(Class<T> protocol,
long clientVersion,
InetSocketAddress addr,
Configuration conf,
SocketFactory factory)
Get a protocol proxy that contains a proxy connection to a remote server
and a set of methods that are supported by the server
|
static <T> ProtocolProxy<T> |
RPC.getProtocolProxy(Class<T> protocol,
long clientVersion,
InetSocketAddress addr,
org.apache.hadoop.security.UserGroupInformation ticket,
Configuration conf,
SocketFactory factory)
Get a protocol proxy that contains a proxy connection to a remote server
and a set of methods that are supported by the server
|
static <T> ProtocolProxy<T> |
RPC.getProtocolProxy(Class<T> protocol,
long clientVersion,
InetSocketAddress addr,
org.apache.hadoop.security.UserGroupInformation ticket,
Configuration conf,
SocketFactory factory,
int rpcTimeout)
Get a protocol proxy that contains a proxy connection to a remote server
and a set of methods that are supported by the server
|
static <T> T |
RPC.getProxy(Class<T> protocol,
long clientVersion,
InetSocketAddress addr,
Configuration conf)
Construct a client-side proxy object with the default SocketFactory
|
static <T> T |
RPC.getProxy(Class<T> protocol,
long clientVersion,
InetSocketAddress addr,
Configuration conf,
SocketFactory factory)
Construct a client-side proxy object that implements the named protocol,
talking to a server at the named address.
|
static <T> T |
RPC.getProxy(Class<T> protocol,
long clientVersion,
InetSocketAddress addr,
org.apache.hadoop.security.UserGroupInformation ticket,
Configuration conf,
SocketFactory factory)
Construct a client-side proxy object that implements the named protocol,
talking to a server at the named address.
|
<T> ProtocolProxy<T> |
WritableRpcEngine.getProxy(Class<T> protocol,
long clientVersion,
InetSocketAddress addr,
org.apache.hadoop.security.UserGroupInformation ticket,
Configuration conf,
SocketFactory factory,
int rpcTimeout)
Construct a client-side proxy object that implements the named protocol,
talking to a server at the named address.
|
static <T> T |
RPC.getProxy(Class<T> protocol,
long clientVersion,
InetSocketAddress addr,
org.apache.hadoop.security.UserGroupInformation ticket,
Configuration conf,
SocketFactory factory,
int rpcTimeout)
Construct a client-side proxy that implements the named protocol,
talking to a server at the named address.
|
<T> ProtocolProxy<T> |
AvroRpcEngine.getProxy(Class<T> protocol,
long clientVersion,
InetSocketAddress addr,
org.apache.hadoop.security.UserGroupInformation ticket,
Configuration conf,
SocketFactory factory,
int rpcTimeout)
Construct a client-side proxy object that implements the named protocol,
talking to a server at the named address.
|
<T> ProtocolProxy<T> |
RpcEngine.getProxy(Class<T> protocol,
long clientVersion,
InetSocketAddress addr,
org.apache.hadoop.security.UserGroupInformation ticket,
Configuration conf,
SocketFactory factory,
int rpcTimeout)
Construct a client-side proxy object.
|
static RPC.Server |
RPC.getServer(Class<?> protocol,
Object instance,
String bindAddress,
int port,
int numHandlers,
boolean verbose,
Configuration conf,
org.apache.hadoop.security.token.SecretManager<? extends org.apache.hadoop.security.token.TokenIdentifier> secretManager)
Construct a server for a protocol implementation instance.
|
static RPC.Server |
RPC.getServer(Class<?> protocol,
Object instance,
String bindAddress,
int port,
int numHandlers,
boolean verbose,
Configuration conf,
org.apache.hadoop.security.token.SecretManager<? extends org.apache.hadoop.security.token.TokenIdentifier> secretManager,
String portRangeConfig) |
WritableRpcEngine.Server |
WritableRpcEngine.getServer(Class<?> protocol,
Object instance,
String bindAddress,
int port,
int numHandlers,
int numReaders,
int queueSizePerHandler,
boolean verbose,
Configuration conf,
org.apache.hadoop.security.token.SecretManager<? extends org.apache.hadoop.security.token.TokenIdentifier> secretManager)
Construct a server for a protocol implementation instance listening on a
port and address.
|
static RPC.Server |
RPC.getServer(Class<?> protocol,
Object instance,
String bindAddress,
int port,
int numHandlers,
int numReaders,
int queueSizePerHandler,
boolean verbose,
Configuration conf,
org.apache.hadoop.security.token.SecretManager<? extends org.apache.hadoop.security.token.TokenIdentifier> secretManager)
Construct a server for a protocol implementation instance.
|
RPC.Server |
WritableRpcEngine.getServer(Class<?> protocol,
Object instance,
String bindAddress,
int port,
int numHandlers,
int numReaders,
int queueSizePerHandler,
boolean verbose,
Configuration conf,
org.apache.hadoop.security.token.SecretManager<? extends org.apache.hadoop.security.token.TokenIdentifier> secretManager,
String portRangeConfig) |
RPC.Server |
AvroRpcEngine.getServer(Class<?> iface,
Object impl,
String bindAddress,
int port,
int numHandlers,
int numReaders,
int queueSizePerHandler,
boolean verbose,
Configuration conf,
org.apache.hadoop.security.token.SecretManager<? extends org.apache.hadoop.security.token.TokenIdentifier> secretManager,
String portRangeConfig)
Construct a server for a protocol implementation instance listening on a
port and address.
|
RPC.Server |
RpcEngine.getServer(Class<?> protocol,
Object instance,
String bindAddress,
int port,
int numHandlers,
int numReaders,
int queueSizePerHandler,
boolean verbose,
Configuration conf,
org.apache.hadoop.security.token.SecretManager<? extends org.apache.hadoop.security.token.TokenIdentifier> secretManager,
String portRangeConfig)
Construct a server for a protocol implementation instance.
|
static RPC.Server |
RPC.getServer(Class protocol,
Object instance,
String bindAddress,
int port,
Configuration conf)
Construct a server for a protocol implementation instance.
|
static RPC.Server |
RPC.getServer(Class protocol,
Object instance,
String bindAddress,
int port,
int numHandlers,
boolean verbose,
Configuration conf)
Deprecated.
secretManager should be passed.
|
static RPC.Server |
RPC.getServer(Object instance,
String bindAddress,
int port,
Configuration conf)
Deprecated.
protocol interface should be passed.
|
static RPC.Server |
RPC.getServer(Object instance,
String bindAddress,
int port,
int numHandlers,
boolean verbose,
Configuration conf)
Deprecated.
protocol interface should be passed.
|
static int |
Client.getTimeout(Configuration conf)
The time after which a RPC will timeout.
|
void |
Server.refreshServiceAcl(Configuration conf,
org.apache.hadoop.security.authorize.PolicyProvider provider)
Refresh the service authorization ACL for the service handled by this server.
|
static void |
Client.setPingInterval(Configuration conf,
int pingInterval)
set the ping interval value in configuration
|
static void |
RPC.setProtocolEngine(Configuration conf,
Class protocol,
Class engine)
Set a protocol to use a non-default RpcEngine.
|
static <T> ProtocolProxy<T> |
RPC.waitForProtocolProxy(Class<T> protocol,
long clientVersion,
InetSocketAddress addr,
Configuration conf)
Get a protocol proxy that contains a proxy connection to a remote server
and a set of methods that are supported by the server
|
static <T> ProtocolProxy<T> |
RPC.waitForProtocolProxy(Class<T> protocol,
long clientVersion,
InetSocketAddress addr,
Configuration conf,
int rpcTimeout,
long timeout)
Get a protocol proxy that contains a proxy connection to a remote server
and a set of methods that are supported by the server
|
static <T> ProtocolProxy<T> |
RPC.waitForProtocolProxy(Class<T> protocol,
long clientVersion,
InetSocketAddress addr,
Configuration conf,
long connTimeout)
Get a protocol proxy that contains a proxy connection to a remote server
and a set of methods that are supported by the server
|
static <T> T |
RPC.waitForProxy(Class<T> protocol,
long clientVersion,
InetSocketAddress addr,
Configuration conf)
Get a proxy connection to a remote server
|
static <T> T |
RPC.waitForProxy(Class<T> protocol,
long clientVersion,
InetSocketAddress addr,
Configuration conf,
int rpcTimeout,
long timeout)
Get a proxy connection to a remote server
|
static <T> T |
RPC.waitForProxy(Class<T> protocol,
long clientVersion,
InetSocketAddress addr,
Configuration conf,
long connTimeout)
Get a proxy connection to a remote server
|
| Constructor and Description |
|---|
Client(Class<? extends Writable> valueClass,
Configuration conf)
Construct an IPC client with the default SocketFactory
|
Client(Class<? extends Writable> valueClass,
Configuration conf,
SocketFactory factory)
Construct an IPC client whose values are of the given
Writable
class. |
RPC.Server(String bindAddress,
int port,
Class<? extends Writable> paramClass,
int handlerCount,
int numReaders,
int queueSizePerHandler,
Configuration conf,
String serverName,
org.apache.hadoop.security.token.SecretManager<? extends org.apache.hadoop.security.token.TokenIdentifier> secretManager,
String portRangeConfig) |
Server(String bindAddress,
int port,
Class<? extends Writable> paramClass,
int handlerCount,
Configuration conf) |
Server(String bindAddress,
int port,
Class<? extends Writable> rpcRequestClass,
int handlerCount,
int numReaders,
int queueSizePerHandler,
Configuration conf,
String serverName,
org.apache.hadoop.security.token.SecretManager<? extends org.apache.hadoop.security.token.TokenIdentifier> secretManager) |
Server(String bindAddress,
int port,
Class<? extends Writable> paramClass,
int handlerCount,
int numReaders,
int queueSizePerHandler,
Configuration conf,
String serverName,
org.apache.hadoop.security.token.SecretManager<? extends org.apache.hadoop.security.token.TokenIdentifier> secretManager,
String portRangeConfig)
Constructs a server listening on the named port and address.
|
WritableRpcEngine.Server(Object instance,
Configuration conf,
String bindAddress,
int port)
Construct an RPC server.
|
WritableRpcEngine.Server(Object instance,
Configuration conf,
String bindAddress,
int port,
int numHandlers,
int numReaders,
int queueSizePerHandler,
boolean verbose,
org.apache.hadoop.security.token.SecretManager<? extends org.apache.hadoop.security.token.TokenIdentifier> secretManager)
Construct an RPC server.
|
WritableRpcEngine.Server(Object instance,
Configuration conf,
String bindAddress,
int port,
int numHandlers,
int numReaders,
int queueSizePerHandler,
boolean verbose,
org.apache.hadoop.security.token.SecretManager<? extends org.apache.hadoop.security.token.TokenIdentifier> secretManager,
String portRangeConfig) |
| Modifier and Type | Method and Description |
|---|---|
Configuration |
SocksSocketFactory.getConf() |
Configuration |
AbstractDNSToSwitchMapping.getConf() |
Configuration |
ScriptBasedMapping.getConf() |
| Modifier and Type | Method and Description |
|---|---|
void |
SocksSocketFactory.setConf(Configuration conf) |
void |
AbstractDNSToSwitchMapping.setConf(Configuration conf) |
void |
ScriptBasedMapping.setConf(Configuration conf)
Set the configuration to be used by this object.
|
| Constructor and Description |
|---|
AbstractDNSToSwitchMapping(Configuration conf)
Create an instance, caching the configuration file.
|
ScriptBasedMapping(Configuration conf)
Create an instance from the given configuration
|
| Modifier and Type | Method and Description |
|---|---|
org.apache.hadoop.security.KerberosInfo |
AnnotatedSecurityInfo.getKerberosInfo(Class<?> protocol,
Configuration conf) |
org.apache.hadoop.security.token.TokenInfo |
AnnotatedSecurityInfo.getTokenInfo(Class<?> protocol,
Configuration conf) |
void |
AuthenticationFilterInitializer.initFilter(FilterContainer container,
Configuration conf)
Initializes hadoop-auth AuthenticationFilter.
|
| Modifier and Type | Method and Description |
|---|---|
protected abstract InetSocketAddress |
GetGroupsBase.getProtocolAddress(Configuration conf)
Must be overridden by subclasses to get the address where the
GetUserMappingsProtocol implementation is running. |
| Constructor and Description |
|---|
GetGroupsBase(Configuration conf)
Create an instance of this tool using the given configuration.
|
GetGroupsBase(Configuration conf,
PrintStream out)
Used exclusively for testing.
|
| Modifier and Type | Method and Description |
|---|---|
static <T> T |
ReflectionUtils.copy(Configuration conf,
T src,
T dst)
Make a copy of the writable object using serialization to a buffer
|
static <T> T |
ReflectionUtils.newInstance(Class<T> theClass,
Configuration conf)
Create an object for the given class and initialize it from conf
|
static int |
ToolRunner.run(Configuration conf,
Tool tool,
String[] args)
Runs the given
Tool by Tool.run(String[]), after
parsing with the given generic arguments. |
static void |
ReflectionUtils.setConf(Object theObject,
Configuration conf)
Check and set 'configuration' if necessary.
|
Copyright © 2013 Apache Software Foundation. All Rights Reserved.