Fairly portable method for getting the Hadoop classpath in the current environment.
Fairly portable method for getting the Hadoop classpath in the current environment.
It assumes that the 'hadoop' command is available and calls 'hadoop classpath', parses
the result, and returns a resolved list of URL's (including wildcard/glob-style patterns,
see com.hindog.grid.ClasspathUtils
for more info).
Load Hadoop configuration using one of two methods:
Load Hadoop configuration using one of two methods:
1) If HADOOP_CONF_DIR is set, load all (or specified) resource files from that folder.
-- otherwise --
2) Use Hadoop classpath obtained from hadoop classpath
command. By default, we'll
load core-site.xml
, hdfs-site.xml
, mapred-site.xml
and yarn-site.xml
files we find on the classpath.
Load Hadoop configuration using all files ending with ".xml" in HADOOP_CONF_DIR