public final class MRJobConfUtil extends Object
Modifier and Type | Field and Description |
---|---|
static double |
PROGRESS_MIN_DELTA_FACTOR
Configurations to control the frequency of logging of task Attempt.
|
static String |
REDACTION_REPLACEMENT_VAL |
static float |
TASK_REPORT_INTERVAL_TO_TIMEOUT_RATIO |
Modifier and Type | Method and Description |
---|---|
static double |
convertTaskProgressToFactor(float progress)
Coverts a progress between 0.0 to 1.0 to double format used to log the
task attempt.
|
static double |
getTaskProgressMinDeltaThreshold()
Retrieves the min delta progress required to log the task attempt current
progress.
|
static long |
getTaskProgressReportInterval(org.apache.hadoop.conf.Configuration conf)
Get the progress heartbeat interval configuration for mapreduce tasks.
|
static long |
getTaskProgressWaitDeltaTimeThreshold()
Retrieves the min time required to log the task attempt current
progress.
|
static void |
redact(org.apache.hadoop.conf.Configuration conf)
Redact job configuration properties.
|
static void |
setTaskLogProgressDeltaThresholds(org.apache.hadoop.conf.Configuration conf)
load the values defined from a configuration file including the delta
progress and the maximum time between each log message.
|
public static final String REDACTION_REPLACEMENT_VAL
public static final float TASK_REPORT_INTERVAL_TO_TIMEOUT_RATIO
public static final double PROGRESS_MIN_DELTA_FACTOR
public static void redact(org.apache.hadoop.conf.Configuration conf)
conf
- the job configuration to redactpublic static long getTaskProgressReportInterval(org.apache.hadoop.conf.Configuration conf)
conf
- the job configuration to read frompublic static void setTaskLogProgressDeltaThresholds(org.apache.hadoop.conf.Configuration conf)
conf
- public static double getTaskProgressMinDeltaThreshold()
setTaskLogProgressDeltaThresholds(org.apache.hadoop.conf.Configuration)
has not been called.public static long getTaskProgressWaitDeltaTimeThreshold()
setTaskLogProgressDeltaThresholds(org.apache.hadoop.conf.Configuration)
has not been called.public static double convertTaskProgressToFactor(float progress)
progress
- of the task which is a value between 0.0 and 1.0.PROGRESS_MIN_DELTA_FACTOR
.Copyright © 2020 Apache Software Foundation. All rights reserved.