public enum HadoopJobProperty extends Enum<HadoopJobProperty>
Enum Constant and Description |
---|
COMBINER_HASHMAP_SIZE
Initial size for hashmap which stores output of mapper and will be used as input of combiner.
|
EXTERNAL_CONCURRENT_MAPPERS
Specifies number of concurrently running mappers for external execution mode.
|
EXTERNAL_CONCURRENT_REDUCERS
Specifies number of concurrently running reducers for external execution mode.
|
JOB_PARTIALLY_RAW_COMPARATOR
Fully qualified name of partially raw comparator which should be used on sorting phase.
|
JOB_SHARED_CLASSLOADER
Whether job classloader can be shared between all tasks.
|
JOB_STATUS_POLL_DELAY
Delay in milliseconds after which Ignite server will reply job status.
|
PARTITION_HASHMAP_SIZE
Initial size for hashmap which stores output of mapper or combiner and will be used as input of reducer.
|
SHUFFLE_COMBINER_NO_SORTING
If set to
true then input for combiner will not be sorted by key. |
SHUFFLE_JOB_THROTTLE
Shuffle job throttle in milliseconds.
|
SHUFFLE_MAPPER_STRIPED_OUTPUT
Whether to stripe mapper output for remote reducers.
|
SHUFFLE_MSG_GZIP
Whether shuffle message should be compressed with GZIP.
|
SHUFFLE_MSG_SIZE
Defines approximate size in bytes of shuffle message which will be passed over wire from mapper to reducer.
|
SHUFFLE_OFFHEAP_PAGE_SIZE
Size in bytes of single memory page which will be allocated for data structures in shuffle.
|
SHUFFLE_REDUCER_NO_SORTING
If set to
true then input for reducer will not be sorted by key. |
Modifier and Type | Method and Description |
---|---|
static boolean |
get(HadoopJobInfo jobInfo,
HadoopJobProperty pty,
boolean dflt) |
static int |
get(HadoopJobInfo jobInfo,
HadoopJobProperty pty,
int dflt) |
static String |
get(HadoopJobInfo jobInfo,
HadoopJobProperty pty,
String dflt) |
String |
propertyName() |
static HadoopJobProperty |
valueOf(String name)
Returns the enum constant of this type with the specified name.
|
static HadoopJobProperty[] |
values()
Returns an array containing the constants of this enum type, in
the order they are declared.
|
public static final HadoopJobProperty COMBINER_HASHMAP_SIZE
Setting it right allows to avoid rehashing.
public static final HadoopJobProperty PARTITION_HASHMAP_SIZE
Setting it right allows to avoid rehashing.
public static final HadoopJobProperty EXTERNAL_CONCURRENT_MAPPERS
If not specified, defaults to Runtime.getRuntime().availableProcessors()
.
public static final HadoopJobProperty EXTERNAL_CONCURRENT_REDUCERS
If not specified, defaults to Runtime.getRuntime().availableProcessors()
.
public static final HadoopJobProperty JOB_STATUS_POLL_DELAY
public static final HadoopJobProperty JOB_SHARED_CLASSLOADER
Defaults to true
.
public static final HadoopJobProperty JOB_PARTIALLY_RAW_COMPARATOR
public static final HadoopJobProperty SHUFFLE_OFFHEAP_PAGE_SIZE
Defaults to 1Mb
.
public static final HadoopJobProperty SHUFFLE_COMBINER_NO_SORTING
true
then input for combiner will not be sorted by key.
Internally hash-map will be used instead of sorted one, so Object.equals(Object)
and Object.hashCode()
methods of key must be implemented consistently with
comparator for that type. Grouping comparator is not supported if this setting is true
.
By default is false
.
public static final HadoopJobProperty SHUFFLE_REDUCER_NO_SORTING
true
then input for reducer will not be sorted by key.
Internally hash-map will be used instead of sorted one, so Object.equals(Object)
and Object.hashCode()
methods of key must be implemented consistently with
comparator for that type. Grouping comparator is not supported if this setting is true
.
By default is false
.
public static final HadoopJobProperty SHUFFLE_MSG_SIZE
Defaults to 1Mb
.
public static final HadoopJobProperty SHUFFLE_MSG_GZIP
Defaults to false
.
public static final HadoopJobProperty SHUFFLE_MAPPER_STRIPED_OUTPUT
Defaults to true
.
public static final HadoopJobProperty SHUFFLE_JOB_THROTTLE
Defaults to 0
.
public static HadoopJobProperty[] values()
for (HadoopJobProperty c : HadoopJobProperty.values()) System.out.println(c);
public static HadoopJobProperty valueOf(String name)
name
- the name of the enum constant to be returned.IllegalArgumentException
- if this enum type has no constant with the specified nameNullPointerException
- if the argument is nullpublic String propertyName()
public static String get(HadoopJobInfo jobInfo, HadoopJobProperty pty, @Nullable String dflt)
jobInfo
- Job info.pty
- Property.dflt
- Default value.public static int get(HadoopJobInfo jobInfo, HadoopJobProperty pty, int dflt)
jobInfo
- Job info.pty
- Property.dflt
- Default value.public static boolean get(HadoopJobInfo jobInfo, HadoopJobProperty pty, boolean dflt)
jobInfo
- Job info.pty
- Property.dflt
- Default value.
Follow @ApacheIgnite
Ignite Fabric : ver. 2.0.0 Release Date : April 30 2017