public static class InputSampler.IntervalSampler<K,V> extends InputSampler.IntervalSampler<K,V> implements InputSampler.Sampler<K,V>
freq, maxSplitsSampled
Constructor and Description |
---|
IntervalSampler(double freq)
Create a new IntervalSampler sampling all splits.
|
IntervalSampler(double freq,
int maxSplitsSampled)
Create a new IntervalSampler.
|
Modifier and Type | Method and Description |
---|---|
K[] |
getSample(InputFormat<K,V> inf,
JobConf job)
For each split sampled, emit when the ratio of the number of records
retained to the total record count is less than the specified
frequency.
|
getSample
clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait
getSample
public IntervalSampler(double freq)
freq
- The frequency with which records will be emitted.public IntervalSampler(double freq, int maxSplitsSampled)
freq
- The frequency with which records will be emitted.maxSplitsSampled
- The maximum number of splits to examine.getSample(org.apache.hadoop.mapred.InputFormat<K, V>, org.apache.hadoop.mapred.JobConf)
public K[] getSample(InputFormat<K,V> inf, JobConf job) throws IOException
IOException
Copyright © 2017 Apache Software Foundation. All Rights Reserved.