public static class InputSampler.RandomSampler<K,V> extends InputSampler.RandomSampler<K,V> implements InputSampler.Sampler<K,V>
freq, maxSplitsSampled, numSamples
Constructor and Description |
---|
InputSampler.RandomSampler(double freq,
int numSamples)
Create a new RandomSampler sampling all splits.
|
InputSampler.RandomSampler(double freq,
int numSamples,
int maxSplitsSampled)
Create a new RandomSampler.
|
Modifier and Type | Method and Description |
---|---|
K[] |
getSample(InputFormat<K,V> inf,
JobConf job)
Randomize the split order, then take the specified number of keys from
each split sampled, where each key is selected with the specified
probability and possibly replaced by a subsequently selected key when
the quota of keys from that split is satisfied.
|
getSample
clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait
getSample
public InputSampler.RandomSampler(double freq, int numSamples)
freq
- Probability with which a key will be chosen.numSamples
- Total number of samples to obtain from all selected
splits.public InputSampler.RandomSampler(double freq, int numSamples, int maxSplitsSampled)
freq
- Probability with which a key will be chosen.numSamples
- Total number of samples to obtain from all selected
splits.maxSplitsSampled
- The maximum number of splits to examine.public K[] getSample(InputFormat<K,V> inf, JobConf job) throws IOException
IOException
Copyright © 2016 Apache Software Foundation. All Rights Reserved.