org.apache.accumulo.core.client.mapreduce.lib.partition

Class KeyRangePartitioner

java.lang.Object

org.apache.hadoop.mapreduce.Partitioner<Key,org.apache.hadoop.io.Writable>

org.apache.accumulo.core.client.mapreduce.lib.partition.KeyRangePartitioner

All Implemented Interfaces:

org.apache.hadoop.conf.Configurable

public class KeyRangePartitioner
extends org.apache.hadoop.mapreduce.Partitioner<Key,org.apache.hadoop.io.Writable>
implements org.apache.hadoop.conf.Configurable

Hadoop partitioner that uses ranges based on row keys, and optionally sub-bins based on hashing.

Constructor Summary

Constructors

Constructor and Description
KeyRangePartitioner()

Method Summary

Methods

Modifier and Type	Method and Description
org.apache.hadoop.conf.Configuration	getConf()
int	getPartition(Key key, org.apache.hadoop.io.Writable value, int numPartitions)
void	setConf(org.apache.hadoop.conf.Configuration conf)
static void	setNumSubBins(org.apache.hadoop.mapreduce.JobContext job, int num) Sets the number of random sub-bins per range
static void	setSplitFile(org.apache.hadoop.mapreduce.JobContext job, String file) Sets the hdfs file name to use, containing a newline separated list of Base64 encoded split points that represent ranges for partitioning

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Detail

KeyRangePartitioner

public KeyRangePartitioner()

Method Detail

getPartition

public int getPartition(Key key,
               org.apache.hadoop.io.Writable value,
               int numPartitions)

Specified by:

getPartition in class org.apache.hadoop.mapreduce.Partitioner<Key,org.apache.hadoop.io.Writable>

getConf

public org.apache.hadoop.conf.Configuration getConf()

Specified by:

getConf in interface org.apache.hadoop.conf.Configurable

setConf

public void setConf(org.apache.hadoop.conf.Configuration conf)

Specified by:

setConf in interface org.apache.hadoop.conf.Configurable

setSplitFile

public static void setSplitFile(org.apache.hadoop.mapreduce.JobContext job,
                String file)

Sets the hdfs file name to use, containing a newline separated list of Base64 encoded split points that represent ranges for partitioning

setNumSubBins

public static void setNumSubBins(org.apache.hadoop.mapreduce.JobContext job,
                 int num)

Sets the number of random sub-bins per range