org.apache.hadoop.mapred

Class SequenceFileInputFilter.PercentFilter

java.lang.Object

org.apache.hadoop.mapreduce.lib.input.SequenceFileInputFilter.FilterBase

org.apache.hadoop.mapred.SequenceFileInputFilter.FilterBase

org.apache.hadoop.mapred.SequenceFileInputFilter.PercentFilter

All Implemented Interfaces:

org.apache.hadoop.conf.Configurable, SequenceFileInputFilter.Filter

Enclosing class:

SequenceFileInputFilter<K,V>

public static class SequenceFileInputFilter.PercentFilter
extends SequenceFileInputFilter.FilterBase

This class returns a percentage of records The percentage is determined by a filtering frequency f using the criteria record# % f == 0. For example, if the frequency is 10, one out of 10 records is returned.

Constructor Summary

Constructors

Constructor and Description
SequenceFileInputFilter.PercentFilter()

Method Summary

Methods

Modifier and Type	Method and Description
boolean	accept(Object key) Filtering method If record# % frequency==0, return true; otherwise return false
void	setConf(org.apache.hadoop.conf.Configuration conf) configure the filter by checking the configuration
static void	setFrequency(org.apache.hadoop.conf.Configuration conf, int frequency) set the frequency and stores it in conf

Methods inherited from class org.apache.hadoop.mapreduce.lib.input.SequenceFileInputFilter.FilterBase

getConf

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Methods inherited from interface org.apache.hadoop.conf.Configurable

getConf

Constructor Detail

SequenceFileInputFilter.PercentFilter

public SequenceFileInputFilter.PercentFilter()

Method Detail

setFrequency

public static void setFrequency(org.apache.hadoop.conf.Configuration conf,
                int frequency)

set the frequency and stores it in conf

Parameters:

conf - configuration

frequency - filtering frequencey

setConf

public void setConf(org.apache.hadoop.conf.Configuration conf)

configure the filter by checking the configuration

Parameters:

conf - configuration

accept

public boolean accept(Object key)

Filtering method If record# % frequency==0, return true; otherwise return false

Parameters:

key - record key

Returns:

true if a record is accepted; return false otherwise

See Also:

SequenceFileInputFilter.Filter.accept(Object)