kafka.etl.impl
Class SimpleKafkaETLMapper

java.lang.Object
  kafka.etl.impl.SimpleKafkaETLMapper

All Implemented Interfaces:

java.io.Closeable, org.apache.hadoop.mapred.JobConfigurable, org.apache.hadoop.mapred.Mapper<KafkaETLKey,org.apache.hadoop.io.BytesWritable,org.apache.hadoop.io.LongWritable,org.apache.hadoop.io.Text>

public class SimpleKafkaETLMapper
extends java.lang.Object
implements org.apache.hadoop.mapred.Mapper<KafkaETLKey,org.apache.hadoop.io.BytesWritable,org.apache.hadoop.io.LongWritable,org.apache.hadoop.io.Text>

Simple implementation of KafkaETLMapper. It assumes that input data are text timestamp (long).

Field Summary

protected long

_count

Constructor Summary

SimpleKafkaETLMapper()

Method Summary

void	close()
void	configure(org.apache.hadoop.mapred.JobConf arg0)
protected org.apache.hadoop.io.Text	getData(kafka.message.Message message)
void	map(KafkaETLKey key, org.apache.hadoop.io.BytesWritable val, org.apache.hadoop.mapred.OutputCollector<org.apache.hadoop.io.LongWritable,org.apache.hadoop.io.Text> collector, org.apache.hadoop.mapred.Reporter reporter)

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Field Detail

_count

protected long _count

Constructor Detail

SimpleKafkaETLMapper

public SimpleKafkaETLMapper()

Method Detail

getData

protected org.apache.hadoop.io.Text getData(kafka.message.Message message)
                                     throws java.io.IOException

Throws:

java.io.IOException

map

public void map(KafkaETLKey key,
                org.apache.hadoop.io.BytesWritable val,
                org.apache.hadoop.mapred.OutputCollector<org.apache.hadoop.io.LongWritable,org.apache.hadoop.io.Text> collector,
                org.apache.hadoop.mapred.Reporter reporter)
         throws java.io.IOException

Specified by:

map in interface org.apache.hadoop.mapred.Mapper<KafkaETLKey,org.apache.hadoop.io.BytesWritable,org.apache.hadoop.io.LongWritable,org.apache.hadoop.io.Text>

Throws:

java.io.IOException

configure

public void configure(org.apache.hadoop.mapred.JobConf arg0)

Specified by:

configure in interface org.apache.hadoop.mapred.JobConfigurable

close

public void close()
           throws java.io.IOException

Specified by:

close in interface java.io.Closeable

Throws:

java.io.IOException