com.google.cloud.hadoop.io.bigquery.samples

Class WordCount.Map

java.lang.Object

org.apache.hadoop.mapreduce.Mapper<org.apache.hadoop.io.LongWritable,com.google.gson.JsonObject,org.apache.hadoop.io.Text,org.apache.hadoop.io.LongWritable>

com.google.cloud.hadoop.io.bigquery.samples.WordCount.Map

Enclosing class:

WordCount

public static class WordCount.Map
extends org.apache.hadoop.mapreduce.Mapper<org.apache.hadoop.io.LongWritable,com.google.gson.JsonObject,org.apache.hadoop.io.Text,org.apache.hadoop.io.LongWritable>

Mapper function for the WordCount job. For input, it consumes a LongWritable and JsonObject as the key and value. These correspond to a row identifier and Json representation of the row's values/columns. For output, it produces Text and a LongWritable as the key and value. These correspond to the word and a count for the number of times it has occurred.

Nested Class Summary

Nested classes/interfaces inherited from class org.apache.hadoop.mapreduce.Mapper

org.apache.hadoop.mapreduce.Mapper.Context

Constructor Summary

Constructors

Constructor and Description
Map()

Method Summary

Modifier and Type	Method and Description
void	map(org.apache.hadoop.io.LongWritable key, com.google.gson.JsonObject value, org.apache.hadoop.mapreduce.Mapper.Context context)
void	setup(org.apache.hadoop.mapreduce.Mapper.Context context)

Methods inherited from class org.apache.hadoop.mapreduce.Mapper

cleanup, run

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Detail

Map

public Map()

Method Detail

setup

public void setup(org.apache.hadoop.mapreduce.Mapper.Context context)
           throws IOException,
                  InterruptedException

Overrides:

setup in class org.apache.hadoop.mapreduce.Mapper<org.apache.hadoop.io.LongWritable,com.google.gson.JsonObject,org.apache.hadoop.io.Text,org.apache.hadoop.io.LongWritable>

Throws:

IOException

InterruptedException

map

public void map(org.apache.hadoop.io.LongWritable key,
                com.google.gson.JsonObject value,
                org.apache.hadoop.mapreduce.Mapper.Context context)
         throws IOException,
                InterruptedException

Overrides:

map in class org.apache.hadoop.mapreduce.Mapper<org.apache.hadoop.io.LongWritable,com.google.gson.JsonObject,org.apache.hadoop.io.Text,org.apache.hadoop.io.LongWritable>

Throws:

IOException

InterruptedException