org.apache.flink.hadoopcompatibility.mapred

Class HadoopReduceFunction<KEYIN,VALUEIN,KEYOUT,VALUEOUT>

java.lang.Object

org.apache.flink.api.common.functions.AbstractRichFunction

org.apache.flink.api.common.functions.RichGroupReduceFunction<org.apache.flink.api.java.tuple.Tuple2<KEYIN,VALUEIN>,org.apache.flink.api.java.tuple.Tuple2<KEYOUT,VALUEOUT>>

org.apache.flink.hadoopcompatibility.mapred.HadoopReduceFunction<KEYIN,VALUEIN,KEYOUT,VALUEOUT>

All Implemented Interfaces:

Serializable, org.apache.flink.api.common.functions.Function, org.apache.flink.api.common.functions.GroupReduceFunction<org.apache.flink.api.java.tuple.Tuple2<KEYIN,VALUEIN>,org.apache.flink.api.java.tuple.Tuple2<KEYOUT,VALUEOUT>>, org.apache.flink.api.common.functions.RichFunction, org.apache.flink.api.java.typeutils.ResultTypeQueryable<org.apache.flink.api.java.tuple.Tuple2<KEYOUT,VALUEOUT>>

@Public
public final class HadoopReduceFunction<KEYIN,VALUEIN,KEYOUT,VALUEOUT>
extends org.apache.flink.api.common.functions.RichGroupReduceFunction<org.apache.flink.api.java.tuple.Tuple2<KEYIN,VALUEIN>,org.apache.flink.api.java.tuple.Tuple2<KEYOUT,VALUEOUT>>
implements org.apache.flink.api.java.typeutils.ResultTypeQueryable<org.apache.flink.api.java.tuple.Tuple2<KEYOUT,VALUEOUT>>, Serializable

This wrapper maps a Hadoop Reducer (mapred API) to a non-combinable Flink GroupReduceFunction.

See Also:

Serialized Form

Constructor Summary

Constructors

Constructor and Description
HadoopReduceFunction(org.apache.hadoop.mapred.Reducer<KEYIN,VALUEIN,KEYOUT,VALUEOUT> hadoopReducer) Maps a Hadoop Reducer (mapred API) to a non-combinable Flink GroupReduceFunction.
HadoopReduceFunction(org.apache.hadoop.mapred.Reducer<KEYIN,VALUEIN,KEYOUT,VALUEOUT> hadoopReducer, org.apache.hadoop.mapred.JobConf conf) Maps a Hadoop Reducer (mapred API) to a non-combinable Flink GroupReduceFunction.

Method Summary

Methods

Modifier and Type	Method and Description
org.apache.flink.api.common.typeinfo.TypeInformation<org.apache.flink.api.java.tuple.Tuple2<KEYOUT,VALUEOUT>>	getProducedType()
void	open(org.apache.flink.configuration.Configuration parameters)
void	reduce(Iterable<org.apache.flink.api.java.tuple.Tuple2<KEYIN,VALUEIN>> values, org.apache.flink.util.Collector<org.apache.flink.api.java.tuple.Tuple2<KEYOUT,VALUEOUT>> out)

Methods inherited from class org.apache.flink.api.common.functions.AbstractRichFunction

close, getIterationRuntimeContext, getRuntimeContext, setRuntimeContext

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Detail

HadoopReduceFunction

public HadoopReduceFunction(org.apache.hadoop.mapred.Reducer<KEYIN,VALUEIN,KEYOUT,VALUEOUT> hadoopReducer)

Maps a Hadoop Reducer (mapred API) to a non-combinable Flink GroupReduceFunction.

Parameters:

hadoopReducer - The Hadoop Reducer to wrap.

HadoopReduceFunction

public HadoopReduceFunction(org.apache.hadoop.mapred.Reducer<KEYIN,VALUEIN,KEYOUT,VALUEOUT> hadoopReducer,
                    org.apache.hadoop.mapred.JobConf conf)

Maps a Hadoop Reducer (mapred API) to a non-combinable Flink GroupReduceFunction.

Parameters:

hadoopReducer - The Hadoop Reducer to wrap.

conf - The JobConf that is used to configure the Hadoop Reducer.

Method Detail

open

public void open(org.apache.flink.configuration.Configuration parameters)
          throws Exception

Specified by:

open in interface org.apache.flink.api.common.functions.RichFunction

Overrides:

open in class org.apache.flink.api.common.functions.AbstractRichFunction

Throws:

Exception

reduce

public void reduce(Iterable<org.apache.flink.api.java.tuple.Tuple2<KEYIN,VALUEIN>> values,
          org.apache.flink.util.Collector<org.apache.flink.api.java.tuple.Tuple2<KEYOUT,VALUEOUT>> out)
            throws Exception

Specified by:

reduce in interface org.apache.flink.api.common.functions.GroupReduceFunction<org.apache.flink.api.java.tuple.Tuple2<KEYIN,VALUEIN>,org.apache.flink.api.java.tuple.Tuple2<KEYOUT,VALUEOUT>>

Specified by:

reduce in class org.apache.flink.api.common.functions.RichGroupReduceFunction<org.apache.flink.api.java.tuple.Tuple2<KEYIN,VALUEIN>,org.apache.flink.api.java.tuple.Tuple2<KEYOUT,VALUEOUT>>

Throws:

Exception

getProducedType

public org.apache.flink.api.common.typeinfo.TypeInformation<org.apache.flink.api.java.tuple.Tuple2<KEYOUT,VALUEOUT>> getProducedType()

Specified by:

getProducedType in interface org.apache.flink.api.java.typeutils.ResultTypeQueryable<org.apache.flink.api.java.tuple.Tuple2<KEYOUT,VALUEOUT>>