org.apache.flink.hadoopcompatibility.mapred

类 HadoopReduceCombineFunction<KEYIN,VALUEIN,KEYOUT,VALUEOUT>

java.lang.Object

org.apache.flink.api.common.functions.AbstractRichFunction

org.apache.flink.api.common.functions.RichGroupReduceFunction<org.apache.flink.api.java.tuple.Tuple2<KEYIN,VALUEIN>,org.apache.flink.api.java.tuple.Tuple2<KEYOUT,VALUEOUT>>

org.apache.flink.hadoopcompatibility.mapred.HadoopReduceCombineFunction<KEYIN,VALUEIN,KEYOUT,VALUEOUT>

所有已实现的接口:

Serializable, org.apache.flink.api.common.functions.Function, org.apache.flink.api.common.functions.GroupCombineFunction<org.apache.flink.api.java.tuple.Tuple2<KEYIN,VALUEIN>,org.apache.flink.api.java.tuple.Tuple2<KEYIN,VALUEIN>>, org.apache.flink.api.common.functions.GroupReduceFunction<org.apache.flink.api.java.tuple.Tuple2<KEYIN,VALUEIN>,org.apache.flink.api.java.tuple.Tuple2<KEYOUT,VALUEOUT>>, org.apache.flink.api.common.functions.RichFunction, org.apache.flink.api.java.typeutils.ResultTypeQueryable<org.apache.flink.api.java.tuple.Tuple2<KEYOUT,VALUEOUT>>

@Public
public final class HadoopReduceCombineFunction<KEYIN,VALUEIN,KEYOUT,VALUEOUT>
extends org.apache.flink.api.common.functions.RichGroupReduceFunction<org.apache.flink.api.java.tuple.Tuple2<KEYIN,VALUEIN>,org.apache.flink.api.java.tuple.Tuple2<KEYOUT,VALUEOUT>>
implements org.apache.flink.api.common.functions.GroupCombineFunction<org.apache.flink.api.java.tuple.Tuple2<KEYIN,VALUEIN>,org.apache.flink.api.java.tuple.Tuple2<KEYIN,VALUEIN>>, org.apache.flink.api.java.typeutils.ResultTypeQueryable<org.apache.flink.api.java.tuple.Tuple2<KEYOUT,VALUEOUT>>, Serializable

This wrapper maps a Hadoop Reducer and Combiner (mapred API) to a combinable Flink GroupReduceFunction.

另请参阅:

序列化表格

构造器概要

构造器

构造器和说明
HadoopReduceCombineFunction(org.apache.hadoop.mapred.Reducer<KEYIN,VALUEIN,KEYOUT,VALUEOUT> hadoopReducer, org.apache.hadoop.mapred.Reducer<KEYIN,VALUEIN,KEYIN,VALUEIN> hadoopCombiner) Maps two Hadoop Reducer (mapred API) to a combinable Flink GroupReduceFunction.
HadoopReduceCombineFunction(org.apache.hadoop.mapred.Reducer<KEYIN,VALUEIN,KEYOUT,VALUEOUT> hadoopReducer, org.apache.hadoop.mapred.Reducer<KEYIN,VALUEIN,KEYIN,VALUEIN> hadoopCombiner, org.apache.hadoop.mapred.JobConf conf) Maps two Hadoop Reducer (mapred API) to a combinable Flink GroupReduceFunction.

方法概要

限定符和类型	方法和说明
void	combine(Iterable<org.apache.flink.api.java.tuple.Tuple2<KEYIN,VALUEIN>> values, org.apache.flink.util.Collector<org.apache.flink.api.java.tuple.Tuple2<KEYIN,VALUEIN>> out)
org.apache.flink.api.common.typeinfo.TypeInformation<org.apache.flink.api.java.tuple.Tuple2<KEYOUT,VALUEOUT>>	getProducedType()
void	open(org.apache.flink.configuration.Configuration parameters)
void	reduce(Iterable<org.apache.flink.api.java.tuple.Tuple2<KEYIN,VALUEIN>> values, org.apache.flink.util.Collector<org.apache.flink.api.java.tuple.Tuple2<KEYOUT,VALUEOUT>> out)

从类继承的方法 org.apache.flink.api.common.functions.AbstractRichFunction

close, getIterationRuntimeContext, getRuntimeContext, setRuntimeContext

从类继承的方法 java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

构造器详细资料

HadoopReduceCombineFunction

public HadoopReduceCombineFunction(org.apache.hadoop.mapred.Reducer<KEYIN,VALUEIN,KEYOUT,VALUEOUT> hadoopReducer,
                                   org.apache.hadoop.mapred.Reducer<KEYIN,VALUEIN,KEYIN,VALUEIN> hadoopCombiner)

Maps two Hadoop Reducer (mapred API) to a combinable Flink GroupReduceFunction.

参数:

hadoopReducer - The Hadoop Reducer that is mapped to a GroupReduceFunction.

hadoopCombiner - The Hadoop Reducer that is mapped to the combiner function.

HadoopReduceCombineFunction

public HadoopReduceCombineFunction(org.apache.hadoop.mapred.Reducer<KEYIN,VALUEIN,KEYOUT,VALUEOUT> hadoopReducer,
                                   org.apache.hadoop.mapred.Reducer<KEYIN,VALUEIN,KEYIN,VALUEIN> hadoopCombiner,
                                   org.apache.hadoop.mapred.JobConf conf)

Maps two Hadoop Reducer (mapred API) to a combinable Flink GroupReduceFunction.

参数:

hadoopReducer - The Hadoop Reducer that is mapped to a GroupReduceFunction.

hadoopCombiner - The Hadoop Reducer that is mapped to the combiner function.

conf - The JobConf that is used to configure both Hadoop Reducers.

方法详细资料

open

public void open(org.apache.flink.configuration.Configuration parameters)
          throws Exception

指定者:

open 在接口中 org.apache.flink.api.common.functions.RichFunction

覆盖:

open 在类中 org.apache.flink.api.common.functions.AbstractRichFunction

抛出:

Exception

reduce

public void reduce(Iterable<org.apache.flink.api.java.tuple.Tuple2<KEYIN,VALUEIN>> values,
                   org.apache.flink.util.Collector<org.apache.flink.api.java.tuple.Tuple2<KEYOUT,VALUEOUT>> out)
            throws Exception

指定者:

reduce 在接口中 org.apache.flink.api.common.functions.GroupReduceFunction<org.apache.flink.api.java.tuple.Tuple2<KEYIN,VALUEIN>,org.apache.flink.api.java.tuple.Tuple2<KEYOUT,VALUEOUT>>

指定者:

reduce 在类中 org.apache.flink.api.common.functions.RichGroupReduceFunction<org.apache.flink.api.java.tuple.Tuple2<KEYIN,VALUEIN>,org.apache.flink.api.java.tuple.Tuple2<KEYOUT,VALUEOUT>>

抛出:

Exception

combine

public void combine(Iterable<org.apache.flink.api.java.tuple.Tuple2<KEYIN,VALUEIN>> values,
                    org.apache.flink.util.Collector<org.apache.flink.api.java.tuple.Tuple2<KEYIN,VALUEIN>> out)
             throws Exception

指定者:

combine 在接口中 org.apache.flink.api.common.functions.GroupCombineFunction<org.apache.flink.api.java.tuple.Tuple2<KEYIN,VALUEIN>,org.apache.flink.api.java.tuple.Tuple2<KEYIN,VALUEIN>>

抛出:

Exception

getProducedType

public org.apache.flink.api.common.typeinfo.TypeInformation<org.apache.flink.api.java.tuple.Tuple2<KEYOUT,VALUEOUT>> getProducedType()

指定者:

getProducedType 在接口中 org.apache.flink.api.java.typeutils.ResultTypeQueryable<org.apache.flink.api.java.tuple.Tuple2<KEYOUT,VALUEOUT>>