org.apache.flink.hadoopcompatibility

类 HadoopInputs

java.lang.Object

org.apache.flink.hadoopcompatibility.HadoopInputs

public final class HadoopInputs
extends Object

HadoopInputs is a utility class to use Apache Hadoop InputFormats with Apache Flink.

It provides methods to create Flink InputFormat wrappers for Hadoop InputFormat and InputFormat.

Key value pairs produced by the Hadoop InputFormats are converted into Flink Tuple2 objects where the first field (Tuple2.f0) is the key and the second field (Tuple2.f1) is the value.

构造器概要

构造器

构造器和说明
HadoopInputs()

方法概要

限定符和类型	方法和说明
static <K,V> HadoopInputFormat<K,V>	createHadoopInput(org.apache.hadoop.mapreduce.InputFormat<K,V> mapreduceInputFormat, Class<K> key, Class<V> value, org.apache.hadoop.mapreduce.Job job) Creates a Flink InputFormat that wraps the given Hadoop InputFormat.
static <K,V> HadoopInputFormat<K,V>	createHadoopInput(org.apache.hadoop.mapred.InputFormat<K,V> mapredInputFormat, Class<K> key, Class<V> value, org.apache.hadoop.mapred.JobConf job) Creates a Flink InputFormat that wraps the given Hadoop InputFormat.
static <K,V> HadoopInputFormat<K,V>	readHadoopFile(org.apache.hadoop.mapred.FileInputFormat<K,V> mapredInputFormat, Class<K> key, Class<V> value, String inputPath) Creates a Flink InputFormat that wraps the given Hadoop FileInputFormat.
static <K,V> HadoopInputFormat<K,V>	readHadoopFile(org.apache.hadoop.mapreduce.lib.input.FileInputFormat<K,V> mapreduceInputFormat, Class<K> key, Class<V> value, String inputPath) Creates a Flink InputFormat that wraps the given Hadoop FileInputFormat.
static <K,V> HadoopInputFormat<K,V>	readHadoopFile(org.apache.hadoop.mapreduce.lib.input.FileInputFormat<K,V> mapreduceInputFormat, Class<K> key, Class<V> value, String inputPath, org.apache.hadoop.mapreduce.Job job) Creates a Flink InputFormat that wraps the given Hadoop FileInputFormat.
static <K,V> HadoopInputFormat<K,V>	readHadoopFile(org.apache.hadoop.mapred.FileInputFormat<K,V> mapredInputFormat, Class<K> key, Class<V> value, String inputPath, org.apache.hadoop.mapred.JobConf job) Creates a Flink InputFormat that wraps the given Hadoop FileInputFormat.
static <K,V> HadoopInputFormat<K,V>	readSequenceFile(Class<K> key, Class<V> value, String inputPath) Creates a Flink InputFormat to read a Hadoop sequence file for the given key and value classes.

从类继承的方法 java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

构造器详细资料

HadoopInputs

public HadoopInputs()

方法详细资料

readHadoopFile

public static <K,V> HadoopInputFormat<K,V> readHadoopFile(org.apache.hadoop.mapred.FileInputFormat<K,V> mapredInputFormat,
                                                          Class<K> key,
                                                          Class<V> value,
                                                          String inputPath,
                                                          org.apache.hadoop.mapred.JobConf job)

Creates a Flink InputFormat that wraps the given Hadoop FileInputFormat.

返回:

A Flink InputFormat that wraps the Hadoop FileInputFormat.

readHadoopFile

public static <K,V> HadoopInputFormat<K,V> readHadoopFile(org.apache.hadoop.mapred.FileInputFormat<K,V> mapredInputFormat,
                                                          Class<K> key,
                                                          Class<V> value,
                                                          String inputPath)

Creates a Flink InputFormat that wraps the given Hadoop FileInputFormat.

返回:

A Flink InputFormat that wraps the Hadoop FileInputFormat.

readSequenceFile

public static <K,V> HadoopInputFormat<K,V> readSequenceFile(Class<K> key,
                                                            Class<V> value,
                                                            String inputPath)
                                                     throws IOException

Creates a Flink InputFormat to read a Hadoop sequence file for the given key and value classes.

返回:

A Flink InputFormat that wraps a Hadoop SequenceFileInputFormat.

抛出:

IOException

createHadoopInput

public static <K,V> HadoopInputFormat<K,V> createHadoopInput(org.apache.hadoop.mapred.InputFormat<K,V> mapredInputFormat,
                                                             Class<K> key,
                                                             Class<V> value,
                                                             org.apache.hadoop.mapred.JobConf job)

Creates a Flink InputFormat that wraps the given Hadoop InputFormat.

返回:

A Flink InputFormat that wraps the Hadoop InputFormat.

readHadoopFile

public static <K,V> HadoopInputFormat<K,V> readHadoopFile(org.apache.hadoop.mapreduce.lib.input.FileInputFormat<K,V> mapreduceInputFormat,
                                                          Class<K> key,
                                                          Class<V> value,
                                                          String inputPath,
                                                          org.apache.hadoop.mapreduce.Job job)
                                                   throws IOException

Creates a Flink InputFormat that wraps the given Hadoop FileInputFormat.

返回:

A Flink InputFormat that wraps the Hadoop FileInputFormat.

抛出:

IOException

readHadoopFile

public static <K,V> HadoopInputFormat<K,V> readHadoopFile(org.apache.hadoop.mapreduce.lib.input.FileInputFormat<K,V> mapreduceInputFormat,
                                                          Class<K> key,
                                                          Class<V> value,
                                                          String inputPath)
                                                   throws IOException

Creates a Flink InputFormat that wraps the given Hadoop FileInputFormat.

返回:

A Flink InputFormat that wraps the Hadoop FileInputFormat.

抛出:

IOException

createHadoopInput

public static <K,V> HadoopInputFormat<K,V> createHadoopInput(org.apache.hadoop.mapreduce.InputFormat<K,V> mapreduceInputFormat,
                                                             Class<K> key,
                                                             Class<V> value,
                                                             org.apache.hadoop.mapreduce.Job job)

Creates a Flink InputFormat that wraps the given Hadoop InputFormat.

返回:

A Flink InputFormat that wraps the Hadoop InputFormat.