org.apache.flink.api.java.hadoop.common

Class HadoopInputFormatCommonBase<T,SPITTYPE extends org.apache.flink.core.io.InputSplit>

java.lang.Object

org.apache.flink.api.common.io.RichInputFormat<T,SPITTYPE>

org.apache.flink.api.java.hadoop.common.HadoopInputFormatCommonBase<T,SPITTYPE>

All Implemented Interfaces:

Serializable, org.apache.flink.api.common.io.InputFormat<T,SPITTYPE>, org.apache.flink.core.io.InputSplitSource<SPITTYPE>

Direct Known Subclasses:

HadoopInputFormatBase, HadoopInputFormatBase

@Internal
public abstract class HadoopInputFormatCommonBase<T,SPITTYPE extends org.apache.flink.core.io.InputSplit>
extends org.apache.flink.api.common.io.RichInputFormat<T,SPITTYPE>

A common base for both "mapred" and "mapreduce" Hadoop input formats.

See Also:

Serialized Form

Field Summary

Fields

Modifier and Type	Field and Description
protected org.apache.hadoop.security.Credentials	credentials

Constructor Summary

Constructors

Modifier	Constructor and Description
protected	HadoopInputFormatCommonBase(org.apache.hadoop.security.Credentials creds)

Method Summary

Modifier and Type	Method and Description
static org.apache.hadoop.security.Credentials	getCredentialsFromUGI(org.apache.hadoop.security.UserGroupInformation ugi) This method only exists because there is no UserGroupInformation.getCredentials() method in Hadoop 1.x
void	read(ObjectInputStream in)
protected void	write(ObjectOutputStream out)

Methods inherited from class org.apache.flink.api.common.io.RichInputFormat

closeInputFormat, getRuntimeContext, openInputFormat, setRuntimeContext

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Methods inherited from interface org.apache.flink.api.common.io.InputFormat

close, configure, createInputSplits, getInputSplitAssigner, getStatistics, nextRecord, open, reachedEnd

Field Detail

credentials

protected transient org.apache.hadoop.security.Credentials credentials

Constructor Detail

HadoopInputFormatCommonBase

protected HadoopInputFormatCommonBase(org.apache.hadoop.security.Credentials creds)

Method Detail

write

protected void write(ObjectOutputStream out)
              throws IOException

Throws:

IOException

read

public void read(ObjectInputStream in)
          throws IOException

Throws:

IOException

getCredentialsFromUGI

public static org.apache.hadoop.security.Credentials getCredentialsFromUGI(org.apache.hadoop.security.UserGroupInformation ugi)

This method only exists because there is no UserGroupInformation.getCredentials() method in Hadoop 1.x

Note that this method returns "null" in Hadoop 1.x environments.

Parameters:

ugi - The user information

Returns:

new credentials object from the user information. MAY RETURN NULL!