org.apache.flink.api.java.io

Class PrimitiveInputFormat<OT>

java.lang.Object

org.apache.flink.api.common.io.RichInputFormat<OT,org.apache.flink.core.fs.FileInputSplit>

org.apache.flink.api.common.io.FileInputFormat<OT>

org.apache.flink.api.common.io.DelimitedInputFormat<OT>

org.apache.flink.api.java.io.PrimitiveInputFormat<OT>

All Implemented Interfaces:

Serializable, org.apache.flink.api.common.io.CheckpointableInputFormat<org.apache.flink.core.fs.FileInputSplit,Long>, org.apache.flink.api.common.io.InputFormat<OT,org.apache.flink.core.fs.FileInputSplit>, org.apache.flink.core.io.InputSplitSource<org.apache.flink.core.fs.FileInputSplit>

@PublicEvolving
public class PrimitiveInputFormat<OT>
extends org.apache.flink.api.common.io.DelimitedInputFormat<OT>

An input format that reads single field primitive data from a given file. The difference between this and CsvInputFormat is that it won't go through Tuple1.

See Also:

Serialized Form

Nested Class Summary

Nested classes/interfaces inherited from class org.apache.flink.api.common.io.FileInputFormat

org.apache.flink.api.common.io.FileInputFormat.FileBaseStatistics, org.apache.flink.api.common.io.FileInputFormat.InputSplitOpenThread

Field Summary

Fields inherited from class org.apache.flink.api.common.io.DelimitedInputFormat

currBuffer, currLen, currOffset, RECORD_DELIMITER

Fields inherited from class org.apache.flink.api.common.io.FileInputFormat

currentSplit, ENUMERATE_NESTED_FILES_FLAG, enumerateNestedFiles, filePath, INFLATER_INPUT_STREAM_FACTORIES, minSplitSize, numSplits, openTimeout, READ_WHOLE_SPLIT_FLAG, splitLength, splitStart, stream, unsplittable

Constructor Summary

Constructors

Constructor and Description
PrimitiveInputFormat(org.apache.flink.core.fs.Path filePath, Class<OT> primitiveClass)
PrimitiveInputFormat(org.apache.flink.core.fs.Path filePath, String delimiter, Class<OT> primitiveClass)

Method Summary

Modifier and Type	Method and Description
protected void	initializeSplit(org.apache.flink.core.fs.FileInputSplit split, Long offset)
OT	readRecord(OT reuse, byte[] bytes, int offset, int numBytes)

Methods inherited from class org.apache.flink.api.common.io.DelimitedInputFormat

close, configure, getBufferSize, getCharset, getCurrentState, getDelimiter, getLineLengthLimit, getNumLineSamples, getStatistics, loadConfigParameters, loadGlobalConfigParams, nextRecord, open, reachedEnd, readLine, reopen, setBufferSize, setCharset, setDelimiter, setDelimiter, setDelimiter, setLineLengthLimit, setNumLineSamples

Methods inherited from class org.apache.flink.api.common.io.FileInputFormat

acceptFile, createInputSplits, decorateInputStream, extractFileExtension, getFilePath, getFilePaths, getFileStats, getFileStats, getInflaterInputStreamFactory, getInputSplitAssigner, getMinSplitSize, getNestedFileEnumeration, getNumSplits, getOpenTimeout, getSplitLength, getSplitStart, registerInflaterInputStreamFactory, setFilePath, setFilePath, setFilePaths, setFilePaths, setFilesFilter, setMinSplitSize, setNestedFileEnumeration, setNumSplits, setOpenTimeout, supportsMultiPaths, testForUnsplittable, toString

Methods inherited from class org.apache.flink.api.common.io.RichInputFormat

closeInputFormat, getRuntimeContext, openInputFormat, setRuntimeContext

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, wait, wait, wait

Constructor Detail

PrimitiveInputFormat

public PrimitiveInputFormat(org.apache.flink.core.fs.Path filePath,
                            Class<OT> primitiveClass)

PrimitiveInputFormat

public PrimitiveInputFormat(org.apache.flink.core.fs.Path filePath,
                            String delimiter,
                            Class<OT> primitiveClass)

Method Detail

initializeSplit

protected void initializeSplit(org.apache.flink.core.fs.FileInputSplit split,
                               Long offset)
                        throws IOException

Overrides:

initializeSplit in class org.apache.flink.api.common.io.DelimitedInputFormat<OT>

Throws:

IOException

readRecord

public OT readRecord(OT reuse,
                     byte[] bytes,
                     int offset,
                     int numBytes)
              throws IOException

Specified by:

readRecord in class org.apache.flink.api.common.io.DelimitedInputFormat<OT>

Throws:

IOException