org.apache.flink.api.java.io

Class TupleCsvInputFormat<OUT>

java.lang.Object

org.apache.flink.api.common.io.RichInputFormat<OT,org.apache.flink.core.fs.FileInputSplit>

org.apache.flink.api.common.io.FileInputFormat<OT>

org.apache.flink.api.common.io.DelimitedInputFormat<OT>

org.apache.flink.api.common.io.GenericCsvInputFormat<OUT>

org.apache.flink.api.java.io.CsvInputFormat<OUT>

org.apache.flink.api.java.io.TupleCsvInputFormat<OUT>

All Implemented Interfaces:

Serializable, org.apache.flink.api.common.io.CheckpointableInputFormat<org.apache.flink.core.fs.FileInputSplit,Long>, org.apache.flink.api.common.io.InputFormat<OUT,org.apache.flink.core.fs.FileInputSplit>, org.apache.flink.core.io.InputSplitSource<org.apache.flink.core.fs.FileInputSplit>

@Internal
public class TupleCsvInputFormat<OUT>
extends CsvInputFormat<OUT>

Input format that reads csv into tuples.

See Also:

Serialized Form

Nested Class Summary

Nested classes/interfaces inherited from class org.apache.flink.api.common.io.FileInputFormat

org.apache.flink.api.common.io.FileInputFormat.FileBaseStatistics, org.apache.flink.api.common.io.FileInputFormat.InputSplitOpenThread

Field Summary

Fields inherited from class org.apache.flink.api.java.io.CsvInputFormat

DEFAULT_FIELD_DELIMITER, DEFAULT_LINE_DELIMITER, parsedValues

Fields inherited from class org.apache.flink.api.common.io.GenericCsvInputFormat

commentCount, commentPrefix, fieldIncluded, invalidLineCount, lineDelimiterIsLinebreak

Fields inherited from class org.apache.flink.api.common.io.DelimitedInputFormat

currBuffer, currLen, currOffset, RECORD_DELIMITER

Fields inherited from class org.apache.flink.api.common.io.FileInputFormat

currentSplit, ENUMERATE_NESTED_FILES_FLAG, enumerateNestedFiles, filePath, INFLATER_INPUT_STREAM_FACTORIES, minSplitSize, numSplits, openTimeout, READ_WHOLE_SPLIT_FLAG, splitLength, splitStart, stream, unsplittable

Constructor Summary

Constructors

Constructor and Description
TupleCsvInputFormat(org.apache.flink.core.fs.Path filePath, String lineDelimiter, String fieldDelimiter, org.apache.flink.api.java.typeutils.TupleTypeInfoBase<OUT> tupleTypeInfo)
TupleCsvInputFormat(org.apache.flink.core.fs.Path filePath, String lineDelimiter, String fieldDelimiter, org.apache.flink.api.java.typeutils.TupleTypeInfoBase<OUT> tupleTypeInfo, boolean[] includedFieldsMask)
TupleCsvInputFormat(org.apache.flink.core.fs.Path filePath, String lineDelimiter, String fieldDelimiter, org.apache.flink.api.java.typeutils.TupleTypeInfoBase<OUT> tupleTypeInfo, int[] includedFieldsMask)
TupleCsvInputFormat(org.apache.flink.core.fs.Path filePath, org.apache.flink.api.java.typeutils.TupleTypeInfoBase<OUT> tupleTypeInfo)
TupleCsvInputFormat(org.apache.flink.core.fs.Path filePath, org.apache.flink.api.java.typeutils.TupleTypeInfoBase<OUT> tupleTypeInfo, boolean[] includedFieldsMask)
TupleCsvInputFormat(org.apache.flink.core.fs.Path filePath, org.apache.flink.api.java.typeutils.TupleTypeInfoBase<OUT> tupleTypeInfo, int[] includedFieldsMask)

Method Summary

Modifier and Type	Method and Description
OUT	fillRecord(OUT reuse, Object[] parsedValues)

Methods inherited from class org.apache.flink.api.java.io.CsvInputFormat

createDefaultMask, getFieldTypes, initializeSplit, nextRecord, readRecord, toBooleanMask, toString

Methods inherited from class org.apache.flink.api.common.io.GenericCsvInputFormat

checkAndCoSort, checkForMonotonousOrder, close, enableQuotedStringParsing, getCommentPrefix, getFieldDelimiter, getFieldParsers, getGenericFieldTypes, getNumberOfFieldsTotal, getNumberOfNonNullFields, isLenient, isSkippingFirstLineAsHeader, parseRecord, setCharset, setCommentPrefix, setFieldDelimiter, setFieldsGeneric, setFieldsGeneric, setFieldTypesGeneric, setLenient, setSkipFirstLineAsHeader, skipFields, supportsMultiPaths

Methods inherited from class org.apache.flink.api.common.io.DelimitedInputFormat

configure, getBufferSize, getCharset, getCurrentState, getDelimiter, getLineLengthLimit, getNumLineSamples, getStatistics, loadConfigParameters, loadGlobalConfigParams, open, reachedEnd, readLine, reopen, setBufferSize, setDelimiter, setDelimiter, setDelimiter, setLineLengthLimit, setNumLineSamples

Methods inherited from class org.apache.flink.api.common.io.FileInputFormat

acceptFile, createInputSplits, decorateInputStream, extractFileExtension, getFilePath, getFilePaths, getFileStats, getFileStats, getInflaterInputStreamFactory, getInputSplitAssigner, getMinSplitSize, getNestedFileEnumeration, getNumSplits, getOpenTimeout, getSplitLength, getSplitStart, registerInflaterInputStreamFactory, setFilePath, setFilePath, setFilePaths, setFilePaths, setFilesFilter, setMinSplitSize, setNestedFileEnumeration, setNumSplits, setOpenTimeout, testForUnsplittable

Methods inherited from class org.apache.flink.api.common.io.RichInputFormat

closeInputFormat, getRuntimeContext, openInputFormat, setRuntimeContext

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, wait, wait, wait

Constructor Detail

TupleCsvInputFormat

public TupleCsvInputFormat(org.apache.flink.core.fs.Path filePath,
                           org.apache.flink.api.java.typeutils.TupleTypeInfoBase<OUT> tupleTypeInfo)

TupleCsvInputFormat

public TupleCsvInputFormat(org.apache.flink.core.fs.Path filePath,
                           String lineDelimiter,
                           String fieldDelimiter,
                           org.apache.flink.api.java.typeutils.TupleTypeInfoBase<OUT> tupleTypeInfo)

TupleCsvInputFormat

public TupleCsvInputFormat(org.apache.flink.core.fs.Path filePath,
                           org.apache.flink.api.java.typeutils.TupleTypeInfoBase<OUT> tupleTypeInfo,
                           int[] includedFieldsMask)

TupleCsvInputFormat

public TupleCsvInputFormat(org.apache.flink.core.fs.Path filePath,
                           String lineDelimiter,
                           String fieldDelimiter,
                           org.apache.flink.api.java.typeutils.TupleTypeInfoBase<OUT> tupleTypeInfo,
                           int[] includedFieldsMask)

TupleCsvInputFormat

public TupleCsvInputFormat(org.apache.flink.core.fs.Path filePath,
                           org.apache.flink.api.java.typeutils.TupleTypeInfoBase<OUT> tupleTypeInfo,
                           boolean[] includedFieldsMask)

TupleCsvInputFormat

public TupleCsvInputFormat(org.apache.flink.core.fs.Path filePath,
                           String lineDelimiter,
                           String fieldDelimiter,
                           org.apache.flink.api.java.typeutils.TupleTypeInfoBase<OUT> tupleTypeInfo,
                           boolean[] includedFieldsMask)

Method Detail

fillRecord

public OUT fillRecord(OUT reuse,
                      Object[] parsedValues)

Specified by:

fillRecord in class CsvInputFormat<OUT>