org.apache.flink.api.java.io

Class CsvInputFormat<OUT>

java.lang.Object

org.apache.flink.api.common.io.RichInputFormat<OT,org.apache.flink.core.fs.FileInputSplit>

org.apache.flink.api.common.io.FileInputFormat<OT>

org.apache.flink.api.common.io.DelimitedInputFormat<OT>

org.apache.flink.api.common.io.GenericCsvInputFormat<OUT>

org.apache.flink.api.java.io.CommonCsvInputFormat<OUT>

org.apache.flink.api.java.io.CsvInputFormat<OUT>

All Implemented Interfaces:

Serializable, org.apache.flink.api.common.io.InputFormat<OUT,org.apache.flink.core.fs.FileInputSplit>, org.apache.flink.core.io.InputSplitSource<org.apache.flink.core.fs.FileInputSplit>

public class CsvInputFormat<OUT>
extends CommonCsvInputFormat<OUT>

See Also:

Serialized Form

Nested Class Summary

Nested classes/interfaces inherited from class org.apache.flink.api.common.io.DelimitedInputFormat

org.apache.flink.api.common.io.DelimitedInputFormat.AbstractConfigBuilder<T>, org.apache.flink.api.common.io.DelimitedInputFormat.ConfigBuilder

Nested classes/interfaces inherited from class org.apache.flink.api.common.io.FileInputFormat

org.apache.flink.api.common.io.FileInputFormat.FileBaseStatistics, org.apache.flink.api.common.io.FileInputFormat.InputSplitOpenThread

Field Summary

Fields inherited from class org.apache.flink.api.java.io.CommonCsvInputFormat

DEFAULT_FIELD_DELIMITER, DEFAULT_LINE_DELIMITER, parsedValues

Fields inherited from class org.apache.flink.api.common.io.GenericCsvInputFormat

commentCount, commentPrefix, fieldIncluded, invalidLineCount, lineDelimiterIsLinebreak

Fields inherited from class org.apache.flink.api.common.io.DelimitedInputFormat

RECORD_DELIMITER

Fields inherited from class org.apache.flink.api.common.io.FileInputFormat

currentSplit, ENUMERATE_NESTED_FILES_FLAG, enumerateNestedFiles, filePath, INFLATER_INPUT_STREAM_FACTORIES, minSplitSize, numSplits, openTimeout, READ_WHOLE_SPLIT_FLAG, splitLength, splitStart, stream, unsplittable

Constructor Summary

Constructors

Constructor and Description
CsvInputFormat(org.apache.flink.core.fs.Path filePath, org.apache.flink.api.common.typeutils.CompositeType<OUT> typeInformation)
CsvInputFormat(org.apache.flink.core.fs.Path filePath, String lineDelimiter, String fieldDelimiter, org.apache.flink.api.common.typeutils.CompositeType<OUT> typeInformation)

Method Summary

Modifier and Type	Method and Description
protected OUT	createTuple(OUT reuse)
String	toString()

Methods inherited from class org.apache.flink.api.java.io.CommonCsvInputFormat

getFieldTypes, nextRecord, open, readRecord, setFields, setFields, setFieldTypes, setOrderOfPOJOFields

Methods inherited from class org.apache.flink.api.common.io.GenericCsvInputFormat

checkAndCoSort, checkForMonotonousOrder, close, enableQuotedStringParsing, getCommentPrefix, getFieldDelimiter, getFieldParsers, getGenericFieldTypes, getNumberOfFieldsTotal, getNumberOfNonNullFields, isLenient, isSkippingFirstLineAsHeader, parseRecord, setCommentPrefix, setCommentPrefix, setCommentPrefix, setCommentPrefix, setCommentPrefix, setFieldDelimiter, setFieldDelimiter, setFieldDelimiter, setFieldsGeneric, setFieldsGeneric, setFieldTypesGeneric, setLenient, setSkipFirstLineAsHeader, skipFields

Methods inherited from class org.apache.flink.api.common.io.DelimitedInputFormat

configure, configureDelimitedFormat, getBufferSize, getDelimiter, getLineLengthLimit, getNumLineSamples, getStatistics, loadGloablConfigParams, reachedEnd, readLine, setBufferSize, setDelimiter, setDelimiter, setDelimiter, setLineLengthLimit, setNumLineSamples

Methods inherited from class org.apache.flink.api.common.io.FileInputFormat

acceptFile, configureFileFormat, createInputSplits, decorateInputStream, extractFileExtension, getFilePath, getFileStats, getInflaterInputStreamFactory, getInputSplitAssigner, getMinSplitSize, getNumSplits, getOpenTimeout, getSplitLength, getSplitStart, registerInflaterInputStreamFactory, setFilePath, setFilePath, setMinSplitSize, setNumSplits, setOpenTimeout, testForUnsplittable

Methods inherited from class org.apache.flink.api.common.io.RichInputFormat

getRuntimeContext, setRuntimeContext

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, wait, wait, wait

Constructor Detail

CsvInputFormat

public CsvInputFormat(org.apache.flink.core.fs.Path filePath,
                      org.apache.flink.api.common.typeutils.CompositeType<OUT> typeInformation)

CsvInputFormat

public CsvInputFormat(org.apache.flink.core.fs.Path filePath,
                      String lineDelimiter,
                      String fieldDelimiter,
                      org.apache.flink.api.common.typeutils.CompositeType<OUT> typeInformation)

Method Detail

createTuple

protected OUT createTuple(OUT reuse)

Specified by:

createTuple in class CommonCsvInputFormat<OUT>

toString

public String toString()

Overrides:

toString in class org.apache.flink.api.common.io.FileInputFormat<OUT>