org.apache.flink.api.java.io

Class RowCsvInputFormat

java.lang.Object

org.apache.flink.api.common.io.RichInputFormat<OT,FileInputSplit>

org.apache.flink.api.common.io.FileInputFormat<OT>

org.apache.flink.api.common.io.DelimitedInputFormat<OT>

org.apache.flink.api.common.io.GenericCsvInputFormat<OUT>

org.apache.flink.api.java.io.CsvInputFormat<Row>

org.apache.flink.api.java.io.RowCsvInputFormat

All Implemented Interfaces:

Serializable, CheckpointableInputFormat<FileInputSplit,Long>, InputFormat<Row,FileInputSplit>, ResultTypeQueryable<Row>, InputSplitSource<FileInputSplit>

@PublicEvolving
public class RowCsvInputFormat
extends CsvInputFormat<Row>
implements ResultTypeQueryable<Row>

See Also:

Serialized Form

Nested Class Summary

Nested classes/interfaces inherited from class org.apache.flink.api.common.io.FileInputFormat

FileInputFormat.FileBaseStatistics, FileInputFormat.InputSplitOpenThread

Field Summary

Fields inherited from class org.apache.flink.api.java.io.CsvInputFormat

DEFAULT_FIELD_DELIMITER, DEFAULT_LINE_DELIMITER, parsedValues

Fields inherited from class org.apache.flink.api.common.io.GenericCsvInputFormat

commentCount, commentPrefix, fieldIncluded, invalidLineCount, lineDelimiterIsLinebreak

Fields inherited from class org.apache.flink.api.common.io.DelimitedInputFormat

RECORD_DELIMITER

Fields inherited from class org.apache.flink.api.common.io.FileInputFormat

currentSplit, ENUMERATE_NESTED_FILES_FLAG, enumerateNestedFiles, filePath, INFLATER_INPUT_STREAM_FACTORIES, minSplitSize, numSplits, openTimeout, READ_WHOLE_SPLIT_FLAG, splitLength, splitStart, stream, unsplittable

Constructor Summary

Constructors

Constructor and Description
RowCsvInputFormat(Path filePath, TypeInformation[] fieldTypes)
RowCsvInputFormat(Path filePath, TypeInformation[] fieldTypes, boolean emptyColumnAsNull)
RowCsvInputFormat(Path filePath, TypeInformation[] fieldTypes, int[] selectedFields)
RowCsvInputFormat(Path filePath, TypeInformation[] fieldTypes, String lineDelimiter, String fieldDelimiter)
RowCsvInputFormat(Path filePath, TypeInformation[] fieldTypes, String lineDelimiter, String fieldDelimiter, int[] selectedFields)
RowCsvInputFormat(Path filePath, TypeInformation[] fieldTypeInfos, String lineDelimiter, String fieldDelimiter, int[] selectedFields, boolean emptyColumnAsNull)

Method Summary

Methods

Modifier and Type	Method and Description
protected Row	fillRecord(Row reuse, Object[] parsedValues)
TypeInformation<Row>	getProducedType()
protected boolean	parseRecord(Object[] holders, byte[] bytes, int offset, int numBytes)

Methods inherited from class org.apache.flink.api.java.io.CsvInputFormat

createDefaultMask, getFieldTypes, nextRecord, open, readRecord, toBooleanMask, toString

Methods inherited from class org.apache.flink.api.common.io.GenericCsvInputFormat

checkAndCoSort, checkForMonotonousOrder, close, enableQuotedStringParsing, getCommentPrefix, getFieldDelimiter, getFieldParsers, getGenericFieldTypes, getNumberOfFieldsTotal, getNumberOfNonNullFields, isLenient, isSkippingFirstLineAsHeader, setCharset, setCommentPrefix, setFieldDelimiter, setFieldsGeneric, setFieldsGeneric, setFieldTypesGeneric, setLenient, setSkipFirstLineAsHeader, skipFields

Methods inherited from class org.apache.flink.api.common.io.DelimitedInputFormat

configure, getBufferSize, getCharset, getCurrentState, getDelimiter, getLineLengthLimit, getNumLineSamples, getStatistics, loadConfigParameters, loadGlobalConfigParams, reachedEnd, readLine, reopen, setBufferSize, setDelimiter, setDelimiter, setDelimiter, setLineLengthLimit, setNumLineSamples

Methods inherited from class org.apache.flink.api.common.io.FileInputFormat

acceptFile, createInputSplits, decorateInputStream, extractFileExtension, getFilePath, getFileStats, getInflaterInputStreamFactory, getInputSplitAssigner, getMinSplitSize, getNestedFileEnumeration, getNumSplits, getOpenTimeout, getSplitLength, getSplitStart, registerInflaterInputStreamFactory, setFilePath, setFilePath, setFilesFilter, setMinSplitSize, setNestedFileEnumeration, setNumSplits, setOpenTimeout, testForUnsplittable

Methods inherited from class org.apache.flink.api.common.io.RichInputFormat

closeInputFormat, getRuntimeContext, openInputFormat, setRuntimeContext

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, wait, wait, wait

Constructor Detail

RowCsvInputFormat

public RowCsvInputFormat(Path filePath,
                 TypeInformation[] fieldTypeInfos,
                 String lineDelimiter,
                 String fieldDelimiter,
                 int[] selectedFields,
                 boolean emptyColumnAsNull)

RowCsvInputFormat

public RowCsvInputFormat(Path filePath,
                 TypeInformation[] fieldTypes,
                 String lineDelimiter,
                 String fieldDelimiter,
                 int[] selectedFields)

RowCsvInputFormat

public RowCsvInputFormat(Path filePath,
                 TypeInformation[] fieldTypes,
                 String lineDelimiter,
                 String fieldDelimiter)

RowCsvInputFormat

public RowCsvInputFormat(Path filePath,
                 TypeInformation[] fieldTypes,
                 int[] selectedFields)

RowCsvInputFormat

public RowCsvInputFormat(Path filePath,
                 TypeInformation[] fieldTypes,
                 boolean emptyColumnAsNull)

RowCsvInputFormat

public RowCsvInputFormat(Path filePath,
                 TypeInformation[] fieldTypes)

Method Detail

fillRecord

protected Row fillRecord(Row reuse,
             Object[] parsedValues)

Specified by:

fillRecord in class CsvInputFormat<Row>

parseRecord

protected boolean parseRecord(Object[] holders,
                  byte[] bytes,
                  int offset,
                  int numBytes)
                       throws ParseException

Overrides:

parseRecord in class GenericCsvInputFormat<Row>

Throws:

ParseException

getProducedType

public TypeInformation<Row> getProducedType()

Specified by:

getProducedType in interface ResultTypeQueryable<Row>