org.deeplearning4j.datasets.fetchers

Class CSVDataFetcher

java.lang.Object

org.deeplearning4j.datasets.fetchers.BaseDataFetcher

org.deeplearning4j.datasets.fetchers.CSVDataFetcher

All Implemented Interfaces:

Serializable, DataSetFetcher

public class CSVDataFetcher
extends BaseDataFetcher

CSV record based data fetcher

Author:

Adam Gibson

See Also:

Serialized Form

Field Summary

Fields inherited from class org.deeplearning4j.datasets.fetchers.BaseDataFetcher

curr, cursor, inputColumns, log, numOutcomes, totalExamples

Constructor Summary

Constructors

Constructor and Description
CSVDataFetcher(File f, int labelColumn) Constructs a csv data fetcher with the specified label column skipping no lines
CSVDataFetcher(File f, int labelColumn, int skipLines) Constructs a csv data fetcher with the specified number of lines to skip
CSVDataFetcher(InputStream is, int labelColumn) Constructs a csv data fetcher with the specified label column skipping no lines
CSVDataFetcher(InputStream is, int labelColumn, int skipLines) Constructs a csv data fetcher with the specified number of lines to skip

Method Summary

Modifier and Type	Method and Description
void	fetch(int numExamples) Fetches the next dataset.

Methods inherited from class org.deeplearning4j.datasets.fetchers.BaseDataFetcher

createInputMatrix, createOutputMatrix, createOutputVector, cursor, hasMore, initializeCurrFromList, inputColumns, next, reset, totalExamples, totalOutcomes

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Detail

CSVDataFetcher

public CSVDataFetcher(InputStream is,
                      int labelColumn)

Constructs a csv data fetcher with the specified label column skipping no lines

Parameters:

is - the input stream to read from

labelColumn - the index of the column (0 based)

CSVDataFetcher

public CSVDataFetcher(File f,
                      int labelColumn)
               throws IOException

Constructs a csv data fetcher with the specified label column skipping no lines

Parameters:

f - the file to read from

labelColumn - the index of the column (0 based)

Throws:

IOException

CSVDataFetcher

public CSVDataFetcher(InputStream is,
                      int labelColumn,
                      int skipLines)

Constructs a csv data fetcher with the specified number of lines to skip

Parameters:

is - the input stream to read from

labelColumn - the index of the column (0 based)

skipLines - the number of lines to skip

CSVDataFetcher

public CSVDataFetcher(File f,
                      int labelColumn,
                      int skipLines)
               throws IOException

Constructs a csv data fetcher with the specified number of lines to skip

Parameters:

f - the file to read from

labelColumn - the index of the column (0 based)

skipLines - the number of lines to skip

Throws:

IOException

Method Detail

fetch

public void fetch(int numExamples)

Fetches the next dataset. You need to call this to getFromOrigin a new dataset, otherwise BaseDataFetcher.next() just returns the last data applyTransformToDestination fetch

Parameters:

numExamples - the number of examples to fetch