org.deeplearning4j.datasets.iterator.parallel

Class JointParallelDataSetIterator

java.lang.Object

org.deeplearning4j.datasets.iterator.parallel.BaseParallelDataSetIterator

org.deeplearning4j.datasets.iterator.parallel.JointParallelDataSetIterator

All Implemented Interfaces:

Serializable, Iterator<org.nd4j.linalg.dataset.DataSet>, org.nd4j.linalg.dataset.api.iterator.DataSetIterator, org.nd4j.linalg.dataset.api.iterator.ParallelDataSetIterator

public class JointParallelDataSetIterator
extends BaseParallelDataSetIterator

Author:

[email protected]

See Also:

Serialized Form

Nested Class Summary

Nested Classes

Modifier and Type	Class and Description
static class	JointParallelDataSetIterator.Builder

Field Summary

Fields

Modifier and Type	Field and Description
protected List<org.nd4j.linalg.dataset.api.iterator.DataSetIterator>	asyncIterators
protected int	bufferSizePerDevice
protected boolean	enforceSingleDevice

Fields inherited from class org.deeplearning4j.datasets.iterator.parallel.BaseParallelDataSetIterator

allDepleted, counter, inequalityHandling, numProducers, producerAffinity, resetTracker, states

Constructor Summary

Constructors

Constructor and Description
JointParallelDataSetIterator(List<org.nd4j.linalg.dataset.api.iterator.DataSetIterator> iterators, boolean singleDeviceMode, int bufferSize, org.nd4j.linalg.dataset.api.iterator.enums.InequalityHandling inequalityHandling)

Method Summary

Modifier and Type	Method and Description
boolean	hasNextFor(int consumer)
protected void	initializeIterators(List<org.nd4j.linalg.dataset.api.iterator.DataSetIterator> originals)
org.nd4j.linalg.dataset.DataSet	nextFor(int consumer)
protected void	reset(int consumer)

Methods inherited from class org.deeplearning4j.datasets.iterator.parallel.BaseParallelDataSetIterator

asyncSupported, attachThread, batch, cursor, getCurrentProducerIndex, getLabels, getPreProcessor, hasNext, hasNextFor, inputColumns, next, next, nextFor, numExamples, remove, reset, resetSupported, setPreProcessor, stepForward, totalExamples, totalOutcomes

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Methods inherited from interface java.util.Iterator

forEachRemaining

Field Detail

asyncIterators

protected List<org.nd4j.linalg.dataset.api.iterator.DataSetIterator> asyncIterators

enforceSingleDevice

protected boolean enforceSingleDevice

bufferSizePerDevice

protected int bufferSizePerDevice

Constructor Detail

JointParallelDataSetIterator

public JointParallelDataSetIterator(@NonNull
                                    List<org.nd4j.linalg.dataset.api.iterator.DataSetIterator> iterators,
                                    boolean singleDeviceMode,
                                    int bufferSize,
                                    @NonNull
                                    org.nd4j.linalg.dataset.api.iterator.enums.InequalityHandling inequalityHandling)

Method Detail

initializeIterators

protected void initializeIterators(List<org.nd4j.linalg.dataset.api.iterator.DataSetIterator> originals)

hasNextFor

public boolean hasNextFor(int consumer)

Specified by:

hasNextFor in interface org.nd4j.linalg.dataset.api.iterator.ParallelDataSetIterator

Specified by:

hasNextFor in class BaseParallelDataSetIterator

nextFor

public org.nd4j.linalg.dataset.DataSet nextFor(int consumer)

Specified by:

nextFor in interface org.nd4j.linalg.dataset.api.iterator.ParallelDataSetIterator

Specified by:

nextFor in class BaseParallelDataSetIterator

reset

protected void reset(int consumer)

Specified by:

reset in class BaseParallelDataSetIterator