Package org.deeplearning4j.models.sequencevectors.transformers.impl.iterables

Class ParallelTransformerIterator

java.lang.Object

org.deeplearning4j.models.sequencevectors.transformers.impl.iterables.BasicTransformerIterator

org.deeplearning4j.models.sequencevectors.transformers.impl.iterables.ParallelTransformerIterator

All Implemented Interfaces:

Iterator<Sequence<VocabWord>>

public class ParallelTransformerIterator
extends BasicTransformerIterator

Field Summary

Fields

Modifier and Type	Field	Description
protected BlockingQueue<Future<Sequence<VocabWord>>>	buffer
protected static int	capacity
protected static AtomicInteger	count
protected AtomicInteger	processing
protected AtomicBoolean	underlyingHas

Fields inherited from class org.deeplearning4j.models.sequencevectors.transformers.impl.iterables.BasicTransformerIterator

allowMultithreading, iterator, sentenceTransformer

Constructor Summary

Constructors

Constructor	Description
ParallelTransformerIterator(@NonNull LabelAwareIterator iterator, @NonNull SentenceTransformer transformer)
ParallelTransformerIterator(@NonNull LabelAwareIterator iterator, @NonNull SentenceTransformer transformer, boolean allowMultithreading)

Method Summary

Modifier and Type	Method	Description
boolean	hasNext()
Sequence<VocabWord>	next()
void	reset()
void	shutdown()

Methods inherited from class org.deeplearning4j.models.sequencevectors.transformers.impl.iterables.BasicTransformerIterator

remove

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Methods inherited from interface java.util.Iterator

forEachRemaining

Field Detail

capacity

protected static final int capacity

See Also:

Constant Field Values

buffer

protected BlockingQueue<Future<Sequence<VocabWord>>> buffer

underlyingHas

protected AtomicBoolean underlyingHas

processing

protected AtomicInteger processing

count

protected static final AtomicInteger count

Constructor Detail

ParallelTransformerIterator

public ParallelTransformerIterator(@NonNull
                                   @NonNull LabelAwareIterator iterator,
                                   @NonNull
                                   @NonNull SentenceTransformer transformer)

ParallelTransformerIterator

public ParallelTransformerIterator(@NonNull
                                   @NonNull LabelAwareIterator iterator,
                                   @NonNull
                                   @NonNull SentenceTransformer transformer,
                                   boolean allowMultithreading)

Method Detail

reset

public void reset()

Overrides:

reset in class BasicTransformerIterator

shutdown

public void shutdown()

hasNext

public boolean hasNext()

Specified by:

hasNext in interface Iterator<Sequence<VocabWord>>

Overrides:

hasNext in class BasicTransformerIterator

next

public Sequence<VocabWord> next()

Specified by:

next in interface Iterator<Sequence<VocabWord>>

Overrides:

next in class BasicTransformerIterator