Class SentenceTransformer
- java.lang.Object
-
- org.deeplearning4j.models.sequencevectors.transformers.impl.SentenceTransformer
-
-
Nested Class Summary
Nested Classes Modifier and Type Class Description static class
SentenceTransformer.Builder
-
Field Summary
Fields Modifier and Type Field Description protected boolean
allowMultithreading
protected BasicTransformerIterator
currentIterator
protected LabelAwareIterator
iterator
protected static org.slf4j.Logger
log
protected boolean
readOnly
protected AtomicInteger
sentenceCounter
protected TokenizerFactory
tokenizerFactory
-
Method Summary
All Methods Instance Methods Concrete Methods Modifier and Type Method Description Iterator<Sequence<VocabWord>>
iterator()
void
reset()
Sequence<VocabWord>
transformToSequence(String object)
This is generic method for transformation data from any format to Sequence of SequenceElement.-
Methods inherited from class java.lang.Object
clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait
-
Methods inherited from interface java.lang.Iterable
forEach, spliterator
-
-
-
-
Field Detail
-
tokenizerFactory
protected TokenizerFactory tokenizerFactory
-
iterator
protected LabelAwareIterator iterator
-
readOnly
protected boolean readOnly
-
sentenceCounter
protected AtomicInteger sentenceCounter
-
allowMultithreading
protected boolean allowMultithreading
-
currentIterator
protected BasicTransformerIterator currentIterator
-
log
protected static final org.slf4j.Logger log
-
-
Method Detail
-
transformToSequence
public Sequence<VocabWord> transformToSequence(String object)
Description copied from interface:SequenceTransformer
This is generic method for transformation data from any format to Sequence of SequenceElement. It will be used both in Vocab building, and in training process- Specified by:
transformToSequence
in interfaceSequenceTransformer<VocabWord,String>
- Parameters:
object
- - Object to be transformed into Sequence- Returns:
-
reset
public void reset()
- Specified by:
reset
in interfaceSequenceTransformer<VocabWord,String>
-
-