Modifier and Type | Field and Description |
---|---|
protected InvertedIndex<VocabWord> |
BaseTextVectorizer.index |
protected VocabCache<VocabWord> |
BagOfWordsVectorizer.Builder.vocabCache |
protected VocabCache<VocabWord> |
TfidfVectorizer.Builder.vocabCache |
protected VocabCache<VocabWord> |
BaseTextVectorizer.vocabCache |
Modifier and Type | Method and Description |
---|---|
InvertedIndex<VocabWord> |
TextVectorizer.getIndex()
Inverted index
|
VocabCache<VocabWord> |
TextVectorizer.getVocabCache()
The vocab sorted in descending order
|
Modifier and Type | Method and Description |
---|---|
BagOfWordsVectorizer.Builder |
BagOfWordsVectorizer.Builder.setVocab(VocabCache<VocabWord> vocab) |
TfidfVectorizer.Builder |
TfidfVectorizer.Builder.setVocab(VocabCache<VocabWord> vocab) |
Modifier and Type | Method and Description |
---|---|
Pair<VocabWord,float[]> |
WordVectorSerializer.Reader.next() |
Pair<VocabWord,float[]> |
WordVectorSerializer.BinaryReader.next() |
Pair<VocabWord,float[]> |
WordVectorSerializer.CSVReader.next() |
static VocabCache<VocabWord> |
WordVectorSerializer.readVocabCache(File file)
This method reads vocab cache from provided file.
|
static VocabCache<VocabWord> |
WordVectorSerializer.readVocabCache(InputStream stream)
This method reads vocab cache from provided InputStream.
|
Modifier and Type | Method and Description |
---|---|
static void |
WordVectorSerializer.writeVocabCache(VocabCache<VocabWord> vocabCache,
File file)
This method saves vocab cache to provided File.
|
static void |
WordVectorSerializer.writeVocabCache(VocabCache<VocabWord> vocabCache,
OutputStream stream)
This method saves vocab cache to provided OutputStream.
|
Modifier and Type | Method and Description |
---|---|
Glove.Builder |
Glove.Builder.unknownElement(VocabWord element)
This method allows you to specify SequenceElement that will be used as UNK element, if UNK is used
|
Modifier and Type | Method and Description |
---|---|
Glove.Builder |
Glove.Builder.iterate(SequenceIterator<VocabWord> iterator) |
Glove.Builder |
Glove.Builder.lookupTable(WeightLookupTable<VocabWord> lookupTable) |
Glove.Builder |
Glove.Builder.modelUtils(ModelUtils<VocabWord> modelUtils)
Sets ModelUtils that gonna be used as provider for utility methods: similarity(), wordsNearest(), accuracy(), etc
|
Glove.Builder |
Glove.Builder.setVectorsListeners(Collection<VectorsListener<VocabWord>> vectorsListeners)
This method sets VectorsListeners for this SequenceVectors model
|
Glove.Builder |
Glove.Builder.stopWords(Collection<VocabWord> stopList) |
Glove.Builder |
Glove.Builder.vocabCache(VocabCache<VocabWord> vocabCache) |
Modifier and Type | Field and Description |
---|---|
protected List<VocabWord> |
ParagraphVectors.labelsList |
Modifier and Type | Method and Description |
---|---|
ParagraphVectors.Builder |
ParagraphVectors.Builder.unknownElement(VocabWord element)
This method allows you to specify SequenceElement that will be used as UNK element, if UNK is used
|
Modifier and Type | Method and Description |
---|---|
ParagraphVectors.Builder |
ParagraphVectors.Builder.elementsLearningAlgorithm(ElementsLearningAlgorithm<VocabWord> algorithm) |
ParagraphVectors.Builder |
ParagraphVectors.Builder.index(InvertedIndex<VocabWord> index) |
org.nd4j.linalg.api.ndarray.INDArray |
ParagraphVectors.inferVector(List<VocabWord> document)
This method calculates inferred vector for given list of words, with default parameters for learning rate and iterations
|
org.nd4j.linalg.api.ndarray.INDArray |
ParagraphVectors.inferVector(List<VocabWord> document,
double learningRate,
double minLearningRate,
int iterations)
This method calculates inferred vector for given document
|
ParagraphVectors.Builder |
ParagraphVectors.Builder.iterate(SequenceIterator<VocabWord> iterator)
This method used to feed SequenceIterator, that contains training corpus, into ParagraphVectors
|
ParagraphVectors.Builder |
ParagraphVectors.Builder.lookupTable(WeightLookupTable<VocabWord> lookupTable)
This method allows to define external WeightLookupTable to be used
|
ParagraphVectors.Builder |
ParagraphVectors.Builder.modelUtils(ModelUtils<VocabWord> modelUtils)
Sets ModelUtils that gonna be used as provider for utility methods: similarity(), wordsNearest(), accuracy(), etc
|
Collection<String> |
ParagraphVectors.nearestLabels(Collection<VocabWord> document,
int topN)
This method returns top N labels nearest to specified set of vocab words
|
String |
ParagraphVectors.predict(List<VocabWord> document)
Deprecated.
|
Collection<String> |
ParagraphVectors.predictSeveral(List<VocabWord> document,
int limit)
Deprecated.
|
ParagraphVectors.Builder |
ParagraphVectors.Builder.sequenceLearningAlgorithm(SequenceLearningAlgorithm<VocabWord> algorithm) |
ParagraphVectors.Builder |
ParagraphVectors.Builder.setVectorsListeners(Collection<VectorsListener<VocabWord>> vectorsListeners)
This method sets VectorsListeners for this SequenceVectors model
|
double |
ParagraphVectors.similarityToLabel(List<VocabWord> document,
String label)
Deprecated.
|
ParagraphVectors.Builder |
ParagraphVectors.Builder.stopWords(Collection<VocabWord> stopList)
This method defines stop words that should be ignored during training
|
ParagraphVectors.Builder |
ParagraphVectors.Builder.vocabCache(VocabCache<VocabWord> vocabCache)
This method allows to define external VocabCache to be used
|
Modifier and Type | Method and Description |
---|---|
VocabWord |
VocabWordFactory.deserialize(String json)
This method builds object from provided JSON
|
Modifier and Type | Method and Description |
---|---|
String |
VocabWordFactory.serialize(VocabWord element)
This method serializaes object into JSON string
|
Modifier and Type | Field and Description |
---|---|
protected VocabCache<VocabWord> |
SentenceTransformer.Builder.vocabCache |
Modifier and Type | Method and Description |
---|---|
Iterator<Sequence<VocabWord>> |
SentenceTransformer.iterator() |
Sequence<VocabWord> |
SentenceTransformer.transformToSequence(String object) |
Modifier and Type | Field and Description |
---|---|
protected LinkedBlockingQueue<Sequence<VocabWord>> |
ParallelTransformerIterator.buffer |
Modifier and Type | Method and Description |
---|---|
Sequence<VocabWord> |
ParallelTransformerIterator.next() |
Sequence<VocabWord> |
BasicTransformerIterator.next() |
Modifier and Type | Method and Description |
---|---|
static VocabWord |
VocabWord.none() |
Modifier and Type | Method and Description |
---|---|
Word2Vec.Builder |
Word2Vec.Builder.unknownElement(VocabWord element)
This method allows you to specify SequenceElement that will be used as UNK element, if UNK is used
|
Modifier and Type | Method and Description |
---|---|
Word2Vec.Builder |
Word2Vec.Builder.elementsLearningAlgorithm(ElementsLearningAlgorithm<VocabWord> algorithm) |
Word2Vec.Builder |
Word2Vec.Builder.index(InvertedIndex<VocabWord> index)
Deprecated.
|
Word2Vec.Builder |
Word2Vec.Builder.iterate(SequenceIterator<VocabWord> iterator)
This method used to feed SequenceIterator, that contains training corpus, into ParagraphVectors
|
Word2Vec.Builder |
Word2Vec.Builder.lookupTable(WeightLookupTable<VocabWord> lookupTable)
This method allows to define external WeightLookupTable to be used
|
Word2Vec.Builder |
Word2Vec.Builder.modelUtils(ModelUtils<VocabWord> modelUtils)
Sets ModelUtils that gonna be used as provider for utility methods: similarity(), wordsNearest(), accuracy(), etc
|
Word2Vec.Builder |
Word2Vec.Builder.setVectorsListeners(Collection<VectorsListener<VocabWord>> vectorsListeners)
This method sets VectorsListeners for this SequenceVectors model
|
Word2Vec.Builder |
Word2Vec.Builder.stopWords(Collection<VocabWord> stopList)
This method defines stop words that should be ignored during training
|
Word2Vec.Builder |
Word2Vec.Builder.vocabCache(VocabCache<VocabWord> vocabCache)
This method allows to define external VocabCache to be used
|
Constructor and Description |
---|
Builder(org.nd4j.linalg.compression.AbstractStorage<Integer> storage,
VocabCache<VocabWord> vocabCache) |
Modifier and Type | Field and Description |
---|---|
Map<String,VocabWord> |
InMemoryLookupCache.tokens
Deprecated.
|
Map<String,VocabWord> |
InMemoryLookupCache.vocabs
Deprecated.
|
Modifier and Type | Method and Description |
---|---|
VocabWord |
InMemoryLookupCache.elementAtIndex(int index)
Deprecated.
|
VocabWord |
InMemoryLookupCache.tokenFor(String word)
Deprecated.
|
VocabWord |
InMemoryLookupCache.wordFor(String word)
Deprecated.
|
Modifier and Type | Method and Description |
---|---|
Map<String,VocabWord> |
InMemoryLookupCache.getTokens()
Deprecated.
|
Map<String,VocabWord> |
InMemoryLookupCache.getVocabs()
Deprecated.
|
Collection<VocabWord> |
InMemoryLookupCache.tokens()
Deprecated.
|
Collection<VocabWord> |
InMemoryLookupCache.vocabWords()
Deprecated.
Returns all of the vocab word nodes
|
Modifier and Type | Method and Description |
---|---|
void |
InMemoryLookupCache.addToken(VocabWord word)
Deprecated.
|
void |
InMemoryLookupCache.removeElement(VocabWord element)
Deprecated.
|
Modifier and Type | Method and Description |
---|---|
void |
InMemoryLookupCache.importVocabulary(VocabCache<VocabWord> vocabCache)
Deprecated.
|
void |
InMemoryLookupCache.setTokens(Map<String,VocabWord> tokens)
Deprecated.
|
void |
InMemoryLookupCache.setVocabs(Map<String,VocabWord> vocabs)
Deprecated.
|
Copyright © 2016. All Rights Reserved.