Modifier and Type | Method and Description |
---|---|
void |
WeightLookupTable.iterate(VocabWord w1,
VocabWord w2)
Iterate on the given 2 vocab words
|
void |
WeightLookupTable.iterateSample(VocabWord w1,
VocabWord w2,
AtomicLong nextRandom,
double alpha)
Iterate on the given 2 vocab words
|
Modifier and Type | Method and Description |
---|---|
void |
InMemoryLookupTable.iterate(VocabWord w1,
VocabWord w2)
Iterate on the given 2 vocab words
|
void |
InMemoryLookupTable.iterateSample(VocabWord w1,
VocabWord w2,
AtomicLong nextRandom,
double alpha)
Iterate on the given 2 vocab words
|
Modifier and Type | Field and Description |
---|---|
protected Queue<Pair<Integer,List<Pair<VocabWord,VocabWord>>>> |
Glove.jobQueue |
protected Queue<Pair<Integer,List<Pair<VocabWord,VocabWord>>>> |
Glove.jobQueue |
Modifier and Type | Method and Description |
---|---|
Iterator<Pair<VocabWord,VocabWord>> |
CoOccurrences.coOccurrenceIteratorVocab() |
Iterator<Pair<VocabWord,VocabWord>> |
CoOccurrences.coOccurrenceIteratorVocab() |
Iterator<List<Pair<VocabWord,VocabWord>>> |
CoOccurrences.coOccurrenceIteratorVocabBatch(int batchSize) |
Iterator<List<Pair<VocabWord,VocabWord>>> |
CoOccurrences.coOccurrenceIteratorVocabBatch(int batchSize) |
List<Pair<VocabWord,VocabWord>> |
CoOccurrences.CoOccurrenceBatchIterator.next() |
List<Pair<VocabWord,VocabWord>> |
CoOccurrences.CoOccurrenceBatchIterator.next() |
Pair<VocabWord,VocabWord> |
CoOccurrences.CoOccurrenceIterator.next() |
Pair<VocabWord,VocabWord> |
CoOccurrences.CoOccurrenceIterator.next() |
Modifier and Type | Method and Description |
---|---|
void |
GloveWeightLookupTable.iterateSample(VocabWord w1,
VocabWord w2,
AtomicLong nextRandom,
double alpha) |
double |
GloveWeightLookupTable.iterateSample(VocabWord w1,
VocabWord w2,
double score)
glove iteration
|
Modifier and Type | Field and Description |
---|---|
protected Queue<LinkedList<Pair<List<VocabWord>,Collection<VocabWord>>>> |
ParagraphVectors.jobQueue |
protected Queue<LinkedList<Pair<List<VocabWord>,Collection<VocabWord>>>> |
ParagraphVectors.jobQueue |
Modifier and Type | Method and Description |
---|---|
protected void |
ParagraphVectors.addWords(List<VocabWord> sentence,
AtomicLong nextRandom,
List<VocabWord> currMiniBatch) |
protected void |
ParagraphVectors.addWords(List<VocabWord> sentence,
AtomicLong nextRandom,
List<VocabWord> currMiniBatch) |
void |
ParagraphVectors.dbow(int i,
Pair<List<VocabWord>,Collection<VocabWord>> sentenceWithLabel,
int b,
AtomicLong nextRandom,
double alpha)
Train the distributed bag of words
model
|
void |
ParagraphVectors.dbow(int i,
Pair<List<VocabWord>,Collection<VocabWord>> sentenceWithLabel,
int b,
AtomicLong nextRandom,
double alpha)
Train the distributed bag of words
model
|
void |
ParagraphVectors.trainSentence(Pair<List<VocabWord>,Collection<VocabWord>> sentenceWithLabel,
AtomicLong nextRandom,
double alpha)
Train on a list of vocab words
|
void |
ParagraphVectors.trainSentence(Pair<List<VocabWord>,Collection<VocabWord>> sentenceWithLabel,
AtomicLong nextRandom,
double alpha)
Train on a list of vocab words
|
Modifier and Type | Method and Description |
---|---|
static VocabWord |
VocabWord.none() |
VocabWord |
VocabWord.read(DataInputStream dos) |
Modifier and Type | Method and Description |
---|---|
int |
VocabWord.compareTo(VocabWord o) |
void |
Word2Vec.iterate(VocabWord w1,
VocabWord w2,
AtomicLong nextRandom,
double alpha)
Train the word vector
on the given words
|
Modifier and Type | Method and Description |
---|---|
protected void |
Word2Vec.addWords(List<VocabWord> sentence,
AtomicLong nextRandom,
List<VocabWord> currMiniBatch) |
protected void |
Word2Vec.addWords(List<VocabWord> sentence,
AtomicLong nextRandom,
List<VocabWord> currMiniBatch) |
void |
Word2Vec.skipGram(int i,
List<VocabWord> sentence,
int b,
AtomicLong nextRandom,
double alpha)
Train via skip gram
|
void |
Word2Vec.trainSentence(List<VocabWord> sentence,
AtomicLong nextRandom,
double alpha)
Train on a list of vocab words
|
Constructor and Description |
---|
Huffman(Collection<VocabWord> words) |
Modifier and Type | Method and Description |
---|---|
List<VocabWord> |
SkipGramMessage.getSentence() |
Modifier and Type | Method and Description |
---|---|
protected void |
VocabActor.processToken(String token,
Set<String> encountered,
List<VocabWord> words,
boolean stem) |
void |
SkipGramMessage.setSentence(List<VocabWord> sentence) |
Constructor and Description |
---|
SkipGramMessage(int i,
int b,
List<VocabWord> sentence) |
Modifier and Type | Method and Description |
---|---|
VocabWord |
VocabCache.tokenFor(String word)
Returns the token (again not necessarily in the vocab)
for this word
|
VocabWord |
VocabCache.wordFor(String word) |
Modifier and Type | Method and Description |
---|---|
Collection<VocabWord> |
VocabCache.tokens()
All of the tokens in the cache, (not necessarily apart of the vocab)
|
Collection<VocabWord> |
VocabCache.vocabWords()
Returns all of the vocab word nodes
|
Modifier and Type | Method and Description |
---|---|
void |
VocabCache.addToken(VocabWord word)
Adds a token
to the cache
|
Modifier and Type | Method and Description |
---|---|
VocabWord |
InMemoryLookupCache.tokenFor(String word) |
VocabWord |
InMemoryLookupCache.wordFor(String word) |
Modifier and Type | Method and Description |
---|---|
Collection<VocabWord> |
InMemoryLookupCache.tokens() |
Collection<VocabWord> |
InMemoryLookupCache.vocabWords()
Returns all of the vocab word nodes
|
Modifier and Type | Method and Description |
---|---|
void |
InMemoryLookupCache.addToken(VocabWord word) |
Modifier and Type | Method and Description |
---|---|
List<Pair<VocabWord,VocabWord>> |
GloveWork.getCoOccurrences() |
List<Pair<VocabWord,VocabWord>> |
GloveWork.getCoOccurrences() |
Map<Integer,VocabWord> |
GloveWork.getIndexes() |
Map<String,Pair<VocabWord,org.nd4j.linalg.api.ndarray.INDArray>> |
GloveWork.getVectors() |
Modifier and Type | Method and Description |
---|---|
double |
GlovePerformer.iterateSample(GloveWork work,
VocabWord w1,
VocabWord w2,
double score)
glove iteration
|
Modifier and Type | Method and Description |
---|---|
void |
GloveWork.setCoOccurrences(List<Pair<VocabWord,VocabWord>> coOccurrences) |
void |
GloveWork.setCoOccurrences(List<Pair<VocabWord,VocabWord>> coOccurrences) |
void |
GloveWork.setIndexes(Map<Integer,VocabWord> indexes) |
void |
GloveWork.setVectors(Map<String,Pair<VocabWord,org.nd4j.linalg.api.ndarray.INDArray>> vectors) |
Constructor and Description |
---|
GloveWork(GloveWeightLookupTable table,
List<Pair<VocabWord,VocabWord>> coOccurrences) |
GloveWork(GloveWeightLookupTable table,
List<Pair<VocabWord,VocabWord>> coOccurrences) |
Constructor and Description |
---|
GloveJobIterator(Iterator<List<List<VocabWord>>> sentenceIterator,
GloveWeightLookupTable table,
VocabCache cache,
org.deeplearning4j.scaleout.api.statetracker.StateTracker stateTracker) |
GloveJobIterator(Iterator<List<List<VocabWord>>> sentenceIterator,
GloveWeightLookupTable table,
VocabCache cache,
org.deeplearning4j.scaleout.api.statetracker.StateTracker stateTracker,
int batchSize) |
Modifier and Type | Method and Description |
---|---|
Map<Integer,VocabWord> |
Word2VecWork.getIndexes() |
Map<String,Pair<VocabWord,org.nd4j.linalg.api.ndarray.INDArray>> |
Word2VecWork.getNegativeVectors() |
List<List<VocabWord>> |
Word2VecWork.getSentences() |
Map<String,Pair<VocabWord,org.nd4j.linalg.api.ndarray.INDArray>> |
Word2VecWork.getVectors() |
Modifier and Type | Method and Description |
---|---|
void |
Word2VecPerformer.iterateSample(Word2VecWork work,
VocabWord w1,
VocabWord w2,
double alpha)
Iterate on the given 2 vocab words
|
Modifier and Type | Method and Description |
---|---|
void |
Word2VecWork.setIndexes(Map<Integer,VocabWord> indexes) |
void |
Word2VecWork.setNegativeVectors(Map<String,Pair<VocabWord,org.nd4j.linalg.api.ndarray.INDArray>> negativeVectors) |
void |
Word2VecWork.setSentences(List<List<VocabWord>> sentences) |
void |
Word2VecWork.setVectors(Map<String,Pair<VocabWord,org.nd4j.linalg.api.ndarray.INDArray>> vectors) |
void |
Word2VecPerformer.skipGram(int i,
List<VocabWord> sentence,
int b,
Word2VecWork work,
double alpha)
Train via skip gram
|
void |
Word2VecPerformer.trainSentence(List<VocabWord> sentence,
Word2VecWork work,
double alpha)
Train on a list of vocab words
|
Constructor and Description |
---|
Word2VecWork(InMemoryLookupTable table,
InMemoryLookupCache cache,
List<List<VocabWord>> sentences) |
Constructor and Description |
---|
Word2VecJobIterator(Iterator<List<List<VocabWord>>> sentenceIterator,
WeightLookupTable table,
VocabCache cache,
org.deeplearning4j.scaleout.api.statetracker.StateTracker stateTracker) |
Word2VecJobIterator(Iterator<List<List<VocabWord>>> sentenceIterator,
WeightLookupTable table,
VocabCache cache,
org.deeplearning4j.scaleout.api.statetracker.StateTracker stateTracker,
int batchSize) |
Modifier and Type | Method and Description |
---|---|
Iterator<List<List<VocabWord>>> |
LuceneInvertedIndex.batchIter(int batchSize) |
Iterator<List<List<VocabWord>>> |
InvertedIndex.batchIter(int batchSize)
Iterate over batches
|
Iterator<List<VocabWord>> |
LuceneInvertedIndex.docs() |
Iterator<List<VocabWord>> |
InvertedIndex.docs()
Iterate over documents
|
List<VocabWord> |
LuceneInvertedIndex.document(int index) |
List<VocabWord> |
InvertedIndex.document(int index)
Returns a list of words for a document
|
Pair<List<VocabWord>,String> |
LuceneInvertedIndex.documentWithLabel(int index) |
Pair<List<VocabWord>,String> |
InvertedIndex.documentWithLabel(int index)
Returns a list of words for a document
and the associated label
|
Pair<List<VocabWord>,Collection<String>> |
LuceneInvertedIndex.documentWithLabels(int index) |
Pair<List<VocabWord>,Collection<String>> |
InvertedIndex.documentWithLabels(int index)
Returns a list of words associated with the document
and the associated labels
|
Iterator<List<VocabWord>> |
LuceneInvertedIndex.miniBatches() |
Iterator<List<VocabWord>> |
InvertedIndex.miniBatches()
Iterates over mini batches
|
List<VocabWord> |
LuceneInvertedIndex.next() |
List<List<VocabWord>> |
LuceneInvertedIndex.BatchDocIter.next() |
List<VocabWord> |
LuceneInvertedIndex.DocIter.next() |
Modifier and Type | Method and Description |
---|---|
void |
LuceneInvertedIndex.addLabelForDoc(int doc,
VocabWord word) |
void |
InvertedIndex.addLabelForDoc(int doc,
VocabWord word)
Add word to a document
|
void |
LuceneInvertedIndex.addWordsToDoc(int doc,
List<VocabWord> words,
VocabWord label) |
void |
InvertedIndex.addWordsToDoc(int doc,
List<VocabWord> words,
VocabWord label)
Adds words to the given document
|
void |
LuceneInvertedIndex.addWordToDoc(int doc,
VocabWord word) |
void |
InvertedIndex.addWordToDoc(int doc,
VocabWord word)
Add word to a document
|
int[] |
LuceneInvertedIndex.documents(VocabWord vocabWord) |
int[] |
InvertedIndex.documents(VocabWord vocabWord)
Returns the list of documents a vocab word is in
|
Modifier and Type | Method and Description |
---|---|
void |
LuceneInvertedIndex.addLabelsForDoc(int doc,
List<VocabWord> label) |
void |
InvertedIndex.addLabelsForDoc(int doc,
List<VocabWord> word)
Add word to a document
|
void |
LuceneInvertedIndex.addWordsToDoc(int doc,
List<VocabWord> words) |
void |
InvertedIndex.addWordsToDoc(int doc,
List<VocabWord> words)
Adds words to the given document
|
void |
LuceneInvertedIndex.addWordsToDoc(int doc,
List<VocabWord> words,
Collection<String> label) |
void |
InvertedIndex.addWordsToDoc(int doc,
List<VocabWord> words,
Collection<String> label)
Adds words to the given document
|
void |
LuceneInvertedIndex.addWordsToDoc(int doc,
List<VocabWord> words,
String label) |
void |
InvertedIndex.addWordsToDoc(int doc,
List<VocabWord> words,
String label)
Adds words to the given document
|
void |
LuceneInvertedIndex.addWordsToDoc(int doc,
List<VocabWord> words,
VocabWord label) |
void |
InvertedIndex.addWordsToDoc(int doc,
List<VocabWord> words,
VocabWord label)
Adds words to the given document
|
void |
LuceneInvertedIndex.addWordsToDocVocabWord(int doc,
List<VocabWord> words,
Collection<VocabWord> label) |
void |
LuceneInvertedIndex.addWordsToDocVocabWord(int doc,
List<VocabWord> words,
Collection<VocabWord> label) |
void |
InvertedIndex.addWordsToDocVocabWord(int doc,
List<VocabWord> words,
Collection<VocabWord> label)
Adds words to the given document
|
void |
InvertedIndex.addWordsToDocVocabWord(int doc,
List<VocabWord> words,
Collection<VocabWord> label)
Adds words to the given document
|
void |
LuceneInvertedIndex.eachDoc(com.google.common.base.Function<List<VocabWord>,Void> func,
ExecutorService exec) |
void |
InvertedIndex.eachDoc(com.google.common.base.Function<List<VocabWord>,Void> func,
ExecutorService exec)
Iterate over each document
|
void |
LuceneInvertedIndex.eachDocWithLabel(com.google.common.base.Function<Pair<List<VocabWord>,String>,Void> func,
ExecutorService exec) |
void |
InvertedIndex.eachDocWithLabel(com.google.common.base.Function<Pair<List<VocabWord>,String>,Void> func,
ExecutorService exec)
Iterate over each document with a label
|
void |
LuceneInvertedIndex.eachDocWithLabels(com.google.common.base.Function<Pair<List<VocabWord>,Collection<String>>,Void> func,
ExecutorService exec) |
void |
InvertedIndex.eachDocWithLabels(com.google.common.base.Function<Pair<List<VocabWord>,Collection<String>>,Void> func,
ExecutorService exec)
Iterate over each document with a label
|
Copyright © 2015. All rights reserved.