org.deeplearning4j.models.paragraphvectors

Class ParagraphVectors

java.lang.Object

org.deeplearning4j.models.embeddings.wordvectors.WordVectorsImpl

org.deeplearning4j.models.word2vec.Word2Vec

org.deeplearning4j.models.paragraphvectors.ParagraphVectors

All Implemented Interfaces:

Serializable, WordVectors

public class ParagraphVectors
extends Word2Vec

Paragraph Vectors: [1] Quoc Le and Tomas Mikolov. Distributed Representations of Sentences and Documents. http://arxiv.org/pdf/1405.4053v2.pdf .. [2] Tomas Mikolov, Kai Chen, Greg Corrado, and Jeffrey Dean. Efficient Estimation of Word Representations in Vector Space. In Proceedings of Workshop at ICLR, 2013. .. [3] Tomas Mikolov, Ilya Sutskever, Kai Chen, Greg Corrado, and Jeffrey Dean. Distributed Representations of Words and Phrases and their Compositionality. In Proceedings of NIPS, 2013.

Author:

Adam Gibson

See Also:

Serialized Form

Nested Class Summary

Nested Classes

Modifier and Type	Class and Description
static class	ParagraphVectors.Builder

Field Summary

Fields

Modifier and Type	Field and Description
protected Queue<LinkedList<Pair<List<VocabWord>,Collection<VocabWord>>>>	jobQueue

Fields inherited from class org.deeplearning4j.models.word2vec.Word2Vec

alpha, batchSize, docIter, g, invertedIndex, learningRateDecayWords, log, minLearningRate, numIterations, sample, saveVocab, seed, sentenceIter, serialVersionUID, shouldReset, tokenizerFactory, totalWords, UNK, useAdaGrad, vectorizer, window, workers

Fields inherited from class org.deeplearning4j.models.embeddings.wordvectors.WordVectorsImpl

layerSize, lookupTable, minWordFrequency, stopWords, vocab

Constructor Summary

Constructors

Constructor and Description
ParagraphVectors()

Method Summary

Modifier and Type	Method and Description
protected void	addWords(List<VocabWord> sentence, AtomicLong nextRandom, List<VocabWord> currMiniBatch)
void	dbow(int i, Pair<List<VocabWord>,Collection<VocabWord>> sentenceWithLabel, int b, AtomicLong nextRandom, double alpha) Train the distributed bag of words model
void	fit() Train the model
void	trainSentence(Pair<List<VocabWord>,Collection<VocabWord>> sentenceWithLabel, AtomicLong nextRandom, double alpha) Train on a list of vocab words

Methods inherited from class org.deeplearning4j.models.word2vec.Word2Vec

buildBinaryTree, buildVocab, getSentenceIter, getStopWords, getTokenizerFactory, getVectorizer, getWindow, iterate, readStopWords, resetWeights, resetWeightsOnSetup, setSentenceIter, setTokenizerFactory, setup, setVectorizer, skipGram, trainSentence

Methods inherited from class org.deeplearning4j.models.embeddings.wordvectors.WordVectorsImpl

accuracy, getWordVector, getWordVectorMatrix, getWordVectorMatrixNormalized, hasWord, indexOf, lookupTable, setLookupTable, setVocab, similarity, similarWordsInVocabTo, vocab, wordsNearest, wordsNearest, wordsNearestSum, wordsNearestSum

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Field Detail

jobQueue

protected Queue<LinkedList<Pair<List<VocabWord>,Collection<VocabWord>>>> jobQueue

Constructor Detail

ParagraphVectors

public ParagraphVectors()

Method Detail

fit

public void fit()
         throws IOException

Train the model

Overrides:

fit in class Word2Vec

Throws:

IOException

trainSentence

public void trainSentence(Pair<List<VocabWord>,Collection<VocabWord>> sentenceWithLabel,
                          AtomicLong nextRandom,
                          double alpha)

Train on a list of vocab words

Parameters:

sentenceWithLabel - the list of vocab words to train on

dbow

public void dbow(int i,
                 Pair<List<VocabWord>,Collection<VocabWord>> sentenceWithLabel,
                 int b,
                 AtomicLong nextRandom,
                 double alpha)

Train the distributed bag of words model

Parameters:

i - the word to train

sentenceWithLabel - the sentence with labels to train

b -

nextRandom -

alpha -

addWords

protected void addWords(List<VocabWord> sentence,
                        AtomicLong nextRandom,
                        List<VocabWord> currMiniBatch)

Overrides:

addWords in class Word2Vec