org.deeplearning4j.models.glove

Class Glove

java.lang.Object

org.deeplearning4j.models.embeddings.wordvectors.WordVectorsImpl

org.deeplearning4j.models.glove.Glove

All Implemented Interfaces:

Serializable, WordVectors

public class Glove
extends WordVectorsImpl

Glove by socher et. al

Author:

Adam Gibson

See Also:

Serialized Form

Nested Class Summary

Nested Classes

Modifier and Type	Class and Description
static class	Glove.Builder

Field Summary

Fields

Modifier and Type	Field and Description
protected Queue<Pair<Integer,List<Pair<VocabWord,VocabWord>>>>	jobQueue
static String	UNK

Fields inherited from class org.deeplearning4j.models.embeddings.wordvectors.WordVectorsImpl

layerSize, lookupTable, stopWords, vocab

Constructor Summary

Constructors

Constructor and Description

Glove(VocabCache cache, SentenceIterator sentenceIterator, TextVectorizer textVectorizer, TokenizerFactory tokenizerFactory, GloveWeightLookupTable lookupTable, int layerSize, double learningRate, double xMax, int windowSize, CoOccurrences coOccurrences, List<String> stopWords, boolean stem, int batchSize, int minWordFrequency, double maxCount, int iterations, boolean symmetric, org.apache.commons.math3.random.RandomGenerator gen, boolean shuffle, long seed, int numWorkers)

Method Summary

Modifier and Type	Method and Description
void	doIteration(int i, List<Pair<String,String>> pairList, Counter<Integer> errorPerIteration, AtomicInteger processed, AtomicInteger countUp)
void	fit()
CoOccurrences	getCoOccurrences()
double	getCount(String w1, String w2)
static Glove	load(InputStream is, InputStream biases) Load a glove model from an input stream.
GloveWeightLookupTable	lookupTable()
void	setCoOccurrences(CoOccurrences coOccurrences)
void	setLookupTable(GloveWeightLookupTable lookupTable)

Methods inherited from class org.deeplearning4j.models.embeddings.wordvectors.WordVectorsImpl

accuracy, getWordVector, getWordVectorMatrix, getWordVectorMatrixNormalized, hasWord, indexOf, setLookupTable, setVocab, similarity, similarWordsInVocabTo, vocab, wordsNearest, wordsNearest, wordsNearestSum, wordsNearestSum

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Field Detail

jobQueue

protected Queue<Pair<Integer,List<Pair<VocabWord,VocabWord>>>> jobQueue

UNK

public static final String UNK

See Also:

Constant Field Values

Constructor Detail

Glove

public Glove(VocabCache cache,
             SentenceIterator sentenceIterator,
             TextVectorizer textVectorizer,
             TokenizerFactory tokenizerFactory,
             GloveWeightLookupTable lookupTable,
             int layerSize,
             double learningRate,
             double xMax,
             int windowSize,
             CoOccurrences coOccurrences,
             List<String> stopWords,
             boolean stem,
             int batchSize,
             int minWordFrequency,
             double maxCount,
             int iterations,
             boolean symmetric,
             org.apache.commons.math3.random.RandomGenerator gen,
             boolean shuffle,
             long seed,
             int numWorkers)

Method Detail

fit

public void fit()

doIteration

public void doIteration(int i,
                        List<Pair<String,String>> pairList,
                        Counter<Integer> errorPerIteration,
                        AtomicInteger processed,
                        AtomicInteger countUp)

load

public static Glove load(InputStream is,
                         InputStream biases)
                  throws IOException

Load a glove model from an input stream. The format is: word num1 num2....

Parameters:

is - the input stream to read from for the weights

biases - the bias input stream

Returns:

the loaded model

Throws:

IOException - if one occurs

getCount

public double getCount(String w1,
                       String w2)

getCoOccurrences

public CoOccurrences getCoOccurrences()

setCoOccurrences

public void setCoOccurrences(CoOccurrences coOccurrences)

lookupTable

public GloveWeightLookupTable lookupTable()

Specified by:

lookupTable in interface WordVectors

Overrides:

lookupTable in class WordVectorsImpl

setLookupTable

public void setLookupTable(GloveWeightLookupTable lookupTable)