org.deeplearning4j.models.rntn

Class RNTN

java.lang.Object

org.deeplearning4j.models.rntn.RNTN

All Implemented Interfaces:

Serializable, Cloneable, Layer, Model

public class RNTN
extends Object
implements Model, Layer

Recursive Neural Tensor Network by Socher et. al This is a modified implementation of the sentiment analysis RNTN from Stanford that is intended to work with more general purpose inputs (scene detection with images, labeling series of sentences, among others) This implementation will also be faster in terms of parallelization as well as integration with native matrices/GPUs

Author:

Adam Gibson

See Also:

Serialized Form

Nested Class Summary

Nested Classes

Modifier and Type	Class and Description
static class	RNTN.Builder

Field Summary

Fields

Modifier and Type	Field and Description
protected org.nd4j.linalg.api.activation.ActivationFunction	activationFunction
protected int	numParameters
protected org.nd4j.linalg.api.activation.ActivationFunction	outputActivation
protected org.nd4j.linalg.learning.AdaGrad	paramAdaGrad
protected double	value

Method Summary

Modifier and Type	Method and Description
org.nd4j.linalg.api.ndarray.INDArray	activate()
org.nd4j.linalg.api.ndarray.INDArray	activate(org.nd4j.linalg.api.ndarray.INDArray input)
org.nd4j.linalg.api.ndarray.INDArray	activationMean()
String	basicCategory(String category)
int	batchSize()
Layer	clone()
NeuralNetConfiguration	conf()
void	fit()
void	fit(org.nd4j.linalg.api.ndarray.INDArray data)
void	fit(List<Tree> trainingBatch) Trains the network on this mini batch
void	forwardPropagateTree(Tree tree) This is the method to call for assigning labels and node vectors to the Tree.
org.nd4j.linalg.api.ndarray.INDArray	getBinaryClassification(String left, String right)
org.nd4j.linalg.api.ndarray.INDArray	getBinaryINDArray(String left, String right)
org.nd4j.linalg.api.ndarray.INDArray	getBinaryTransform(String left, String right)
org.nd4j.linalg.api.ndarray.INDArray	getClassWForNode(Tree node)
org.nd4j.linalg.api.ndarray.INDArray	getFeatureVector(String word)
Gradient	getGradient()
org.nd4j.linalg.api.ndarray.INDArray	getINDArrayForNode(Tree node)
org.nd4j.linalg.api.ndarray.INDArray	getInput()
int	getNumParameters()
org.nd4j.linalg.api.ndarray.INDArray	getParam(String param)
org.nd4j.linalg.api.ndarray.INDArray	getParameters()
org.nd4j.linalg.api.ndarray.INDArray	getUnaryClassification(String category)
double	getValue()
org.nd4j.linalg.api.ndarray.INDArray	getValueGradient()
String	getVocabWord(String word)
org.nd4j.linalg.api.ndarray.INDArray	getWForNode(Tree node)
Pair<Gradient,Double>	gradientAndScore()
void	initParams()
org.nd4j.linalg.api.ndarray.INDArray	input()
void	iterate(org.nd4j.linalg.api.ndarray.INDArray input)
void	merge(Layer layer, int batchSize)
int	numParams()
List<org.nd4j.linalg.api.ndarray.INDArray>	output(List<Tree> trees) output the prediction probabilities for each tree
org.nd4j.linalg.api.ndarray.INDArray	params()
Map<String,org.nd4j.linalg.api.ndarray.INDArray>	paramTable()
List<Integer>	predict(List<Tree> trees) output the top level labels for each tree
org.nd4j.linalg.api.ndarray.INDArray	preOutput(org.nd4j.linalg.api.ndarray.INDArray x)
org.nd4j.linalg.api.ndarray.INDArray	randomTransformBlock()
org.nd4j.linalg.api.ndarray.INDArray	randomTransformMatrix()
double	score()
void	setConf(NeuralNetConfiguration conf)
void	setConfiguration(NeuralNetConfiguration conf)
void	setInput(org.nd4j.linalg.api.ndarray.INDArray input)
void	setParam(String key, org.nd4j.linalg.api.ndarray.INDArray val)
void	setParameters(org.nd4j.linalg.api.ndarray.INDArray params)
void	setParams(org.nd4j.linalg.api.ndarray.INDArray params)
void	setParamTable(Map<String,org.nd4j.linalg.api.ndarray.INDArray> paramTable)
org.nd4j.linalg.api.ndarray.INDArray	transform(org.nd4j.linalg.api.ndarray.INDArray data)
Layer	transpose()
void	update(Gradient gradient)
void	validateInput()

Methods inherited from class java.lang.Object

equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Field Detail

value

protected double value

activationFunction

protected org.nd4j.linalg.api.activation.ActivationFunction activationFunction

outputActivation

protected org.nd4j.linalg.api.activation.ActivationFunction outputActivation

paramAdaGrad

protected org.nd4j.linalg.learning.AdaGrad paramAdaGrad

numParameters

protected int numParameters

Method Detail

randomTransformMatrix

public org.nd4j.linalg.api.ndarray.INDArray randomTransformMatrix()

randomTransformBlock

public org.nd4j.linalg.api.ndarray.INDArray randomTransformBlock()

fit

public void fit(List<Tree> trainingBatch)

Trains the network on this mini batch

Parameters:

trainingBatch - the trees to iterate on

getWForNode

public org.nd4j.linalg.api.ndarray.INDArray getWForNode(Tree node)

getINDArrayForNode

public org.nd4j.linalg.api.ndarray.INDArray getINDArrayForNode(Tree node)

getClassWForNode

public org.nd4j.linalg.api.ndarray.INDArray getClassWForNode(Tree node)

getFeatureVector

public org.nd4j.linalg.api.ndarray.INDArray getFeatureVector(String word)

getVocabWord

public String getVocabWord(String word)

basicCategory

public String basicCategory(String category)

getUnaryClassification

public org.nd4j.linalg.api.ndarray.INDArray getUnaryClassification(String category)

getBinaryClassification

public org.nd4j.linalg.api.ndarray.INDArray getBinaryClassification(String left,
                                                                    String right)

getBinaryTransform

public org.nd4j.linalg.api.ndarray.INDArray getBinaryTransform(String left,
                                                               String right)

getBinaryINDArray

public org.nd4j.linalg.api.ndarray.INDArray getBinaryINDArray(String left,
                                                              String right)

forwardPropagateTree

public void forwardPropagateTree(Tree tree)

This is the method to call for assigning labels and node vectors to the Tree. After calling this, each of the non-leaf nodes will have the node vector and the predictions of their classes assigned to that subtree's node.

output

public List<org.nd4j.linalg.api.ndarray.INDArray> output(List<Tree> trees)

output the prediction probabilities for each tree

Parameters:

trees - the trees to predict

Returns:

the prediction probabilities for each tree

predict

public List<Integer> predict(List<Tree> trees)

output the top level labels for each tree

Parameters:

trees - the trees to predict

Returns:

the prediction labels for each tree

setParameters

public void setParameters(org.nd4j.linalg.api.ndarray.INDArray params)

getNumParameters

public int getNumParameters()

getParameters

public org.nd4j.linalg.api.ndarray.INDArray getParameters()

getValueGradient

public org.nd4j.linalg.api.ndarray.INDArray getValueGradient()

getValue

public double getValue()

fit

public void fit()

Specified by:

fit in interface Model

update

public void update(Gradient gradient)

Specified by:

update in interface Model

score

public double score()

Specified by:

score in interface Model

transform

public org.nd4j.linalg.api.ndarray.INDArray transform(org.nd4j.linalg.api.ndarray.INDArray data)

Specified by:

transform in interface Model

params

public org.nd4j.linalg.api.ndarray.INDArray params()

Specified by:

params in interface Model

numParams

public int numParams()

Specified by:

numParams in interface Model

setParams

public void setParams(org.nd4j.linalg.api.ndarray.INDArray params)

Specified by:

setParams in interface Model

fit

public void fit(org.nd4j.linalg.api.ndarray.INDArray data)

Specified by:

fit in interface Model

iterate

public void iterate(org.nd4j.linalg.api.ndarray.INDArray input)

Specified by:

iterate in interface Model

getGradient

public Gradient getGradient()

Specified by:

getGradient in interface Model

gradientAndScore

public Pair<Gradient,Double> gradientAndScore()

Specified by:

gradientAndScore in interface Model

batchSize

public int batchSize()

Specified by:

batchSize in interface Model

merge

public void merge(Layer layer,
                  int batchSize)

Specified by:

merge in interface Layer

getParam

public org.nd4j.linalg.api.ndarray.INDArray getParam(String param)

Specified by:

getParam in interface Layer

initParams

public void initParams()

Specified by:

initParams in interface Layer

paramTable

public Map<String,org.nd4j.linalg.api.ndarray.INDArray> paramTable()

Specified by:

paramTable in interface Layer

setParamTable

public void setParamTable(Map<String,org.nd4j.linalg.api.ndarray.INDArray> paramTable)

Specified by:

setParamTable in interface Layer

setParam

public void setParam(String key,
                     org.nd4j.linalg.api.ndarray.INDArray val)

Specified by:

setParam in interface Layer

activationMean

public org.nd4j.linalg.api.ndarray.INDArray activationMean()

Specified by:

activationMean in interface Layer

conf

public NeuralNetConfiguration conf()

Specified by:

conf in interface Layer

Specified by:

conf in interface Model

setConfiguration

public void setConfiguration(NeuralNetConfiguration conf)

Specified by:

setConfiguration in interface Layer

getInput

public org.nd4j.linalg.api.ndarray.INDArray getInput()

Specified by:

getInput in interface Layer

setInput

public void setInput(org.nd4j.linalg.api.ndarray.INDArray input)

Specified by:

setInput in interface Layer

preOutput

public org.nd4j.linalg.api.ndarray.INDArray preOutput(org.nd4j.linalg.api.ndarray.INDArray x)

Specified by:

preOutput in interface Layer

activate

public org.nd4j.linalg.api.ndarray.INDArray activate()

Specified by:

activate in interface Layer

activate

public org.nd4j.linalg.api.ndarray.INDArray activate(org.nd4j.linalg.api.ndarray.INDArray input)

Specified by:

activate in interface Layer

transpose

public Layer transpose()

Specified by:

transpose in interface Layer

clone

public Layer clone()

Specified by:

clone in interface Layer

Overrides:

clone in class Object

setConf

public void setConf(NeuralNetConfiguration conf)

Specified by:

setConf in interface Model

input

public org.nd4j.linalg.api.ndarray.INDArray input()

Specified by:

input in interface Model

validateInput

public void validateInput()

Specified by:

validateInput in interface Model