org.deeplearning4j.optimize

Class NeuralNetworkOptimizer

java.lang.Object

org.deeplearning4j.optimize.NeuralNetworkOptimizer

All Implemented Interfaces:

cc.mallet.optimize.Optimizable, cc.mallet.optimize.Optimizable.ByGradientValue, Serializable, NeuralNetEpochListener

Direct Known Subclasses:

DenoisingAutoEncoderOptimizer, RBMOptimizer

public abstract class NeuralNetworkOptimizer
extends Object
implements cc.mallet.optimize.Optimizable.ByGradientValue, Serializable, NeuralNetEpochListener

Performs basic beam search based on the network's loss function

Author:

Adam Gibson

See Also:

Serialized Form

Nested Class Summary

Nested classes/interfaces inherited from interface cc.mallet.optimize.Optimizable

cc.mallet.optimize.Optimizable.ByBatchGradient, cc.mallet.optimize.Optimizable.ByCombiningBatchGradient, cc.mallet.optimize.Optimizable.ByGISUpdate, cc.mallet.optimize.Optimizable.ByGradient, cc.mallet.optimize.Optimizable.ByGradientValue, cc.mallet.optimize.Optimizable.ByHessian, cc.mallet.optimize.Optimizable.ByValue, cc.mallet.optimize.Optimizable.ByVotedPerceptron

Field Summary

Fields

Modifier and Type	Field and Description
protected List<Double>	errors
protected Object[]	extraParams
protected static org.slf4j.Logger	log
protected double	lr
protected double	minLearningRate
protected BaseNeuralNetwork	network
protected NonZeroStoppingConjugateGradient	opt
protected double	tolerance

Constructor Summary

Constructors

Constructor and Description
NeuralNetworkOptimizer(BaseNeuralNetwork network, double lr, Object[] trainingParams)

Method Summary

Methods

Modifier and Type	Method and Description
void	epochDone(int epoch)
List<Double>	getErrors()
int	getNumParameters()
double	getParameter(int index)
void	getParameters(double[] buffer)
double	getValue()
abstract void	getValueGradient(double[] buffer)
void	setParameter(int index, double value)
void	setParameters(double[] params)
void	train(org.jblas.DoubleMatrix x)

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Field Detail

network

protected BaseNeuralNetwork network

lr

protected double lr

extraParams

protected Object[] extraParams

tolerance

protected double tolerance

log

protected static org.slf4j.Logger log

errors

protected List<Double> errors

minLearningRate

protected double minLearningRate

opt

protected transient NonZeroStoppingConjugateGradient opt

Constructor Detail

NeuralNetworkOptimizer

public NeuralNetworkOptimizer(BaseNeuralNetwork network,
                      double lr,
                      Object[] trainingParams)

Method Detail

train

public void train(org.jblas.DoubleMatrix x)

epochDone

public void epochDone(int epoch)

Specified by:

epochDone in interface NeuralNetEpochListener

getErrors

public List<Double> getErrors()

getNumParameters

public int getNumParameters()

Specified by:

getNumParameters in interface cc.mallet.optimize.Optimizable

getParameters

public void getParameters(double[] buffer)

Specified by:

getParameters in interface cc.mallet.optimize.Optimizable

getParameter

public double getParameter(int index)

Specified by:

getParameter in interface cc.mallet.optimize.Optimizable

setParameters

public void setParameters(double[] params)

Specified by:

setParameters in interface cc.mallet.optimize.Optimizable

setParameter

public void setParameter(int index,
                double value)

Specified by:

setParameter in interface cc.mallet.optimize.Optimizable

getValueGradient

public abstract void getValueGradient(double[] buffer)

Specified by:

getValueGradient in interface cc.mallet.optimize.Optimizable.ByGradientValue

getValue

public double getValue()

Specified by:

getValue in interface cc.mallet.optimize.Optimizable.ByGradientValue