org.deeplearning4j.optimize

Class NeuralNetworkOptimizer

java.lang.Object

org.deeplearning4j.optimize.NeuralNetworkOptimizer

All Implemented Interfaces:

cc.mallet.optimize.Optimizable, cc.mallet.optimize.Optimizable.ByGradientValue, Serializable, NeuralNetEpochListener, OptimizableByGradientValueMatrix

Direct Known Subclasses:

DenoisingAutoEncoderOptimizer, RBMOptimizer

public abstract class NeuralNetworkOptimizer
extends Object
implements cc.mallet.optimize.Optimizable.ByGradientValue, OptimizableByGradientValueMatrix, Serializable, NeuralNetEpochListener

Performs basic beam search based on the network's loss function

Author:

Adam Gibson

See Also:

Serialized Form

Nested Class Summary

Nested classes/interfaces inherited from interface cc.mallet.optimize.Optimizable

cc.mallet.optimize.Optimizable.ByBatchGradient, cc.mallet.optimize.Optimizable.ByCombiningBatchGradient, cc.mallet.optimize.Optimizable.ByGISUpdate, cc.mallet.optimize.Optimizable.ByGradient, cc.mallet.optimize.Optimizable.ByGradientValue, cc.mallet.optimize.Optimizable.ByHessian, cc.mallet.optimize.Optimizable.ByValue, cc.mallet.optimize.Optimizable.ByVotedPerceptron

Field Summary

Fields

Modifier and Type	Field and Description
protected List<Double>	errors
protected Object[]	extraParams
protected static org.slf4j.Logger	log
protected NeuralNetwork.LossFunction	lossFunction
protected double	lr
protected double	minLearningRate
protected NeuralNetwork	network
protected OptimizerMatrix	opt
protected NeuralNetwork.OptimizationAlgorithm	optimizationAlgorithm
protected double	tolerance

Constructor Summary

Constructors

Constructor and Description
NeuralNetworkOptimizer(NeuralNetwork network, double lr, Object[] trainingParams, NeuralNetwork.OptimizationAlgorithm optimizationAlgorithm, NeuralNetwork.LossFunction lossFunction)

Method Summary

Methods

Modifier and Type	Method and Description
void	epochDone(int epoch) Event listener for each iteration
List<Double>	getErrors()
int	getNumParameters()
double	getParameter(int index)
org.jblas.DoubleMatrix	getParameters()
void	getParameters(double[] buffer)
double	getTolerance()
double	getValue()
org.jblas.DoubleMatrix	getValueGradient()
abstract void	getValueGradient(double[] buffer)
void	setParameter(int index, double value)
void	setParameters(double[] params)
void	setParameters(org.jblas.DoubleMatrix params)
void	setTolerance(double tolerance)
void	train(org.jblas.DoubleMatrix x)

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Field Detail

network

protected NeuralNetwork network

lr

protected double lr

extraParams

protected Object[] extraParams

tolerance

protected double tolerance

log

protected static org.slf4j.Logger log

errors

protected List<Double> errors

minLearningRate

protected double minLearningRate

opt

protected transient OptimizerMatrix opt

optimizationAlgorithm

protected NeuralNetwork.OptimizationAlgorithm optimizationAlgorithm

lossFunction

protected NeuralNetwork.LossFunction lossFunction

Constructor Detail

NeuralNetworkOptimizer

public NeuralNetworkOptimizer(NeuralNetwork network,
                      double lr,
                      Object[] trainingParams,
                      NeuralNetwork.OptimizationAlgorithm optimizationAlgorithm,
                      NeuralNetwork.LossFunction lossFunction)

Parameters:

network -

lr -

trainingParams -

Method Detail

train

public void train(org.jblas.DoubleMatrix x)

epochDone

public void epochDone(int epoch)

Description copied from interface: NeuralNetEpochListener

Event listener for each iteration

Specified by:

epochDone in interface NeuralNetEpochListener

getErrors

public List<Double> getErrors()

getNumParameters

public int getNumParameters()

Specified by:

getNumParameters in interface cc.mallet.optimize.Optimizable

Specified by:

getNumParameters in interface OptimizableByGradientValueMatrix

getParameters

public void getParameters(double[] buffer)

Specified by:

getParameters in interface cc.mallet.optimize.Optimizable

getParameter

public double getParameter(int index)

Specified by:

getParameter in interface cc.mallet.optimize.Optimizable

Specified by:

getParameter in interface OptimizableByGradientValueMatrix

setParameters

public void setParameters(double[] params)

Specified by:

setParameters in interface cc.mallet.optimize.Optimizable

setParameter

public void setParameter(int index,
                double value)

Specified by:

setParameter in interface cc.mallet.optimize.Optimizable

Specified by:

setParameter in interface OptimizableByGradientValueMatrix

getParameters

public org.jblas.DoubleMatrix getParameters()

Specified by:

getParameters in interface OptimizableByGradientValueMatrix

setParameters

public void setParameters(org.jblas.DoubleMatrix params)

Specified by:

setParameters in interface OptimizableByGradientValueMatrix

getValueGradient

public org.jblas.DoubleMatrix getValueGradient()

Specified by:

getValueGradient in interface OptimizableByGradientValueMatrix

getValueGradient

public abstract void getValueGradient(double[] buffer)

Specified by:

getValueGradient in interface cc.mallet.optimize.Optimizable.ByGradientValue

getValue

public double getValue()

Specified by:

getValue in interface cc.mallet.optimize.Optimizable.ByGradientValue

Specified by:

getValue in interface OptimizableByGradientValueMatrix

getTolerance

public double getTolerance()

setTolerance

public void setTolerance(double tolerance)