org.deeplearning4j.da

Class DenoisingAutoEncoder

java.lang.Object

org.deeplearning4j.nn.BaseNeuralNetwork

org.deeplearning4j.da.DenoisingAutoEncoder

All Implemented Interfaces:

Serializable, Cloneable, NeuralNetwork, Persistable

public class DenoisingAutoEncoder
extends BaseNeuralNetwork
implements Serializable

Denoising Autoencoder. Add Gaussian noise to input and learn a reconstruction function.

Author:

Adam Gibson

See Also:

Serialized Form

Nested Class Summary

Nested Classes

Modifier and Type	Class and Description
static class	DenoisingAutoEncoder.Builder

Field Summary

Fields inherited from class org.deeplearning4j.nn.BaseNeuralNetwork

dist, fanIn, hBias, input, l2, momentum, nHidden, nVisible, optimizer, renderWeightsEveryNumEpochs, rng, sparsity, useRegularization, vBias, W

Constructor Summary

Constructors

Constructor and Description
DenoisingAutoEncoder()
DenoisingAutoEncoder(org.jblas.DoubleMatrix input, int nVisible, int nHidden, org.jblas.DoubleMatrix W, org.jblas.DoubleMatrix hbias, org.jblas.DoubleMatrix vbias, org.apache.commons.math3.random.RandomGenerator rng, double fanIn, org.apache.commons.math3.distribution.RealDistribution dist)
DenoisingAutoEncoder(int nVisible, int nHidden, org.jblas.DoubleMatrix W, org.jblas.DoubleMatrix hbias, org.jblas.DoubleMatrix vbias, org.apache.commons.math3.random.RandomGenerator rng, double fanIn)

Method Summary

Methods

Modifier and Type	Method and Description
org.jblas.DoubleMatrix	getCorruptedInput(org.jblas.DoubleMatrix x, double corruptionLevel) Corrupts the given input by doing a binomial sampling given the corruption level
NeuralNetworkGradient	getGradient(Object[] params)
org.jblas.DoubleMatrix	getHiddenValues(org.jblas.DoubleMatrix x)
org.jblas.DoubleMatrix	getReconstructedInput(org.jblas.DoubleMatrix y)
double	lossFunction(Object[] params) The loss function (cross entropy, reconstruction error,...)
double	negativeLoglikelihood(double corruptionLevel) Negative log likelihood of the current input given the corruption level
org.jblas.DoubleMatrix	reconstruct(org.jblas.DoubleMatrix x) All neural networks are based on this idea of minimizing reconstruction error.
void	train(org.jblas.DoubleMatrix x, double lr, double corruptionLevel) Perform one iteration of training
void	train(org.jblas.DoubleMatrix input, double lr, Object[] params) Train one iteration of the network
void	trainTillConvergence(org.jblas.DoubleMatrix x, double lr, double corruptionLevel) Run a network optimizer
void	trainTillConvergence(org.jblas.DoubleMatrix input, double lr, Object[] params)

Methods inherited from class org.deeplearning4j.nn.BaseNeuralNetwork

clone, fanIn, getDist, gethBias, getInput, getL2, getMomentum, getnHidden, getnVisible, getReConstructionCrossEntropy, getRenderEpochs, getRng, getSparsity, getvBias, getW, initWeights, jostleWeighMatrix, l2RegularizedCoefficient, load, lossFunction, merge, setDist, setFanIn, sethBias, setInput, setL2, setMomentum, setnHidden, setnVisible, setRenderEpochs, setRng, setSparsity, setvBias, setW, squaredLoss, transpose, update, write

Methods inherited from class java.lang.Object

equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Detail

DenoisingAutoEncoder

public DenoisingAutoEncoder()

DenoisingAutoEncoder

public DenoisingAutoEncoder(int nVisible,
                    int nHidden,
                    org.jblas.DoubleMatrix W,
                    org.jblas.DoubleMatrix hbias,
                    org.jblas.DoubleMatrix vbias,
                    org.apache.commons.math3.random.RandomGenerator rng,
                    double fanIn)

DenoisingAutoEncoder

public DenoisingAutoEncoder(org.jblas.DoubleMatrix input,
                    int nVisible,
                    int nHidden,
                    org.jblas.DoubleMatrix W,
                    org.jblas.DoubleMatrix hbias,
                    org.jblas.DoubleMatrix vbias,
                    org.apache.commons.math3.random.RandomGenerator rng,
                    double fanIn,
                    org.apache.commons.math3.distribution.RealDistribution dist)

Method Detail

getCorruptedInput

public org.jblas.DoubleMatrix getCorruptedInput(org.jblas.DoubleMatrix x,
                                       double corruptionLevel)

Corrupts the given input by doing a binomial sampling given the corruption level

Parameters:

x - the input to corrupt

corruptionLevel - the corruption value

Returns:

the binomial sampled corrupted input

negativeLoglikelihood

public double negativeLoglikelihood(double corruptionLevel)

Negative log likelihood of the current input given the corruption level

Parameters:

corruptionLevel - the corruption level to use

Returns:

the negative log likelihood of the auto encoder given the corruption level

getHiddenValues

public org.jblas.DoubleMatrix getHiddenValues(org.jblas.DoubleMatrix x)

getReconstructedInput

public org.jblas.DoubleMatrix getReconstructedInput(org.jblas.DoubleMatrix y)

trainTillConvergence

public void trainTillConvergence(org.jblas.DoubleMatrix x,
                        double lr,
                        double corruptionLevel)

Run a network optimizer

Parameters:

x - the input

lr - the learning rate

corruptionLevel - the corruption level

train

public void train(org.jblas.DoubleMatrix x,
         double lr,
         double corruptionLevel)

Perform one iteration of training

Parameters:

x - the input

lr - the learning rate

corruptionLevel - the corruption level to train with

reconstruct

public org.jblas.DoubleMatrix reconstruct(org.jblas.DoubleMatrix x)

Description copied from class: BaseNeuralNetwork

All neural networks are based on this idea of minimizing reconstruction error. Both RBMs and Denoising AutoEncoders have a component for reconstructing, ala different implementations.

Specified by:

reconstruct in class BaseNeuralNetwork

Parameters:

x - the input to reconstruct

Returns:

the reconstructed input

trainTillConvergence

public void trainTillConvergence(org.jblas.DoubleMatrix input,
                        double lr,
                        Object[] params)

Specified by:

trainTillConvergence in interface NeuralNetwork

lossFunction

public double lossFunction(Object[] params)

Description copied from class: BaseNeuralNetwork

The loss function (cross entropy, reconstruction error,...)

Specified by:

lossFunction in class BaseNeuralNetwork

Returns:

the loss function

train

public void train(org.jblas.DoubleMatrix input,
         double lr,
         Object[] params)

Description copied from class: BaseNeuralNetwork

Train one iteration of the network

Specified by:

train in interface NeuralNetwork

Specified by:

train in class BaseNeuralNetwork

Parameters:

input - the input to train on

lr - the learning rate to train at

params - the extra params (k, corruption level,...)

getGradient

public NeuralNetworkGradient getGradient(Object[] params)

Specified by:

getGradient in interface NeuralNetwork