org.deeplearning4j.nn.conf.layers

Class BasePretrainNetwork

java.lang.Object

org.deeplearning4j.nn.conf.layers.Layer

org.deeplearning4j.nn.conf.layers.BaseLayer

org.deeplearning4j.nn.conf.layers.FeedForwardLayer

org.deeplearning4j.nn.conf.layers.BasePretrainNetwork

All Implemented Interfaces:

Serializable, Cloneable, TrainingConfig

Direct Known Subclasses:

AutoEncoder, VariationalAutoencoder

public abstract class BasePretrainNetwork
extends FeedForwardLayer

See Also:

Serialized Form

Nested Class Summary

Nested Classes

Modifier and Type	Class and Description
static class	BasePretrainNetwork.Builder<T extends BasePretrainNetwork.Builder<T>>

Field Summary

Fields

Modifier and Type	Field and Description
protected LossFunctions.LossFunction	lossFunction
protected boolean	pretrain
protected double	visibleBiasInit

Fields inherited from class org.deeplearning4j.nn.conf.layers.FeedForwardLayer

nIn, nOut

Fields inherited from class org.deeplearning4j.nn.conf.layers.BaseLayer

activationFn, biasInit, biasUpdater, dist, gradientNormalization, gradientNormalizationThreshold, iUpdater, l1, l1Bias, l2, l2Bias, weightInit, weightNoise

Fields inherited from class org.deeplearning4j.nn.conf.layers.Layer

constraints, iDropout, layerName

Constructor Summary

Constructors

Constructor and Description
BasePretrainNetwork(BasePretrainNetwork.Builder builder)

Method Summary

Modifier and Type	Method and Description
double	getL1ByParam(String paramName) Get the L1 coefficient for the given parameter.
double	getL2ByParam(String paramName) Get the L2 coefficient for the given parameter.
boolean	isPretrain()
boolean	isPretrainParam(String paramName) Is the specified parameter a layerwise pretraining only parameter? For example, visible bias params in an autoencoder (or, decoder params in a variational autoencoder) aren't used during supervised backprop. Layers (like DenseLayer, etc) with no pretrainable parameters will return false for all (valid) inputs.
void	setPretrain(boolean pretrain)

Methods inherited from class org.deeplearning4j.nn.conf.layers.FeedForwardLayer

getOutputType, getPreProcessorForInputType, setNIn

Methods inherited from class org.deeplearning4j.nn.conf.layers.BaseLayer

clone, getGradientNormalization, getUpdaterByParam, resetLayerDefaultConfig

Methods inherited from class org.deeplearning4j.nn.conf.layers.Layer

getMemoryReport, initializeConstraints, initializer, instantiate

Methods inherited from class java.lang.Object

equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Methods inherited from interface org.deeplearning4j.nn.api.TrainingConfig

getGradientNormalizationThreshold, getLayerName

Field Detail

lossFunction

protected LossFunctions.LossFunction lossFunction

visibleBiasInit

protected double visibleBiasInit

pretrain

protected boolean pretrain

Constructor Detail

BasePretrainNetwork

public BasePretrainNetwork(BasePretrainNetwork.Builder builder)

Method Detail

getL1ByParam

public double getL1ByParam(String paramName)

Description copied from class: Layer

Get the L1 coefficient for the given parameter. Different parameters may have different L1 values, even for a single .l1(x) configuration. For example, biases generally aren't L1 regularized, even if weights are

Specified by:

getL1ByParam in interface TrainingConfig

Overrides:

getL1ByParam in class FeedForwardLayer

Parameters:

paramName - Parameter name

Returns:

L1 value for that parameter

getL2ByParam

public double getL2ByParam(String paramName)

Description copied from class: Layer

Get the L2 coefficient for the given parameter. Different parameters may have different L2 values, even for a single .l2(x) configuration. For example, biases generally aren't L1 regularized, even if weights are

Specified by:

getL2ByParam in interface TrainingConfig

Overrides:

getL2ByParam in class FeedForwardLayer

Parameters:

paramName - Parameter name

Returns:

L2 value for that parameter

isPretrainParam

public boolean isPretrainParam(String paramName)

Description copied from class: Layer

Is the specified parameter a layerwise pretraining only parameter?
For example, visible bias params in an autoencoder (or, decoder params in a variational autoencoder) aren't used during supervised backprop.
Layers (like DenseLayer, etc) with no pretrainable parameters will return false for all (valid) inputs.

Specified by:

isPretrainParam in interface TrainingConfig

Overrides:

isPretrainParam in class FeedForwardLayer

Parameters:

paramName - Parameter name/key

Returns:

True if the parameter is for layerwise pretraining only, false otherwise

isPretrain

public boolean isPretrain()

Specified by:

isPretrain in interface TrainingConfig

Overrides:

isPretrain in class FeedForwardLayer

Returns:

True if the layer is set up for layerwise pretraining

setPretrain

public void setPretrain(boolean pretrain)

Specified by:

setPretrain in interface TrainingConfig

Overrides:

setPretrain in class Layer

Parameters:

pretrain - Whether the layer is currently undergoing layerwise unsupervised training, or multi-layer backprop