org.deeplearning4j.nn.conf.layers

Class AbstractLSTM

java.lang.Object

org.deeplearning4j.nn.conf.layers.Layer

org.deeplearning4j.nn.conf.layers.BaseLayer

org.deeplearning4j.nn.conf.layers.FeedForwardLayer

org.deeplearning4j.nn.conf.layers.BaseRecurrentLayer

org.deeplearning4j.nn.conf.layers.AbstractLSTM

All Implemented Interfaces:

Serializable, Cloneable, TrainingConfig

Direct Known Subclasses:

GravesLSTM, LSTM

public abstract class AbstractLSTM
extends BaseRecurrentLayer

LSTM recurrent net, based on Graves: Supervised Sequence Labelling with Recurrent Neural Networks http://www.cs.toronto.edu/~graves/phd.pdf

See Also:

Serialized Form

Nested Class Summary

Nested Classes

Modifier and Type	Class and Description
static class	AbstractLSTM.Builder<T extends AbstractLSTM.Builder<T>>

Field Summary

Fields

Modifier and Type	Field and Description
protected double	forgetGateBiasInit
protected IActivation	gateActivationFn

Fields inherited from class org.deeplearning4j.nn.conf.layers.BaseRecurrentLayer

distRecurrent, weightInitRecurrent

Fields inherited from class org.deeplearning4j.nn.conf.layers.FeedForwardLayer

nIn, nOut

Fields inherited from class org.deeplearning4j.nn.conf.layers.BaseLayer

activationFn, biasInit, biasUpdater, dist, gradientNormalization, gradientNormalizationThreshold, iUpdater, l1, l1Bias, l2, l2Bias, weightInit, weightNoise

Fields inherited from class org.deeplearning4j.nn.conf.layers.Layer

constraints, iDropout, layerName

Constructor Summary

Constructors

Modifier	Constructor and Description
protected	AbstractLSTM(AbstractLSTM.Builder builder)

Method Summary

Modifier and Type	Method and Description
double	getL1ByParam(String paramName) Get the L1 coefficient for the given parameter.
double	getL2ByParam(String paramName) Get the L2 coefficient for the given parameter.

Methods inherited from class org.deeplearning4j.nn.conf.layers.BaseRecurrentLayer

getOutputType, getPreProcessorForInputType, isPretrain, setNIn

Methods inherited from class org.deeplearning4j.nn.conf.layers.FeedForwardLayer

isPretrainParam

Methods inherited from class org.deeplearning4j.nn.conf.layers.BaseLayer

clone, getGradientNormalization, getUpdaterByParam, resetLayerDefaultConfig

Methods inherited from class org.deeplearning4j.nn.conf.layers.Layer

getMemoryReport, initializeConstraints, initializer, instantiate, setPretrain

Methods inherited from class java.lang.Object

equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Methods inherited from interface org.deeplearning4j.nn.api.TrainingConfig

getGradientNormalizationThreshold, getLayerName

Field Detail

forgetGateBiasInit

protected double forgetGateBiasInit

gateActivationFn

protected IActivation gateActivationFn

Constructor Detail

AbstractLSTM

protected AbstractLSTM(AbstractLSTM.Builder builder)

Method Detail

getL1ByParam

public double getL1ByParam(String paramName)

Description copied from class: Layer

Get the L1 coefficient for the given parameter. Different parameters may have different L1 values, even for a single .l1(x) configuration. For example, biases generally aren't L1 regularized, even if weights are

Specified by:

getL1ByParam in interface TrainingConfig

Overrides:

getL1ByParam in class FeedForwardLayer

Parameters:

paramName - Parameter name

Returns:

L1 value for that parameter

getL2ByParam

public double getL2ByParam(String paramName)

Description copied from class: Layer

Get the L2 coefficient for the given parameter. Different parameters may have different L2 values, even for a single .l2(x) configuration. For example, biases generally aren't L1 regularized, even if weights are

Specified by:

getL2ByParam in interface TrainingConfig

Overrides:

getL2ByParam in class FeedForwardLayer

Parameters:

paramName - Parameter name

Returns:

L2 value for that parameter