Modifier and Type | Method and Description |
---|---|
Gradient |
Model.gradient()
Get the gradient.
|
Modifier and Type | Method and Description |
---|---|
Pair<Gradient,INDArray> |
Layer.backpropGradient(INDArray epsilon,
LayerWorkspaceMgr workspaceMgr)
Calculate the gradient relative to the error in the next layer
|
Pair<Gradient,Double> |
Model.gradientAndScore()
Get the gradient and score
|
Modifier and Type | Method and Description |
---|---|
void |
Model.update(Gradient gradient)
Update layer weights and biases with gradient change
|
void |
Updater.update(Trainable layer,
Gradient gradient,
int iteration,
int epoch,
int miniBatchSize,
LayerWorkspaceMgr workspaceMgr)
Updater: updates the model
|
Modifier and Type | Method and Description |
---|---|
Pair<Gradient,INDArray> |
RecurrentLayer.tbpttBackpropGradient(INDArray epsilon,
int tbpttBackLength,
LayerWorkspaceMgr workspaceMgr)
Truncated BPTT equivalent of Layer.backpropGradient().
|
Modifier and Type | Class and Description |
---|---|
class |
DefaultGradient
Default gradient implementation.
|
Modifier and Type | Field and Description |
---|---|
protected Gradient |
ComputationGraph.gradient |
Modifier and Type | Method and Description |
---|---|
Gradient |
ComputationGraph.backpropGradient(INDArray... epsilons)
Calculate the gradient of the network with respect to some external errors.
|
Gradient |
ComputationGraph.gradient() |
Modifier and Type | Method and Description |
---|---|
Pair<Gradient,Double> |
ComputationGraph.gradientAndScore() |
Modifier and Type | Method and Description |
---|---|
void |
ComputationGraph.update(Gradient gradient) |
Modifier and Type | Method and Description |
---|---|
Pair<Gradient,INDArray[]> |
BaseWrapperVertex.doBackward(boolean tbptt,
LayerWorkspaceMgr workspaceMgr) |
Pair<Gradient,INDArray[]> |
GraphVertex.doBackward(boolean tbptt,
LayerWorkspaceMgr workspaceMgr)
Do backward pass
|
Modifier and Type | Method and Description |
---|---|
Pair<Gradient,INDArray[]> |
SubsetVertex.doBackward(boolean tbptt,
LayerWorkspaceMgr workspaceMgr) |
Pair<Gradient,INDArray[]> |
LayerVertex.doBackward(boolean tbptt,
LayerWorkspaceMgr workspaceMgr) |
Pair<Gradient,INDArray[]> |
PreprocessorVertex.doBackward(boolean tbptt,
LayerWorkspaceMgr workspaceMgr) |
Pair<Gradient,INDArray[]> |
StackVertex.doBackward(boolean tbptt,
LayerWorkspaceMgr workspaceMgr) |
Pair<Gradient,INDArray[]> |
MergeVertex.doBackward(boolean tbptt,
LayerWorkspaceMgr workspaceMgr) |
Pair<Gradient,INDArray[]> |
ElementWiseVertex.doBackward(boolean tbptt,
LayerWorkspaceMgr workspaceMgr) |
Pair<Gradient,INDArray[]> |
L2NormalizeVertex.doBackward(boolean tbptt,
LayerWorkspaceMgr workspaceMgr) |
Pair<Gradient,INDArray[]> |
ShiftVertex.doBackward(boolean tbptt,
LayerWorkspaceMgr workspaceMgr) |
Pair<Gradient,INDArray[]> |
ReshapeVertex.doBackward(boolean tbptt,
LayerWorkspaceMgr workspaceMgr) |
Pair<Gradient,INDArray[]> |
UnstackVertex.doBackward(boolean tbptt,
LayerWorkspaceMgr workspaceMgr) |
Pair<Gradient,INDArray[]> |
ScaleVertex.doBackward(boolean tbptt,
LayerWorkspaceMgr workspaceMgr) |
Pair<Gradient,INDArray[]> |
InputVertex.doBackward(boolean tbptt,
LayerWorkspaceMgr workspaceMgr) |
Pair<Gradient,INDArray[]> |
PoolHelperVertex.doBackward(boolean tbptt,
LayerWorkspaceMgr workspaceMgr) |
Pair<Gradient,INDArray[]> |
L2Vertex.doBackward(boolean tbptt,
LayerWorkspaceMgr workspaceMgr) |
Modifier and Type | Method and Description |
---|---|
Pair<Gradient,INDArray[]> |
ReverseTimeSeriesVertex.doBackward(boolean tbptt,
LayerWorkspaceMgr workspaceMgr) |
Pair<Gradient,INDArray[]> |
DuplicateToTimeSeriesVertex.doBackward(boolean tbptt,
LayerWorkspaceMgr workspaceMgr) |
Pair<Gradient,INDArray[]> |
LastTimeStepVertex.doBackward(boolean tbptt,
LayerWorkspaceMgr workspaceMgr) |
Modifier and Type | Field and Description |
---|---|
protected Gradient |
BaseLayer.gradient |
Modifier and Type | Method and Description |
---|---|
protected Gradient |
BasePretrainNetwork.createGradient(INDArray wGradient,
INDArray vBiasGradient,
INDArray hBiasGradient) |
Gradient |
LossLayer.gradient()
Gets the gradient from one training iteration
|
Gradient |
BaseLayer.gradient() |
Gradient |
FrozenLayer.gradient() |
Gradient |
RepeatVector.gradient() |
Gradient |
AbstractLayer.gradient() |
Gradient |
BaseOutputLayer.gradient()
Gets the gradient from one training iteration
|
Modifier and Type | Method and Description |
---|---|
void |
BaseLayer.update(Gradient gradient) |
void |
FrozenLayer.update(Gradient gradient) |
void |
AbstractLayer.update(Gradient gradient) |
void |
FrozenLayerWithBackprop.update(Gradient gradient) |
Modifier and Type | Method and Description |
---|---|
Gradient |
SpaceToBatch.gradient() |
Gradient |
SpaceToDepth.gradient() |
Modifier and Type | Method and Description |
---|---|
Gradient |
Subsampling3DLayer.gradient() |
Gradient |
SubsamplingLayer.gradient() |
Modifier and Type | Method and Description |
---|---|
Pair<Gradient,INDArray> |
SubsamplingHelper.backpropGradient(INDArray input,
INDArray epsilon,
int[] kernel,
int[] strides,
int[] pad,
PoolingType poolingType,
ConvolutionMode convolutionMode,
int[] dilation,
LayerWorkspaceMgr workspaceMgr) |
Pair<Gradient,INDArray> |
Subsampling3DLayer.backpropGradient(INDArray epsilon,
LayerWorkspaceMgr workspaceMgr) |
Pair<Gradient,INDArray> |
Subsampling1DLayer.backpropGradient(INDArray epsilon,
LayerWorkspaceMgr workspaceMgr) |
Pair<Gradient,INDArray> |
SubsamplingLayer.backpropGradient(INDArray epsilon,
LayerWorkspaceMgr workspaceMgr) |
Modifier and Type | Method and Description |
---|---|
Gradient |
Upsampling3D.gradient() |
Gradient |
Upsampling2D.gradient() |
Modifier and Type | Method and Description |
---|---|
Pair<Gradient,INDArray> |
Upsampling1D.backpropGradient(INDArray epsilon,
LayerWorkspaceMgr workspaceMgr) |
Pair<Gradient,INDArray> |
Upsampling3D.backpropGradient(INDArray epsilon,
LayerWorkspaceMgr workspaceMgr) |
Pair<Gradient,INDArray> |
Upsampling2D.backpropGradient(INDArray epsilon,
LayerWorkspaceMgr workspaceMgr) |
Modifier and Type | Method and Description |
---|---|
Pair<Gradient,INDArray> |
PReLU.backpropGradient(INDArray epsilon,
LayerWorkspaceMgr workspaceMgr) |
Modifier and Type | Method and Description |
---|---|
Pair<Gradient,INDArray> |
ElementWiseMultiplicationLayer.backpropGradient(INDArray epsilon,
LayerWorkspaceMgr workspaceMgr) |
Modifier and Type | Method and Description |
---|---|
Pair<Gradient,INDArray> |
EmbeddingLayer.backpropGradient(INDArray epsilon,
LayerWorkspaceMgr workspaceMgr) |
Pair<Gradient,INDArray> |
EmbeddingSequenceLayer.backpropGradient(INDArray epsilon,
LayerWorkspaceMgr workspaceMgr) |
Modifier and Type | Method and Description |
---|---|
Gradient |
BatchNormalization.gradient() |
Modifier and Type | Method and Description |
---|---|
Pair<Gradient,INDArray> |
LocalResponseNormalizationHelper.backpropGradient(INDArray input,
INDArray epsilon,
double k,
double n,
double alpha,
double beta,
LayerWorkspaceMgr workspaceMgr) |
Pair<Gradient,INDArray> |
BatchNormalizationHelper.backpropGradient(INDArray input,
INDArray epsilon,
int[] shape,
INDArray gamma,
INDArray dGammaView,
INDArray dBetaView,
double eps,
LayerWorkspaceMgr workspaceMgr) |
Pair<Gradient,INDArray> |
LocalResponseNormalization.backpropGradient(INDArray epsilon,
LayerWorkspaceMgr workspaceMgr) |
Pair<Gradient,INDArray> |
BatchNormalization.backpropGradient(INDArray epsilon,
LayerWorkspaceMgr workspaceMgr) |
Modifier and Type | Method and Description |
---|---|
Pair<Gradient,INDArray> |
Yolo2OutputLayer.backpropGradient(INDArray epsilon,
LayerWorkspaceMgr workspaceMgr) |
Pair<Gradient,Double> |
Yolo2OutputLayer.gradientAndScore() |
Modifier and Type | Method and Description |
---|---|
Pair<Gradient,INDArray> |
OCNNOutputLayer.backpropGradient(INDArray epsilon,
LayerWorkspaceMgr workspaceMgr) |
Modifier and Type | Method and Description |
---|---|
Pair<Gradient,INDArray> |
GlobalPoolingLayer.backpropGradient(INDArray epsilon,
LayerWorkspaceMgr workspaceMgr) |
Modifier and Type | Method and Description |
---|---|
Gradient |
LSTM.gradient() |
Gradient |
GravesLSTM.gradient()
Deprecated.
|
Gradient |
GravesBidirectionalLSTM.gradient() |
Gradient |
BidirectionalLayer.gradient() |
Modifier and Type | Method and Description |
---|---|
Pair<Gradient,INDArray> |
RnnLossLayer.backpropGradient(INDArray epsilon,
LayerWorkspaceMgr workspaceMgr) |
Pair<Gradient,INDArray> |
LSTM.backpropGradient(INDArray epsilon,
LayerWorkspaceMgr workspaceMgr) |
Pair<Gradient,INDArray> |
MaskZeroLayer.backpropGradient(INDArray epsilon,
LayerWorkspaceMgr workspaceMgr) |
Pair<Gradient,INDArray> |
GravesLSTM.backpropGradient(INDArray epsilon,
LayerWorkspaceMgr workspaceMgr)
Deprecated.
|
Pair<Gradient,INDArray> |
RnnOutputLayer.backpropGradient(INDArray epsilon,
LayerWorkspaceMgr workspaceMgr) |
Pair<Gradient,INDArray> |
GravesBidirectionalLSTM.backpropGradient(INDArray epsilon,
LayerWorkspaceMgr workspaceMgr) |
Pair<Gradient,INDArray> |
BidirectionalLayer.backpropGradient(INDArray epsilon,
LayerWorkspaceMgr workspaceMgr) |
Pair<Gradient,INDArray> |
LastTimeStepLayer.backpropGradient(INDArray epsilon,
LayerWorkspaceMgr workspaceMgr) |
Pair<Gradient,INDArray> |
SimpleRnn.backpropGradient(INDArray epsilon,
LayerWorkspaceMgr workspaceMgr) |
Pair<Gradient,INDArray> |
LSTMHelper.backpropGradient(NeuralNetConfiguration conf,
IActivation gateActivationFn,
INDArray input,
INDArray recurrentWeights,
INDArray inputWeights,
INDArray epsilon,
boolean truncatedBPTT,
int tbpttBackwardLength,
FwdPassReturn fwdPass,
boolean forwards,
String inputWeightKey,
String recurrentWeightKey,
String biasWeightKey,
Map<String,INDArray> gradientViews,
INDArray maskArray,
boolean hasPeepholeConnections,
LayerWorkspaceMgr workspaceMgr) |
static Pair<Gradient,INDArray> |
LSTMHelpers.backpropGradientHelper(NeuralNetConfiguration conf,
IActivation gateActivationFn,
INDArray input,
INDArray recurrentWeights,
INDArray inputWeights,
INDArray epsilon,
boolean truncatedBPTT,
int tbpttBackwardLength,
FwdPassReturn fwdPass,
boolean forwards,
String inputWeightKey,
String recurrentWeightKey,
String biasWeightKey,
Map<String,INDArray> gradientViews,
INDArray maskArray,
boolean hasPeepholeConnections,
LSTMHelper helper,
LayerWorkspaceMgr workspaceMgr) |
Pair<Gradient,Double> |
BidirectionalLayer.gradientAndScore() |
Pair<Gradient,INDArray> |
LSTM.tbpttBackpropGradient(INDArray epsilon,
int tbpttBackwardLength,
LayerWorkspaceMgr workspaceMgr) |
Pair<Gradient,INDArray> |
GravesLSTM.tbpttBackpropGradient(INDArray epsilon,
int tbpttBackwardLength,
LayerWorkspaceMgr workspaceMgr)
Deprecated.
|
Pair<Gradient,INDArray> |
GravesBidirectionalLSTM.tbpttBackpropGradient(INDArray epsilon,
int tbpttBackwardLength,
LayerWorkspaceMgr workspaceMgr) |
Pair<Gradient,INDArray> |
BidirectionalLayer.tbpttBackpropGradient(INDArray epsilon,
int tbpttBackLength,
LayerWorkspaceMgr workspaceMgr) |
Pair<Gradient,INDArray> |
SimpleRnn.tbpttBackpropGradient(INDArray epsilon,
int tbpttBackLength,
LayerWorkspaceMgr workspaceMgr) |
Modifier and Type | Method and Description |
---|---|
void |
BidirectionalLayer.update(Gradient gradient) |
Modifier and Type | Method and Description |
---|---|
Pair<Gradient,INDArray> |
SameDiffOutputLayer.backpropGradient(INDArray epsilon,
LayerWorkspaceMgr workspaceMgr) |
Pair<Gradient,INDArray> |
SameDiffLayer.backpropGradient(INDArray epsilon,
LayerWorkspaceMgr workspaceMgr) |
Pair<Gradient,INDArray[]> |
SameDiffGraphVertex.doBackward(boolean tbptt,
LayerWorkspaceMgr workspaceMgr) |
Modifier and Type | Method and Description |
---|---|
Gradient |
CenterLossOutputLayer.gradient()
Gets the gradient from one training iteration
|
Modifier and Type | Method and Description |
---|---|
Pair<Gradient,INDArray> |
CenterLossOutputLayer.backpropGradient(INDArray epsilon,
LayerWorkspaceMgr workspaceMgr) |
Pair<Gradient,Double> |
CenterLossOutputLayer.gradientAndScore() |
Modifier and Type | Method and Description |
---|---|
Pair<Gradient,INDArray> |
MaskLayer.backpropGradient(INDArray epsilon,
LayerWorkspaceMgr workspaceMgr) |
Modifier and Type | Field and Description |
---|---|
protected Gradient |
VariationalAutoencoder.gradient |
Modifier and Type | Method and Description |
---|---|
Gradient |
VariationalAutoencoder.gradient() |
Modifier and Type | Method and Description |
---|---|
Pair<Gradient,INDArray> |
VariationalAutoencoder.backpropGradient(INDArray epsilon,
LayerWorkspaceMgr workspaceMgr) |
Pair<Gradient,Double> |
VariationalAutoencoder.gradientAndScore() |
Modifier and Type | Method and Description |
---|---|
void |
VariationalAutoencoder.update(Gradient gradient) |
Modifier and Type | Method and Description |
---|---|
Gradient |
BaseWrapperLayer.gradient() |
Modifier and Type | Method and Description |
---|---|
Pair<Gradient,INDArray> |
BaseWrapperLayer.backpropGradient(INDArray epsilon,
LayerWorkspaceMgr workspaceMgr) |
Pair<Gradient,Double> |
BaseWrapperLayer.gradientAndScore() |
Modifier and Type | Method and Description |
---|---|
void |
BaseWrapperLayer.update(Gradient gradient) |
Modifier and Type | Field and Description |
---|---|
protected Gradient |
MultiLayerNetwork.gradient |
Modifier and Type | Method and Description |
---|---|
Gradient |
MultiLayerNetwork.gradient() |
Modifier and Type | Method and Description |
---|---|
Pair<Gradient,INDArray> |
MultiLayerNetwork.backpropGradient(INDArray epsilon,
LayerWorkspaceMgr workspaceMgr) |
protected Pair<Gradient,INDArray> |
MultiLayerNetwork.calcBackpropGradients(INDArray epsilon,
boolean withOutputLayer,
boolean tbptt,
boolean returnInputActGrad)
Calculate gradients and errors.
|
Pair<Gradient,INDArray> |
MultiLayerNetwork.calculateGradients(INDArray features,
INDArray label,
INDArray fMask,
INDArray labelMask)
Calculate parameter gradients and input activation gradients given the input and labels
|
Pair<Gradient,Double> |
MultiLayerNetwork.gradientAndScore() |
Modifier and Type | Method and Description |
---|---|
void |
MultiLayerNetwork.update(Gradient gradient) |
Modifier and Type | Method and Description |
---|---|
void |
BaseMultiLayerUpdater.preApply(Trainable layer,
Gradient gradient,
int iteration)
Pre-apply: Apply gradient normalization/clipping
|
void |
BaseMultiLayerUpdater.update(Gradient gradient,
int iteration,
int epoch,
int batchSize,
LayerWorkspaceMgr workspaceMgr)
Update the gradient for the model.
|
void |
BaseMultiLayerUpdater.update(Trainable layer,
Gradient gradient,
int iteration,
int epoch,
int batchSize,
LayerWorkspaceMgr workspaceMgr) |
Modifier and Type | Method and Description |
---|---|
Pair<Gradient,Double> |
ConvexOptimizer.gradientAndScore(LayerWorkspaceMgr workspaceMgr)
The gradient and score for this optimizer
|
Modifier and Type | Method and Description |
---|---|
void |
ConvexOptimizer.updateGradientAccordingToParams(Gradient gradient,
Model model,
int batchSize,
LayerWorkspaceMgr workspaceMgr)
Update the gradient according to the configuration such as adagrad, momentum, and sparsity
|
Modifier and Type | Method and Description |
---|---|
void |
ConvexOptimizer.setupSearchState(Pair<Gradient,Double> pair)
Based on the gradient and score
setup a search state
|
Modifier and Type | Method and Description |
---|---|
Pair<Gradient,Double> |
BaseOptimizer.gradientAndScore(LayerWorkspaceMgr workspaceMgr) |
Modifier and Type | Method and Description |
---|---|
void |
BaseOptimizer.updateGradientAccordingToParams(Gradient gradient,
Model model,
int batchSize,
LayerWorkspaceMgr workspaceMgr) |
Modifier and Type | Method and Description |
---|---|
void |
LBFGS.setupSearchState(Pair<Gradient,Double> pair) |
void |
BaseOptimizer.setupSearchState(Pair<Gradient,Double> pair)
Setup the initial search state
|
Copyright © 2018. All rights reserved.