Execute the algorithm for given sequence of Δweight and sequence of weights
Execute the algorithm for given sequence of Δweight and sequence of weights
the sequence of accumulated Δweight
the sequence of current weights
Decay factor for L1 regularization
Decay factor for L1 regularization
Decay factor for L2 regularization
Decay factor for L2 regularization
Compute weight-loss of given weight parameters
Compute weight-loss of given weight parameters
the sequence of weight matrices
the total weight loss of this sequence
Trait that describes the algorithm for weight update
Because each weight update requires history, we recommend to make inherited one as a class.