For single instance and weights calculates gradient and loss.
For single instance and weights calculates gradient and loss. Depending on direction adds gradient and loss to the accumulated data.
Weights to evaluate gradient at
Featrues of instance to evaluate gradient at
Labels of the instance to evaluate gradient at
Update term to store gradient at
Loss vector to record resulting loss values.
Adds L2 regularization part to the gradient and loss.
Adds L2 regularization part to the gradient and loss.
Apply L1 shrinkage to the updated weights.
Apply L1 shrinkage to the updated weights.
Given L1 regularization config create a vector with per-label reg param (by default - constant).
Given L1 regularization config create a vector with per-label reg param (by default - constant).
Given L2 regularization config create a vector with per-label reg param (by default - constant).
Given L2 regularization config create a vector with per-label reg param (by default - constant).
Utility used to split weights matrice into label -> vector map
Utility used to split weights matrice into label -> vector map
Given labels info and weights matrice create appropriate ML models.
Given labels info and weights matrice create appropriate ML models.
Extracts a single row from a matrice.
Extracts a single row from a matrice.
Extracts summary blocks from iterations loss history.
Extracts summary blocks from iterations loss history.
Extracts not converged labels based on actual and previous weights and on the loss history.
Extracts not converged labels based on actual and previous weights and on the loss history.
Evaluates loss difference simply as relative change
Evaluates loss difference simply as relative change
Merges weights from the new epoch with overal weights.
Merges weights from the new epoch with overal weights. Dimensions of weights matrices might be different when part of labels are already converged and do not participate in descend.
Used to preserve only active (not yet converged) labels into a vector
Used to preserve only active (not yet converged) labels into a vector
Used to preserve only active (not yet converged) labels into a matrix
Used to preserve only active (not yet converged) labels into a matrix
Single epoch of the descend
Single epoch of the descend
Data with features and labels
Weghts matrix to start with.
Average weights among walked during previous epoch.
Average gradient among seen during previous epoch.
Vector with the strength of L1 regularization (null if disabled)
Vector with the strength of L2 regularization (null if disabled)
Number of epoch
State with weights, averages and loss from this epoch
Updates the weights given update term and current value.
Updates the weights given update term and current value.
Evaluates weight norm for a given label.
Evaluates weight norm for a given label.
Weights matrix
Label to evaluate weights
Weights norm.
Evaluates weight distance based on old and new weights images.
Evaluates weight distance based on old and new weights images.
Weights from the previous epoch
Weights from the current epoch.
Label to check for convergence.
Distance between old and new weights.
Multi-label linear regresion with DSVRGD