Package | Description |
---|---|
org.deeplearning4j.optimize.solvers.accumulation.encoding.residual |
Class and Description |
---|
ResidualClippingPostProcessor
Residual clipping post processor clips the values of a residual every N iterations as follows:
For residual vector R, and C = thresholdMultipleClipValue, T is the current encoding threshold R[i] = C*T if R[i] > C*TR[i] = -C*T if R[i] < -C*TR[i] is unmodified otherwiseNote: Regarding the frequency, a value around 5 is suggested as a good balance between applying frequently enough, and minimizing the computational overhead. |
Copyright © 2019. All rights reserved.