| Interface | Description |
|---|---|
| GradientUpdater |
Gradient modifications:
Calculates an update and tracks related
information for gradient changes over time
for handling updates.
|
| GradientUpdaterAggregator | Deprecated
Use Updater view array functionality instead
|
| Class | Description |
|---|---|
| AdaDelta |
http://www.matthewzeiler.com/pubs/googleTR2012/googleTR2012.pdf
https://arxiv.org/pdf/1212.5701v1.pdf
|
| AdaDelta.AdaDeltaAggregator | |
| AdaGrad |
Vectorized Learning Rate used per Connection Weight
Adapted from: http://xcorr.net/2014/01/23/adagrad-eliminating-learning-rates-in-stochastic-gradient-descent/
See also http://cs231n.github.io/neural-networks-3/#ada
|
| AdaGrad.AdaGradAggregator | |
| Adam |
The Adam updater.
|
| Adam.AdamAggregator | |
| Nesterovs |
Nesterov's momentum.
|
| Nesterovs.NesterovsAggregator | |
| NoOpUpdater |
Created by Alex on 08/09/2016.
|
| RmsProp |
RMS Prop updates:
|
| RmsProp.RmsPropAggregator | |
| Sgd | |
| Sgd.SgdAggregator |
Copyright © 2016. All Rights Reserved.