| Class | Description |
|---|---|
| WeightInitUtil |
Weight initialization utility
|
| Enum | Description |
|---|---|
| WeightInit |
Weight initialization scheme
Distribution: Sample weights from a distribution based on shape of input
Normalized: Normalize sample weights
Size: Sample weights from bound uniform distribution using shape for min and max
Uniform: Sample weights from bound uniform distribution (specify min and max)
VI: Sample weights from variance normalized initialization (Glorot)
Zeros: Generate weights as zeros
Xavier:
RELU: N(0,2/nIn): He et al.
|
Copyright © 2016. All Rights Reserved.