Interface | Description |
---|---|
IWeightInit |
Class | Description |
---|---|
WeightInitConstant | |
WeightInitDistribution | |
WeightInitIdentity | |
WeightInitLecunUniform |
Uniform U[-a,a] with a=3/sqrt(fanIn).
|
WeightInitNormal |
Normal/Gaussian distribution, with mean 0 and standard deviation 1/sqrt(fanIn).
|
WeightInitRelu | |
WeightInitReluUniform | |
WeightInitSigmoidUniform | |
WeightInitUniform | |
WeightInitUtil |
Weight initialization utility
|
WeightInitVarScalingNormalFanAvg | |
WeightInitVarScalingNormalFanIn | |
WeightInitVarScalingNormalFanOut | |
WeightInitVarScalingUniformFanAvg |
Uniform U[-a,a] with a=3.0/((fanIn + fanOut)/2)
|
WeightInitVarScalingUniformFanIn | |
WeightInitVarScalingUniformFanOut | |
WeightInitXavier | |
WeightInitXavierLegacy |
Xavier weight init in DL4J up to 0.6.0.
|
WeightInitXavierUniform |
As per Glorot and Bengio 2010: Uniform distribution U(-s,s) with s = sqrt(6/(fanIn + fanOut))
|
Enum | Description |
---|---|
WeightInit |
Copyright © 2021. All rights reserved.