Creates a model of Affine layer
Creates a model of Affine layer
layer properties
vector for weights initialization
random number generator
model of Affine layer
Initialize weights randomly in the interval.
Initialize weights randomly in the interval.
Uses [Bottou-88] heuristic [-a/sqrt(in); a/sqrt(in)],
where a
is chosen in such a way that the weight variance corresponds
to the points to the maximal curvature of the activation function
(which is approximately 2.38 for a standard sigmoid).
number of inputs
number of outputs
vector for weights initialization
random number generator
Fabric for Affine layer models