First derivative of the linear function
First derivative of the sigmoid function
First derivative of the rectified linear function
First derivative of the hyperbolic tangent function
Function which returns the appropriate activation for a given string
Function which returns the appropriate derivative activation for a given string
Linear/Identity Function
Sigmoid/Logistic function
Rectified linear Function
Hyperbolic tangent function