Glossary: Calculus for ML
Also written: rectified linear unit
An activation function, max(0, z). Its slope is 1 where z > 0 and 0 elsewhere.
Activation functionTanh