Skip to content

Glossary: Calculus for ML

ReLU

Also written: rectified linear unit

An activation function, max(0, z). Its slope is 1 where z > 0 and 0 elsewhere.

Where the book teaches it

Related terms

Activation functionTanh