Skip to content

Glossary: Linear Algebra for ML

ReLU (rectified linear unit)

Also written: ReLU, relu

An activation that keeps positive numbers and turns negative ones into 0: `np.maximum(0, z)`.

Where the book teaches it

Related terms

Activation functionNeuron