Glossary: Linear Algebra for ML
ReLU (rectified linear unit)
Also written: ReLU, relu
An activation that keeps positive numbers and turns negative ones into 0: `np.maximum(0, z)`.
Glossary: Linear Algebra for ML
Also written: ReLU, relu
An activation that keeps positive numbers and turns negative ones into 0: `np.maximum(0, z)`.