Glossary: Linear Algebra for ML
Activation function
Also written: activation
A simple bend applied after a neuron's dot product, such as ReLU or sigmoid. Without it, stacked layers would collapse into a single matrix.
Glossary: Linear Algebra for ML
Also written: activation
A simple bend applied after a neuron's dot product, such as ReLU or sigmoid. Without it, stacked layers would collapse into a single matrix.