Activation function

Also written: activation, activations

A function applied to each number a layer outputs, bending it so stacked layers can learn curves. Without activations, many layers collapse into one linear layer.