Skip to content

Glossary: Calculus for ML

Backpropagation

Also written: backprop, backward pass

The chain rule applied backward through a network's layers, one local derivative at a time, to get the gradient for every parameter. Alex's cold brew network is trained this way.

Where the book teaches it

Related terms

Chain ruleComputation graphLocal derivativeAutomatic differentiation (autodiff)