Skip to content

Glossary: Calculus for ML

Automatic differentiation (autodiff)

Also written: autodiff, automatic differentiation, autograd

A way to get exact gradients without writing formulas. The library records every operation as your code runs, then runs the chain rule backward through that record.

Where the book teaches it

Related terms

Reverse modeComputation graphBackpropagationPyTorch