Skip to content

Glossary: Calculus for ML

Gradient check

Also written: grad_check

Comparing your hand-derived gradients with numerical ones to catch backpropagation bugs. Such bugs otherwise fail silently, because the model still trains, just badly.

Where the book teaches it

Related terms

Relative errorNumerical derivativeBackpropagation