Skip to content

Glossary: Calculus for ML

Plateau

A flat stretch where the loss barely changes for many steps before falling again. It is common near saddle points.

Where the book teaches it

Related terms

Saddle pointMomentum