Glossary: Computer Vision Beyond the Basics

Momentum

Also written: SGD, SGD with momentum

SGD (stochastic gradient descent) updates weights from each batch's gradient; momentum smooths those updates using past steps. It is torchvision's usual optimizer choice for detectors.