Glossary: Deep Learning Basics

Optimizer

Also written: optimizers, torch.optim

An object that updates a model's parameters from their gradients, at a given learning rate. Each step is `zero_grad`, forward and loss, `backward`, `step`.