Optimizer
Also written: torch.optim.SGD, opt.step, zero_grad
An object that applies an update rule to a list of parameters, such as `torch.optim.SGD` doing plain gradient descent. Each training step calls `zero_grad`, then `backward`, then `step`.
Also written: torch.optim.SGD, opt.step, zero_grad
An object that applies an update rule to a list of parameters, such as `torch.optim.SGD` doing plain gradient descent. Each training step calls `zero_grad`, then `backward`, then `step`.