Adam
A popular optimizer that combines momentum with a separate step size for each parameter. In PyTorch you use it by swapping `SGD` for `torch.optim.Adam`.
A popular optimizer that combines momentum with a separate step size for each parameter. In PyTorch you use it by swapping `SGD` for `torch.optim.Adam`.