AdamW
An optimizer that updates a model's weights during training. It is Adam with weight decay applied separately from the gradient step, which usually generalizes better.
An optimizer that updates a model's weights during training. It is Adam with weight decay applied separately from the gradient step, which usually generalizes better.