AdamW

A version of the Adam optimizer that applies weight decay directly to the weights, shrinking them slightly at each step, instead of adding an L2 penalty to the gradient. It is used to regularize neural networks and reduce overfitting.