Adam

Also written: Adam optimizer

An optimizer that keeps running averages of each parameter's gradient and its size, and scales each parameter's step separately. Its default learning rate of 0.001 makes it a common first choice.