Diverge

Also written: diverges, divergence

To grow out of control. With a learning rate that's too big, each gradient step overshoots and lands higher, so the numbers explode.