Glossary: Probability for ML

Underflow

Also written: overflow

When a number is too small for the computer to store and becomes 0.0. Multiplying thousands of small probabilities underflows, so their logs are summed instead; overflow is the opposite problem of numbers too big to store, such as e¹⁰⁰⁰.