Glossary: Probability for ML

Bits, nats

Also written: bit, nat, bits, nats

Units for measuring entropy. Using base-2 logs gives bits, and using natural logs gives nats, which ML libraries use.