Glossary: ML in Production

A/B test

Also written: A/B testing, A/B release

An experiment where two groups get different versions, such as two models, for a few weeks and you compare business results. It answers questions like whether model B's calls save more subscribers per dollar.