Skip to content

Glossary: ML in Production

Holdout

Also written: held-out test set

Labeled data kept out of training and used only to evaluate. In retraining it is the newest labeled week, which the challenger didn't train on.

Where the book teaches it

Related terms

Paired bootstrapPromotion gate