Offline eval / online eval

Also written: eval, evals, test set

Offline evals score a model or prompt on a saved test set before release. Online evals grade samples of live traffic after release.