ECE (expected calibration error)

Also written: ECE, expected calibration error

One number that summarizes a reliability table: the gap between predicted and observed rate in each bin, weighted by the share of predictions in that bin. Lower is better.