Glossary: Statistical Inference and A/B Testing

Confidence level

Also written: 95% confidence

The share of samples for which the interval-building method would capture the true value, such as 90%, 95% or 99%. A higher confidence level gives a wider interval, and 95% (alpha 0.05) is the usual convention.