Glossary: Statistical Inference and A/B Testing

Alpha (α)

Also written: significance level, alpha level

The threshold set in advance for calling a result significant, usually 0.05. It is also the share left outside a confidence interval, and the Type I error rate you accept.