Glossary: Statistical Inference and A/B Testing

One-sided, two-sided test

Also written: one-sided, two-sided, one-tailed, two-tailed

A two-sided test counts surprises in both directions; a one-sided test counts one direction and gives half the p-value. A/B tests should be two-sided unless one direction was fixed in advance.