Glossary: Statistical Inference and A/B Testing

Simpson's paradox

A comparison that reverses when data are split into groups. In a test, changing the traffic split midway can make B win each week yet lose when pooled.