Five ways to reduce variance in A/B testing
Marton Trencseni - Sun 19 September 2021 • Tagged with ab-testing, variance, stratification, cuped
I use toy Monte Carlo simulations to demonstrate 5 ways to reduce variance in A/B testing: increase sample size, move towards a more even split, reduce variance in the metric definition, stratification and CUPED.
