A/A testing and false positives with CUPED
Marton Trencseni - Sun 15 August 2021 • Tagged with ab-testing, cuped
I use Monte Carlo simulations of A/A tests to demonstrate how Data Scientists can incorrectly skew lift and p-values if they pick-and-choose between reporting traditional and CUPED results after the experiment has concluded.