A/B tests are extremely common, and their general concept is simple. However, as I’ve used this method more and more, things get more and more complicated. I wrote this article to talk about two mistakes I made along the way when running A/B tests.
Mistake 1. I didn’t estimate a test’s duration.
Reality: Estimating a test’s duration helps you use resources better
I still remember the very first AB test that I ran. It got a lot of attention from my company, and I often got this question “how long should we run this test for”. For a while, … Read the rest