This is the third post in the A/B testing series, you may want to read part 1 and part 2 first.
So you started your test and after 10 visitors arrived to your site (5 in each group) 2 visitors from group B converted compared to just one from group A – the change improved conversion rate by 100% – time to party.
Well, maybe it’s too early to party, just 10 visitors isn’t much and it’s possible those two customers arrived at the same group by accident, how do we know the next 3 visitors to group A won’t buy and...