A/B Testing

A/B Testing

A/B Split Testing – your first test

This is the forth post in a series, you may want to read the previous posts first: part 1, part 2 and part 3. Now that we learned all about split testing you probably already want to test two designs of your web site to see if you can improve your sales (and if you don’t you should) but there’s one more small thing you should know before starting – what to test first. The first thing you need to test is your A/B testing software and your site, you do this by running your current design against...

A/B Split Testing – understanding the test results

This is the third post in the A/B testing series, you may want to read part 1 and part 2 first. So you started your test and after 10 visitors arrived to your site (5 in each group) 2 visitors from group B converted compared to just one from group A – the change improved conversion rate by 100% – time to party. Well, maybe it’s too early to party, just 10 visitors isn’t much and it’s possible those two customers arrived at the same group by accident, how do we know the next 3 visitors to group A won’t buy and...

A/B Split Testing – before you begin

Like anything in science there are some thing you need to know before running A/B tests, there are some basic things you have to get right or the whole test will be meaningless. As I said in the previous post A/B testing is done by dividing your visitors into two groups, we’ll call them A and B, and showing a different page to each group and than measure what group performed better, there are quite a few split testing tools out there and they should handle the technicalities I describe here automatically – but it’s important to know this in order...

A/B Split Testing – an introduction

Let’s imagine for a moment you run a web site, and that you make money from this web site somehow (for example selling time tracking software) – how can you improve the web site to increase your profits? One very common method is to blindly make changes to the site and hope for the best, sometimes it even work, but there got to be a better way. And that better way is A/B testing or split testing – in this method you show half the site visitors your old design while the other half get the new design – then you compare...