Article

Sylvia Jensen
Sylvia Jensen 27 May 2014

Guide to A/B Split Testing for Technophobes

A/B split testing marries creativity and data analytics to create more powerful, more effective campaigns.

A/B split testing marries creativity and data analytics to create more powerful, more effective campaigns – here’s everything you need to know.

 

 

A/B split testing used to be a niche skill, reserved for a few techie-types. But increased competition and a need for greater personalisation in marketing messages means that all marketers now need to be able to understand the techniques involved.

 

This quick guide will help you understand easily what A/B split testing is and why it is so important.

 

 

What is A/B split testing?

 

A/B split testing is a multi-stage process designed to improve the effectiveness of your marketing messages. A/B split testing can be performed on virtually any aspect of your marketing – take this example for an email message:

 

  1. You select an aspect of your message, such as the subject line, and create two different versions. You now have two, almost identical messages.
  2. You split one of your target groups in half to create two lists.
  3. You send one version of the email to the first list and the other version to the other list.

 

 

Just like any other email campaign, you collect and analyse statistics including

 

  • Click-through rates.
  • Open rates.
  • Conversion rates.
  • Unsubscribe rates.

 

 

“64% of people say they open an email because of the subject line.”

Business2Community

 

 

Once the data has been gathered, the key is to compare which of the two subject lines was the most successful. This insight can then be applied to your next campaign and another element of the message, such as the colour of the buttons or the length of the body text, can become part of the next cycle.

 

A/B split testing is iterative, a never-ending cycle of tuning and improvement intended to improve conversion rates at every possible opportunity. The techniques can also be applied to your social media, website design and any other aspect of your marketing.

 

 

“A/B testing for emails is one of the smartest moves because for every $1 spent, $44.25 is the average return on email marketing investment.”

Experian

 

 

Why does A/B split testing matter?

 

Because A/B split testing is focused on improving your messaging and communications for profit, no marketer can afford to ignore it any longer. Obama’s 2012 re-election campaign has become legendary for its use of A/B split testing to generate millions of dollars in donations.

 

 

“This was kind of revolutionary at the time and overall more than half of the $1 billion raised by the campaign came from online donations. This A/B testing probably resulted in $200 million in additional revenue.”

 

Amelia Showalter, director of digital analytics for the Obama 2012 campaign

 

 

The same A/B split testing techniques were applied to various aspects of Obama’s digital campaign including the campaign website. These insights were coupled with other big data analysis techniques to raise over $500 million in online donations.

 

Don’t forget, you can A/B split test any aspect of your digital marketing to try and gain a competitive advantage.

 

 

“Only a third of responding companies (32%) carry out a regular amount of testing for email marketing. One quarter of organisations say they infrequently carry out testing, while 13% don’t test at all.”

 

Econsultancy Email Marketing Census

 

 

What do you need to remember?

 

The most important things to remember about successful A/B split testing are:

 

  • A/B split testing can be applied to any aspect of your marketing.
  • A/B split testing is the marriage of creativity and data analytics – both are equally important.
  • The results of A/B split testing are often surprising and counterintuitive – never assume that an idea will not work without testing it first.
  • A/B split testing works best with a big subscriber list.
 
 

Get more tips and tricks on mastering digital marketing with our free eGuide: Defining the Modern Marketer: From Real to Ideal

 

Please login or register to add a comment.

Contribute Now!

Loving our articles? Do you have an insightful post that you want to shout about? Well, you've come to the right place! We are always looking for fresh Doughnuts to be a part of our community.

Popular Articles

See all
Digital Marketing Vs. Traditional Marketing: Which One Is Better?

Digital Marketing Vs. Traditional Marketing: Which One Is Better?

What's the difference between digital marketing and traditional marketing, and why does it matter? The answers may surprise you.

Julie Cave
Julie Cave 14 July 2016
Read more
4 Important Digital Marketing Channels You Should Know About

4 Important Digital Marketing Channels You Should Know About

It goes without saying that a company can't do without digital marketing in today's world.

Digital Doughnut Contributor
Digital Doughnut Contributor 5 November 2014
Read more
5 Off-Page Methods to Improve Your Page's Position on Google

5 Off-Page Methods to Improve Your Page's Position on Google

On-page SEO is one of the things that is on the mind of every website owner out there, and there is a good reason for that. It is one of the key factors based on which Google will rank your website, along with other factors, such as backlinks, or the quality of your content.

Joan Selby
Joan Selby 20 April 2017
Read more
How digital and direct mail became best friends

How digital and direct mail became best friends

The propaganda from digital marketeers said direct mail was dead. Now they’re retreating with their tails between their legs begging to be let back in. After all, the already powerful direct mail can have even more impact when paired with digital. But how are the digital natives returning to direct mail and why?

David Amor
David Amor 26 April 2017
Read more
5 essentials of an agile content contingency plan

5 essentials of an agile content contingency plan

Theresa May’s decision to call a snap election should be a wake up call to any organisation that isn’t able to respond to unpredictable events

Miles Kendall
Miles Kendall 24 April 2017
Read more