Article

Sylvia Jensen
Sylvia Jensen 27 May 2014

Guide to A/B Split Testing for Technophobes

A/B split testing marries creativity and data analytics to create more powerful, more effective campaigns.

A/B split testing marries creativity and data analytics to create more powerful, more effective campaigns – here’s everything you need to know.

 

 

A/B split testing used to be a niche skill, reserved for a few techie-types. But increased competition and a need for greater personalisation in marketing messages means that all marketers now need to be able to understand the techniques involved.

 

This quick guide will help you understand easily what A/B split testing is and why it is so important.

 

 

What is A/B split testing?

 

A/B split testing is a multi-stage process designed to improve the effectiveness of your marketing messages. A/B split testing can be performed on virtually any aspect of your marketing – take this example for an email message:

 

  1. You select an aspect of your message, such as the subject line, and create two different versions. You now have two, almost identical messages.
  2. You split one of your target groups in half to create two lists.
  3. You send one version of the email to the first list and the other version to the other list.

 

 

Just like any other email campaign, you collect and analyse statistics including

 

  • Click-through rates.
  • Open rates.
  • Conversion rates.
  • Unsubscribe rates.

 

 

“64% of people say they open an email because of the subject line.”

Business2Community

 

 

Once the data has been gathered, the key is to compare which of the two subject lines was the most successful. This insight can then be applied to your next campaign and another element of the message, such as the colour of the buttons or the length of the body text, can become part of the next cycle.

 

A/B split testing is iterative, a never-ending cycle of tuning and improvement intended to improve conversion rates at every possible opportunity. The techniques can also be applied to your social media, website design and any other aspect of your marketing.

 

 

“A/B testing for emails is one of the smartest moves because for every $1 spent, $44.25 is the average return on email marketing investment.”

Experian

 

 

Why does A/B split testing matter?

 

Because A/B split testing is focused on improving your messaging and communications for profit, no marketer can afford to ignore it any longer. Obama’s 2012 re-election campaign has become legendary for its use of A/B split testing to generate millions of dollars in donations.

 

 

“This was kind of revolutionary at the time and overall more than half of the $1 billion raised by the campaign came from online donations. This A/B testing probably resulted in $200 million in additional revenue.”

 

Amelia Showalter, director of digital analytics for the Obama 2012 campaign

 

 

The same A/B split testing techniques were applied to various aspects of Obama’s digital campaign including the campaign website. These insights were coupled with other big data analysis techniques to raise over $500 million in online donations.

 

Don’t forget, you can A/B split test any aspect of your digital marketing to try and gain a competitive advantage.

 

 

“Only a third of responding companies (32%) carry out a regular amount of testing for email marketing. One quarter of organisations say they infrequently carry out testing, while 13% don’t test at all.”

 

Econsultancy Email Marketing Census

 

 

What do you need to remember?

 

The most important things to remember about successful A/B split testing are:

 

  • A/B split testing can be applied to any aspect of your marketing.
  • A/B split testing is the marriage of creativity and data analytics – both are equally important.
  • The results of A/B split testing are often surprising and counterintuitive – never assume that an idea will not work without testing it first.
  • A/B split testing works best with a big subscriber list.
 
 

Get more tips and tricks on mastering digital marketing with our free eGuide: Defining the Modern Marketer: From Real to Ideal

 

Please login or register to add a comment.

Contribute Now!

Loving our articles? Do you have an insightful post that you want to shout about? Well, you've come to the right place! We are always looking for fresh Doughnuts to be a part of our community.

Popular Articles

See all
Digital Marketing Vs. Traditional Marketing: Which One Is Better?

Digital Marketing Vs. Traditional Marketing: Which One Is Better?

What's the difference between digital marketing and traditional marketing, and why does it matter? The answers may surprise you.

Julie Cave
Julie Cave 14 July 2016
Read more
4 Important Digital Marketing Channels You Should Know About

4 Important Digital Marketing Channels You Should Know About

It goes without saying that a company can't do without digital marketing in today's world.

Digital Doughnut Contributor
Digital Doughnut Contributor 5 November 2014
Read more
How To Write Content That’s Easy To Localize

How To Write Content That’s Easy To Localize

Do you want to know how to reduce costs and get to market faster? Write content that's easy to localize!

David Ost
David Ost 15 June 2017
Read more
The Difference Between AI and Machine Learning

The Difference Between AI and Machine Learning

Artificial Intelligence (AI) and Machine Learning used to be heard when the topic was Big Data Analytics – and maybe in some sci-fi movies- before; but now it is impossible to ignore them with the self-driving cars, knowledge navigators...

Asena Atilla Saunders
Asena Atilla Saunders 15 June 2017
Read more
How To Master Localized SEO

How To Master Localized SEO

When you’re rolling out different language versions of your website, ignore localized SEO at your peril. Failing to consider local keywords, backlinks and social media could cost you valuable site visitors. You’re investing a lot of marketing budget in reaching out to new clients. But fail to get eyes on your website and your efforts will be in vain.

David Ost
David Ost 14 June 2017
Read more