Article

Sylvia Jensen
Sylvia Jensen 27 May 2014

Guide to A/B Split Testing for Technophobes

A/B split testing marries creativity and data analytics to create more powerful, more effective campaigns.

A/B split testing marries creativity and data analytics to create more powerful, more effective campaigns – here’s everything you need to know.

 

 

A/B split testing used to be a niche skill, reserved for a few techie-types. But increased competition and a need for greater personalisation in marketing messages means that all marketers now need to be able to understand the techniques involved.

 

This quick guide will help you understand easily what A/B split testing is and why it is so important.

 

 

What is A/B split testing?

 

A/B split testing is a multi-stage process designed to improve the effectiveness of your marketing messages. A/B split testing can be performed on virtually any aspect of your marketing – take this example for an email message:

 

  1. You select an aspect of your message, such as the subject line, and create two different versions. You now have two, almost identical messages.
  2. You split one of your target groups in half to create two lists.
  3. You send one version of the email to the first list and the other version to the other list.

 

 

Just like any other email campaign, you collect and analyse statistics including

 

  • Click-through rates.
  • Open rates.
  • Conversion rates.
  • Unsubscribe rates.

 

 

“64% of people say they open an email because of the subject line.”

Business2Community

 

 

Once the data has been gathered, the key is to compare which of the two subject lines was the most successful. This insight can then be applied to your next campaign and another element of the message, such as the colour of the buttons or the length of the body text, can become part of the next cycle.

 

A/B split testing is iterative, a never-ending cycle of tuning and improvement intended to improve conversion rates at every possible opportunity. The techniques can also be applied to your social media, website design and any other aspect of your marketing.

 

 

“A/B testing for emails is one of the smartest moves because for every $1 spent, $44.25 is the average return on email marketing investment.”

Experian

 

 

Why does A/B split testing matter?

 

Because A/B split testing is focused on improving your messaging and communications for profit, no marketer can afford to ignore it any longer. Obama’s 2012 re-election campaign has become legendary for its use of A/B split testing to generate millions of dollars in donations.

 

 

“This was kind of revolutionary at the time and overall more than half of the $1 billion raised by the campaign came from online donations. This A/B testing probably resulted in $200 million in additional revenue.”

 

Amelia Showalter, director of digital analytics for the Obama 2012 campaign

 

 

The same A/B split testing techniques were applied to various aspects of Obama’s digital campaign including the campaign website. These insights were coupled with other big data analysis techniques to raise over $500 million in online donations.

 

Don’t forget, you can A/B split test any aspect of your digital marketing to try and gain a competitive advantage.

 

 

“Only a third of responding companies (32%) carry out a regular amount of testing for email marketing. One quarter of organisations say they infrequently carry out testing, while 13% don’t test at all.”

 

Econsultancy Email Marketing Census

 

 

What do you need to remember?

 

The most important things to remember about successful A/B split testing are:

 

  • A/B split testing can be applied to any aspect of your marketing.
  • A/B split testing is the marriage of creativity and data analytics – both are equally important.
  • The results of A/B split testing are often surprising and counterintuitive – never assume that an idea will not work without testing it first.
  • A/B split testing works best with a big subscriber list.
 
 

Get more tips and tricks on mastering digital marketing with our free eGuide: Defining the Modern Marketer: From Real to Ideal

 

Please login or register to add a comment.

Contribute Now!

Loving our articles? Do you have an insightful post that you want to shout about? Well, you've come to the right place! We are always looking for fresh Doughnuts to be a part of our community.

Popular Articles

See all
7 reasons why social media marketing is important for your business

7 reasons why social media marketing is important for your business

Social media is quickly becoming one of the most important aspects of digital marketing, which provides incredible benefits that help reach millions of customers worldwide. And if you are not applying this profitable...

Sharron Nelson
Sharron Nelson 6 February 2018
Read more
‘Complainer marketing’ – should we harness rage to promote brands?

‘Complainer marketing’ – should we harness rage to promote brands?

As marketers, we're always looking to get the best results for our clients. But should we highjack the emotions of their customers to do so? No, as I explain in this post, you're better than that.

Tom Chapman
Tom Chapman 18 July 2018
Read more
8 Digital Marketing Trends to Watch in 2023

8 Digital Marketing Trends to Watch in 2023

The internet has conditioned customers to demand instant gratification, and that’s only set to continue. In 2023, customers will expect a response time of just hours. No more sending an email and waiting days for a...

Azeem Adam
Azeem Adam 3 May 2022
Read more
Deep Link vs. Universal Link: Which One is Better?

Deep Link vs. Universal Link: Which One is Better?

Are universal link and deep link the same thing? There are some big differences, let's understand them.

Stefano Pisoni
Stefano Pisoni 17 March 2020
Read more
The Impact of New Technology on Marketing

The Impact of New Technology on Marketing

Technology has impacted every part of our lives. From household chores to business disciplines and etiquette, there's a gadget or app for it. Marketing has changed dramatically over the years, but what is the...

Alex Lysak
Alex Lysak 22 September 2020
Read more