A/B Testing in BlastWizard

From Boomerang Wiki

Jump to: navigation, search


Contents

What is A/B Testing?

A/B testing is a powerful feature that allows you to gain more insight into what works best with your email recipients. Using this feature, you will be able to randomly split your recipient list into 2 groups, A and B, then send two variations of your email blast to each of the two groups (like two different subject lines, for example). When done properly, you will be able to compare version A with version B and see which one had higher conversions like open rate, clickthrough rate, etc.

Here are some of the things that you will be able to vary when using this feature:

  1. Different subject lines in your email
  2. Varying the email message "Sender Name"
  3. Testing different offers or call to action (like "click here" or "learn more") in the body of your email
  4. Varying your landing pages



How does it work?

A/B split testing in BlastWizard is usually set up after the job has been queues under the Jobs>Pending tab. You could leave placeholders in your email creative where you want to vary content, then replace it with the generated merge code once your A/B test is set up. Here is how you do it.

  1. Decide what it is that you need to vary, either in the subject line or the body of your email message, that could potentially affect the outcome of your email blast.


  2. A/B Testing Setup

  3. Go to Jobs>Pending tab and select the job you want to test. Click on A/B Testing at the bottom to start the A/B test setup.


  4. Type in a word or a phrase in the Merge Field box (not exceeding 255 characters) that defines your variation, "Special Offer" is entered here in the screenshot above.


  5. Click on Edit in the table to enter your first variation. Type the text for your first variation under the Variation column, then enter the percentage (without % sign) in the Percentage column. Click on Update to save


  6. Add you other variation by clicking on Add Variation at the bottom right of the table. Type in your second variation and percentage, then hit Update.


  7. When done entering the variations and the percentages, click on Apply Variations to generate the variation merge code.


  8. Depending on where you want the variation to take effect, you can either check the box where it says "Replace subject line with merge code" to automatically merge the variation in the subject line or your email, or edit the document and replace your place holder with the variation merge code. Hit Back to apply variation.


Queued Job

Once the job is activated and sent out, BlastWizard will automatically merge the different offers based on random selection of recipients as defined in the percentages set in your test.


Please also check out A/B Testing FAQs.


Personal tools
FAQ