What is A/B Testing?

From Boomerang Wiki

Jump to: navigation, search

Question

What is A/B Testing? How do I use it?

Answer

Blastwizard’s makes AB testing simple to facilitate at the job level. AB Testing can be performed on subject lines or any other field in your document. If you’re familiar with BlastWizard you would go through the regular job scheduling process. Before activating your job click on “A/B Tesing” on the Pending Jobs page. Choose alternate subject lines to test and a merge field if you wish.

Here is how it works:

Step 1:Setting up the variations

  • Decide on which attribute you would like to test - lets say you would like to test on the offer attribute. You would like 50% of the recipients to receive offer 20% discount and the rest offer 25% discount
  • In the vary job screen, type in the word offer in ‘Merge Field:’ column.
  • Add a variation with 50% in the percentage field and the words "20% discount" in the variation field
  • Add another variation with 50% in the percentage field and the words "25% discount" in variation field.
  • Copy the content of the ‘User this Merge Code:’ field for later use. In this case you will see "`merge:offer"
  • When you are done, click on Apply Variations. BlastWizard will automatically do the needful in the background to ensure that list is split randomly into two halves and the 2 offers applied.

Step 2: Editing your document

  • Obviously you have placeholder in your creative where the offer has to be merged in. Edit the job’s document to place the `merge:offer in the appropriate place.

Note: For subject lines we don’t need to follow step 2, it’s automatic

When the job is sent out, BlastWizard will automatically merge the appropriate offer.

You can view the performance of the two offers in the Reports.

Personal tools
FAQ