{"id":32,"date":"2022-05-12T23:39:55","date_gmt":"2022-05-12T23:39:55","guid":{"rendered":"https:\/\/flux.la\/?p=32"},"modified":"2022-05-26T02:44:00","modified_gmt":"2022-05-26T02:44:00","slug":"how-to-ab-test","status":"publish","type":"post","link":"https:\/\/flux.la\/how-to-ab-test\/","title":{"rendered":"How to A\/B Test – [6 Tips to Run Great Campaigns]"},"content":{"rendered":"\n

A\/B testing, or split testing, compares two different versions of a web page to see which one is more successful. Each version is shown to a different group of website visitors at the same time, and the one with the better conversion rate wins.<\/p>\n\n\n\n

Every website has a goal that it\u2019s trying to achieve. Some websites want their visitors to buy a product they\u2019re selling, some aim to get visitors to sign up for a trial of a product and eventually become paying customers, while others hope readers will click on ads displayed on their site. Whatever the goal, the rate at which it\u2019s achieved is known as the conversion rate.<\/p>\n\n\n\n

\"A\/B<\/a><\/figure><\/div>\n\n\n\n

Why A\/B Testing?<\/h1>\n\n\n\n

A\/B testing makes it possible for you to use the traffic you\u2019re already getting to your advantage. Increasing traffic is fairly difficult and costly, while increasing conversions on existing traffic is minimal. A\/B testing offers a huge return on investment, since even just a small change on a website\u2019s landing page can significantly increase conversion rates.<\/p>\n\n\n\n

What Can You Use A\/B Testing For?<\/h1>\n\n\n\n

You can run A\/B testing on practically anything on your website. Here\u2019s a list of the most commonly tested features.<\/p>\n\n\n\n

  1. Headlines<\/li>
  2. Sub headlines<\/li>
  3. Paragraph Text<\/li>
  4. Testimonials<\/li>
  5. Call to Action text<\/li>
  6. Call to Action Button<\/li>
  7. Links<\/li>
  8. Images<\/li>
  9. Content near the fold<\/li>
  10. Social proof<\/li>
  11. Media mentions<\/li>
  12. Awards and badges<\/li><\/ol>\n\n\n\n

    Aside from these, more advanced A\/B tests can compare different price structures, sales promotions, trial lengths, free vs. paid delivery, etc.<\/p>\n\n\n\n

    Now that you have a general idea of how A\/B testing can be used to increase website conversions, here are some tips to make the most of your tests.<\/p>\n\n\n\n

    1. The Control Stands<\/h1>\n\n\n\n

    Many people look at the two variants being tested as equals. However, this isn\u2019t likely to bring you significant improvements to your conversion rate. Unless a variant truly proves itself as the better option, with a significant margin, the control stands. Otherwise, any \u201cvictory\u201d of a variant could just as easily be attributed to a small sample size. The goal of A\/B testing is to find variants for different variables that create significant increases in conversion rate and combining them. Thus, one variant that performs 2% better than the control won\u2019t really contribute to a huge increase in conversions in the long run.<\/p>\n\n\n\n

    2. Make Sure You Have Enough Traffic<\/h1>\n\n\n\n

    In order to make sure your A\/B testing is yielding statistically significant results, make sure that at least 2000 people visit the site during the time that you\u2019re running the test. If you don\u2019t have that volume of traffic on your site yet, wait until you do to run A\/B testing. Without a large enough audience for your test, your results are likely to be skewed by the visitors you do get. Of course, the more visitors, the better, but 2000 is a good starting benchmark.<\/p>\n\n\n\n

    3. Run Tests For at Least 1 Week<\/h1>\n\n\n\n

    With tests that run for less than a week, the results are too volatile to be conclusive and reliable. Tests can start with a huge improvement within the first day, but end up with a slight improvement or even a decline by the end of the week.<\/p>\n\n\n\n

    Running each test for a week also ensures that you get a full cycle of data. Website visitors may behave differently at the beginning of a work week than they do by the end, or on a weekend vs. weekday. By waiting a week to collect your results, you ensure that these variations in visitor behavior don\u2019t affect your A\/B testing.<\/p>\n\n\n\n

    4. Kill Tests with a Less than 10% Improvement<\/h1>\n\n\n\n

    Although 10% better than the control is better, chances are you can get a higher improvement with another variant that you\u2019re not currently testing. Since A\/B testing requires time for each test, it\u2019s better to not waste time on unproductive tests. Instead of a winner that increases conversion rate by 10% that took 6 months to find, it\u2019s better to take that same amount of time and cycle through several different tests to find a winner that increases conversions by 25%. Due to the time necessary for each test, the longer a test runs, the higher the opportunity costs gets. If you let unsuccessful tests run for too long, you\u2019re missing out on chances to find big winners in that same amount of time. A 10% improvement is just not significant enough to keep tests going.<\/p>\n\n\n\n

    5. Kill Tests Without a Winner After 1 Month<\/h1>\n\n\n\n

    There has to be a point at which you cut off tests that don\u2019t have a clear winner. It\u2019s important to not get particularly attached to a specific variant when A\/B testing. If you\u2019re personally rooting for one to win, you\u2019re more likely to let it run longer, wasting precious time. If after a month, a variant is not doing significantly better than the control, it\u2019s time to kill the test and consider the control the winner. Even if the variant is slightly better, that lead is likely to decrease as time goes on.<\/p>\n\n\n\n

    6. Plan Your Next Test While Waiting for Data<\/h1>\n\n\n\n

    The point of A\/B testing is to determine several successful variants, each of which changes a different aspect of the website. In order to do this quickly and efficiently, you should launch the next test right after you finish one. This means designing and building new variants while you still have one test running. This way, you\u2019ll avoid downtime between tests and be able to go through as many variants as possible in a time-efficient manner.<\/p>\n","protected":false},"excerpt":{"rendered":"

    A\/B testing, or split testing, compares two different versions of a web page to see which one is more successful. Each version is shown to a different group of website visitors at the same time, and the one with the better conversion rate wins. Every website has a goal that it\u2019s trying to achieve. Some…<\/p>\n","protected":false},"author":1,"featured_media":35,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[7],"tags":[],"_links":{"self":[{"href":"https:\/\/flux.la\/wp-json\/wp\/v2\/posts\/32"}],"collection":[{"href":"https:\/\/flux.la\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/flux.la\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/flux.la\/wp-json\/wp\/v2\/users\/1"}],"replies":[{"embeddable":true,"href":"https:\/\/flux.la\/wp-json\/wp\/v2\/comments?post=32"}],"version-history":[{"count":0,"href":"https:\/\/flux.la\/wp-json\/wp\/v2\/posts\/32\/revisions"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/flux.la\/wp-json\/wp\/v2\/media\/35"}],"wp:attachment":[{"href":"https:\/\/flux.la\/wp-json\/wp\/v2\/media?parent=32"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/flux.la\/wp-json\/wp\/v2\/categories?post=32"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/flux.la\/wp-json\/wp\/v2\/tags?post=32"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}