Ecommerce Expertise / Ecommerce Marketing / How To Sell Online

A/B Testing for E-commerce Stores: What it is and why you should use it, plus 10 tests to try

/ 5 min read

Table of Contents

    Tell me honestly — is your e-commerce website optional? Or does it really mean some serious business for you? I ask because if your site is really something you value, then you absolutely need to understand the power of A/B testing.

    You invest a lot of time, money and effort into making your online store successful. And when you’re receiving tons of traffic, it’s natural for you to hesitate in making even a small change on the website. Okay, you “feel” like it should help increase your conversion rate. But the doubt remains — what if it backfires?

    You probably have a lot of ideas in the back of your head about changes in your heading, discount offers, pricing, layout, and so on. But maybe the fear of plummeting conversion rates has always stopped you from trying them out.

    That’s where A/B testing can really move the needle. It allows you to measure the success of proposed changes while limiting potential damage.

    What is A/B testing, exactly?

    Imagine how great it would be if you could just poll your live visitors and ask if they would like a certain change on the website or not. Unfortunately, that’s not how it works.

    A/B testing lets you do something very similar, except people will not even be aware that they are voting for something. It allows you to make two versions of your landing page. The first will be the Control page, which is the original page on your site. The second is the Variation page, which will be nearly identical to the Control except for the one change that you want to test. These two versions are then tested with live visitors on your site to check the conversion rate and find the winning page.

    Here’s a visual of how A/B testing works:


    Your testing goal can be anything from selling more of a certain product to site engagement, form completion and more. The goal completion of every visitor is tracked for both versions of the page and the winning version is declared once statistical confidence of the data has been achieved.

    How does A/B testing help e-commerce sites in damage control?

    Sometimes when you’re apprehensive about changing your website, trying out a variation that seems to have, say, a 50-50 chance of success requires courage. After all, if the variation doesn’t get the desired response, it can cause lost leads or conversions. And if yours is a website that receives heavy traffic, that loss can accumulate and become overwhelming within a day or two.

    A/B testing tools help you keep that potential damage in check. For instance, you could show the Variation page to only 20% of your visitors, while the remaining 80% of the visitors still see the Control. You test the two versions of the web page with your live visitors and see how they respond to the change. You can always change the percentage who see the variation according to your specific requirements.

    You can even track your revenue while this test is going on, and see for yourself which page (Control or Variation) is performing better for your unique set of visitors. As the statistical confidence of the test is achieved (based on the number of visitors on the site), the winning page is declared.

    In simple terms, you’re no longer hanging in limbo, contemplating if you should go ahead with making a permanent change to your site. You simply A/B test for a few days and get a definite answer based on facts and proven data. After all, it’s about what works for you and not what you think should work.

    A/B testing has gone mainstream

    The primary reasons why A/B testing has become increasingly popular for e-commerce sites of all sizes and a must for e-commerce giants like Amazon and Ebay:

    1. Major potential for improvement — There are so many elements to an e-commerce site that it presents a multitude of opportunities for testing: from the checkout process and product pages to site layout, or even a complete design overhaul.

    2. Conversion rates directly impact revenue — For e-commerce sites, the impact of A/B testing can be directly measured in terms of revenue. It’s not about lead generation, form filling, brochure download or anything else; it’s a direct sale. Successful tests can help you reduce your cart abandonment rates and average order value, or analyze your user behavior to find out what interests them on your site and what doesn’t. This case study details how increased their sales by 15% just by testing three simple changes to their checkout page.

    Tests to try for optimized conversion

    If you’re considering A/B testing your site, here are some of the most commonly tested elements for e-commerce sites:

    Pricing and Shipping Strategies

    Many people would visit your site just to take a look around, check out the latest products, etc. But how do you reel in those window shoppers and make them click that “buy now” button?

    We all know pricing greatly influences consumer decision making. So how do you make it work in your favor and not against? Should you start ending your prices with .99 or other variations as seen in tons of other stores (you can see the pattern of ending prices with 95 in the image below, taken from How is your latest discount offer working for you? Should your prices be displayed on the left-hand or right-hand side of the image? Are your visitors abandoning carts after seeing your shipping charges?

    You can find answers to all of this and more through A/B testing your website. Check out how SmileyCookie increased their sales by 41% by offering next-day shipping to see exactly what I’m talking about.

    Product Pages and Product Filters

    There are so many things you can test on your product pages. For example, raised their conversions by 9% by increasing the size of their product images. Of course, there are best practices that you can implement and test right away, like placing “buy now” buttons above the fold, using bright and contrasting button colors (as you can see on Sony’s official website), including trust badges, and so on.

    Some of you may wonder why you should A/B test if these are proven practices. That’s the whole deal with A/B testing — you can never be sure about the results until you test them on live visitors. For example, here’s a case study about how removing a product filter increased site engagement by 27% for But in other tests, including product filters has been found to be a good practice that increases revenue.

    For some sites, displaying best-selling products may work better for cross selling. For others, showing the latest products might be more effective. Similarly, you can test which search result pattern works best for you: the grid or the list. You can even test if cross-selling increases revenue (by providing more choices and encouraging customers to buy more), or decreases revenue (by offering too many choices and confusing your customers about what they should buy).

    Once you get into the groove of A/B testing, the entire site is your playground. Figure out a solution to reduce your cart abandonment rates, try out different product page layouts, experiment with product descriptions, headlines, button placement/colors and more — and track your revenue for each of them.

    You might not always find that your changes work, but many times they will. And moving forward, the insights into shopper behavior will help you make your site a lot more effective and eliminate the friction that causes lost sales.

    The best part is that you do not have to be a techie to get started with A/B testing. With tools like Visual Website Optimizer, it takes just a few minutes to create a test and you don’t need any knowledge of HTML or coding. Try out A/B testing and see how it works for you!

    Most Popular Reads


    Leave a Comment
    • Jim McCarthy

      Curious to know if there is a PRICE testing tool for bc? jim—

    • It is very important test a / b,very interesting contribution , thank you very much,I have a site that I recommend Ecommerce Business

    • Great examples Smriti! It’s crazy how many eCommerce companies neglect to test FREE Shipping offers!

    • Bale ist ein Guter. Jeremy Renner allerdings auch, und Mark Ruffalo erst. (bor)] Dnen gnnt man’sSusanne Bier gewinnt mit In a Better World den Oscar f锟斤拷r den besten fremdsprachigen Film. Die Dnin (Things We Lost in the Fire) dreht seit Jahren hochemotionale Dramen. Verdient! Allerdings htte man es dem mexikanischen Film Biutiful auch gegnnt. (bor)] Runterholen, sofortWenn Hathaway und Franco nicht gleich freiwillig von der B锟斤拷hne gehen, muss Kollege Pitzke halt mal den BackstageBereich verlassen und sie verscheuchen. Isjafurchtbar. (tdo)] Schnarch…Anne Hathaway trllert ein Liedchen vor sich hin. Mehr Kaffee, ich schlaf gleich ein! (bor)] Nnnnein!!! Was soll das denn Mal im Ernst, Colin Firth, Geoffrey Rush und Helena Bonham
      New UGG Bailey Button 5808
      Kennedy had rebelled against that call to higher duty in his youth, it would come to define him. 2011 Christopher J. MatthewsTo order 锟斤拷Jack Kennedy: Elusive Hero,锟斤拷 click here.Morning Joe staffImmigrationWars CoverPreface Jeb BushImmigration to me is personal . It means my wife and family, as it has for countless Americans since our country was founded.In 1970, on the central plaza of the town of Le锟斤拷n, Mexico, I met a beautiful young woman with the beautiful name of Columba Garnica de Gallo. After spending a few weeks in Le锟斤拷n, I knew I wanted to marry her. It seems crazy in this era of young people waiting for years until they decide to marry, but I tell our children it was what people used to call love at first sight.A year later, Colu
      reml imjuumldischen Schtetl ist im Moment bei uns zu Hause der Schlager:Ich bin KleinAbraham, der schnellste krumme FingerKuumlnstler bin ich, dreh” die dollsten Dinger In den Knast kam ich, das kraumlnkt mich bis zum Tod Weil ich Hunger hatt” und fingerte ein Brot, oj, oj . . .So kleine Diebe, wie uumlberhaupt Trickbetruumlger, Geldfaumllscher,Geldschrankknacker und KiezGanoven, stehen moralisch hoch uumlberprofessionellen und kaltbluumltigen Spitzeln der politischen Polizei inder DDR. Sie achten wenigstens einen kleinen, aber zuverlaumlssigenEhrenkodex unter Freunden.Nach meiner BuumlchnerRede wurde ich von den meisten Verwalternder oumlffentlichen Meinung wie ein Denunziant und Verleumderbehandelt. Keiner von diesen hochdotierten Uumlbe
      New UGG Bailey Button 5808
      amerikanischen Blockadegefordert hat wie die USRegierung den Abzug der Raketen.Freitag, . Uhr. John Scali, diplomatischer Korrespondent derTVGesellschaft ABC in Washington, bekommt einen Anruf aus derSowjetbotschaft. Alexander Fomin, der als KGBMann gilt, draumlngtScali mit houmlrbarer Erregung, ihn auf der Stelle im RestaurantOccidental an der Pennsylvania Avenue zu treffen. Dort erklaumlrtFomin dem Amerikaner frei heraus, er sei beauftragt herauszufinden,ob die USRegierung daran interessiert sei, den Raketenstreit unterfolgenden Bedingungen beizulegen: Die Sowjets ziehen ihreAtomgeschosse aus Kuba ab, dafuumlr verpflichten sich die VereinigtenStaaten, jeden Angriff auf Kuba zu unterlassen.John Scali uumlbermittelt das Signal an Roger Hils

    • Hi Melissa,

      First things first, you’ve to ensure that you can actually do free shipping. Assuming you’re good on that, there are two aspects to this A/B test

      1) Showing a variation with different text/image on the checkout page. Something that says “Free Shipping”.

      2) Ensuring that the A/B test is coded so that those who see the Variation (free shipping) will not be charged for it and those who see Control (paid shipping) will be charged. This will require a bit of Javascript coding and depending on how your checkout is setup, might even need server side changes.

      Therefore, I’d suggest you send us an email at support @ wingify . com and one of our engineers can work with yours to set it up.

      Does that help?

      (I work for VWO)

    • Hi, I am keen to know how do we set up the A/B Testing for our site for the shipping option. I would love to trial the option of free shipping. Is there any links to videos or help topics about this, I have not found any to date.

    Less Development. More Marketing.

    Let us future-proof your backend. You focus on building your brand.