{"id":3374,"date":"2020-03-26T09:57:00","date_gmt":"2020-03-26T09:57:00","guid":{"rendered":"https:\/\/staging.elixirrdigital.com\/us\/2020\/03\/26\/conversion-rate-optimisation-how-to-build-a-culture-of-experimentation\/"},"modified":"2025-06-16T13:53:37","modified_gmt":"2025-06-16T13:53:37","slug":"conversion-rate-optimisation-how-to-build-a-culture-of-experimentation","status":"publish","type":"post","link":"https:\/\/staging.elixirrdigital.com\/us\/2020\/03\/26\/conversion-rate-optimisation-how-to-build-a-culture-of-experimentation\/","title":{"rendered":"Conversion Rate Optimisation &#8211; How to build a culture of experimentation"},"content":{"rendered":"<p>What do these brands have in common?<\/p>\n<p><img decoding=\"async\" class=\"aligncenter size-full wp-image-14227\" src=\"https:\/\/staging.elixirrdigital.com\/us\/wp-content\/uploads\/2025\/02\/Logos-6.png\" alt=\"\"><\/p>\n<p>They are not afraid to experiment. These companies have created a culture where everyone in the business is aligned and committed to testing. As a result, these businesses are thriving.<br \/>\nTransforming teams and companies to a point where everyone cares and respects experimentation is not only commendable, it\u2019s necessary.<\/p>\n<p><center><iframe loading=\"lazy\" class=\"giphy-embed\" src=\"https:\/\/giphy.com\/embed\/26BGKHrjfTMZX4g9y\" width=\"480\" height=\"246\" frameborder=\"0\"><\/iframe><\/center><\/p>\n<h2>The power of testing<\/h2>\n<p>According to <a href=\"https:\/\/www.forrester.com\/report\/InsightsDriven+Businesses+Set+The+Pace+For+Global+Growth\/-\/E-RES130848\" target=\"_blank\" rel=\"noopener noreferrer\">Forrester Research<\/a>, companies that experiment grow 8 times faster.<\/p>\n<p>Testing allows you to learn at a faster rate and innovate in the process. However, this is easier said than done. It\u2019s not uncommon for businesses to leave their CRO experimentation efforts down to one specialist.<\/p>\n<p>More often than not there is a discontent between <a href=\"https:\/\/staging.elixirrdigital.com\/us\/services\/cro\/\">conversion rate optimisation<\/a> and the business. It\u2019s often seen as an add-on or something that does not add value opposed to being an integral part of an organisation\u2019s core strategy.<\/p>\n<p>Testing is not about having the best tools or the largest volumes of traffic. It\u2019s more about attitude, ideas, and practice \u2013 things that are accessible to anyone, therefore there is no excuse not to do it. If you are struggling to prove the value of your experimentation strategy or struggling to get internal buy-in the key is to test the things that matter.<\/p>\n<p>When you do that, you, your colleagues and the business will start to learn and understand your customers. You start to understand what motivates them, what they buy, why they are likely to buy, and so on. This continual understanding of your customer sometimes is enough to spark and interest in CRO and thus the experimentation begins.<\/p>\n<p><strong>However often companies are put off testing because of two key reasons:<\/strong><\/p>\n<h3>1. Fear of failing<\/h3>\n<p>Of course, nobody wants to fail, so it\u2019s no surprise that this is one of the biggest barriers in introducing the concept of experimentation within your business.<\/p>\n<p><strong>Apple Newton<\/strong><\/p>\n<p>In 1993, Apple wasn\u2019t the global super giant it is now. In fact, Apple wouldn\u2019t go on to make a successful product until 2001 when it released the first iPod. The apple Newton was deemed \u201cahead of its time\u201d and started at $700 dollars.<\/p>\n<p>The device\u2019s text recognition feature was so bad that even the Simpsons made fun of it. But fast forward 26 years and Apple is now the most valuable company in the world.<\/p>\n<p>Watch the 1993 Apple Newton ad.<\/p>\n<p><center><iframe loading=\"lazy\" src=\"https:\/\/www.youtube.com\/embed\/pRuNsc6DfHA\" width=\"560\" height=\"315\" frameborder=\"0\"><center><\/center><\/iframe><\/center><img decoding=\"async\" class=\"aligncenter size-full wp-image-14231\" src=\"https:\/\/staging.elixirrdigital.com\/us\/wp-content\/uploads\/2025\/03\/simpsons-beat-up-martin-3.jpeg\" alt=\"\"><\/p>\n<p><strong>Amazon Fire phone<\/strong><\/p>\n<p>In 2014, Amazon released the Amazon Fire phone off the back of the success of their Kindle Fire tablet. I have never met anyone who owned the phone, did you? I think we can all agree it was a flop. The product made a loss of $170 million. To put that into perspective $170 dollars is what it cost to produce Iron Man 2 &amp; the Hunger games movies.<\/p>\n<p><center><iframe loading=\"lazy\" class=\"giphy-embed\" src=\"https:\/\/giphy.com\/embed\/DowKEtWnLZcru\" width=\"250\" height=\"250\" frameborder=\"0\"><\/iframe><\/center>So, the Amazon Fire was a failure, right?<\/p>\n<p>Wrong.<\/p>\n<p><center><iframe loading=\"lazy\" class=\"giphy-embed\" src=\"https:\/\/giphy.com\/embed\/14nS5MjzuC91GU\" width=\"480\" height=\"270\" frameborder=\"0\"><\/iframe><\/center>Ok, let me backtrack. Yes, commercially it failed. But it drove further success. How?<br \/>\nThe Amazon Echo.<\/p>\n<p><img decoding=\"async\" class=\"aligncenter size-full wp-image-14232\" src=\"https:\/\/staging.elixirrdigital.com\/us\/wp-content\/uploads\/2025\/03\/echo-e1585211197927.jpeg\" alt=\"\"><\/p>\n<p>Development of the Fire phone and the Echo began around the same time. While the Fire phone was a failure, Amazon was able to take their learnings and accelerate their efforts when building Echo and Alexa.<\/p>\n<p>By 2019, more than 100 million Alexa-enabled devices have been sold. What does this prove? That Amazon certainly isn\u2019t afraid to innovate and test, and they are reaping the benefits because of it.<\/p>\n<p><strong>In a letter to Amazon investors, Jeff Bezos wrote:<\/strong><\/p>\n<p><em>\u201cAs a company grows, everything needs to scale, including the size of your failed experiments. If the size of your failures isn\u2019t growing, you\u2019re not going to be inventing at a size that can actually move the needle. Amazon will be experimenting at the right scale for a company of our size if we occasionally have multibillion-dollar failures. <\/em><\/p>\n<p>Of course, we won\u2019t undertake such experiments cavalierly. We will work hard to make them good bets, but not all good bets will ultimately pay out. This kind of large-scale risk taking is part of the service we as a large company can provide to our customers and to society. The good news for shareowners is that a single big winning bet can more than cover the cost of many failed ones.\u201d<\/p>\n<h3>2. Testing the wrong things or not testing at all<\/h3>\n<p>The <a href=\"https:\/\/www.youtube.com\/watch?v=_15i4KdYN_M\" target=\"_blank\" rel=\"noopener noreferrer\">Domino\u2019s winter survivor deal<\/a>\u00a0is a traditional winter offer and has always been enormously popular. But in 2016, the company made a change to the deal:<\/p>\n<p><center><iframe loading=\"lazy\" src=\"https:\/\/www.youtube.com\/embed\/_15i4KdYN_M\" width=\"560\" height=\"315\" frameborder=\"0\"><center><\/center><\/iframe><\/center><\/p>\n<ul>\n<li>Reducing the price from \u00a316.96 to \u00a314.99<\/li>\n<li>Removing the cookie from the deal<\/li>\n<\/ul>\n<p>These are small changes. The customer pays less, however if they want a cookie, they can add it back in and it would cost the same as the original deal. All of this sounds rational, right? The problem is, consumers are not always rational.<\/p>\n<p>Unfortunately, the change had a very negative effect on the general perception of the deal. It was less popular and as a result the company made less money because fewer customers were taking part.<\/p>\n<p>This is a great example of the sort of change that should be tested first before being implemented. To limit the risk, we test, measure and iterate. In this scenario, Domino\u2019s should have created and tested multiple deals and gone with the deal\/products that customers respond well to.<\/p>\n<h2>Test what matters<\/h2>\n<p>Practitioners often get too tied up in the minor tweaks: copy or layout changes, testing something to be safe before deploying it any way and so on. But these changes are often not radical enough to drive real change in user behaviour which is why so often CRO programmes fail or halter.<\/p>\n<p>This differs greatly from how those who do it well. When you compare yourself to the likes of Amazon, or Spotify, or Air B&amp;B they use their programmes to introduce new concepts, new bundles, new pricing structures, in summary radical changes.<\/p>\n<p><strong>This goes back to my point earlier. Test what matters &#8211; but how do you do that?<\/strong><\/p>\n<p>Here are a few questions to think about when trying to work out what to test and what matters most to your business:<\/p>\n<ul>\n<li>What are the goals, assumptions, risks, investments that my business is making?<\/li>\n<li>What processes are in place just because \u201cthat\u2019s the way it\u2019s always been done\u201d?<\/li>\n<li>What are the risks you\u2019re taking in the next year?<\/li>\n<li>What are you going to be doing \/ what are you not going to be doing?<\/li>\n<\/ul>\n<p>You could also go around your business and start asking teams and people what is useful to them and being to assess whether experimentation in the business can provide advantage over your competition.<\/p>\n<p>\u00a0<\/p>\n<blockquote><p>Experimentation is a chance to make better and bolder choices. It allows you to see what is behind a door before deciding to go through.<\/p><\/blockquote>\n<p>\u00a0<\/p>\n<h2>Be radical, but not always<\/h2>\n<p>When you start to take a more radical approach to experimentation, you will begin to realise that your standard A\/B test perhaps doesn\u2019t offer as much value as you once thought. Not all changes need to be radical, there is always room in your experimental strategy for small changes, but they should not make up the majority of your testing strategy as this is where your testing begins to suffer.<\/p>\n<p>Stakeholders lose interest, and it doesn\u2019t add value and testing halters. When you focus on changes that matter and start to experience results that propel the business you will quickly see a surge in investment in your experimentation strategy<\/p>\n<p><center><iframe loading=\"lazy\" class=\"giphy-embed\" src=\"https:\/\/giphy.com\/embed\/g9582DNuQppxC\" width=\"480\" height=\"270\" frameborder=\"0\"><\/iframe><\/center><\/p>\n<h2>Running experiments<\/h2>\n<p>This is likely to be the biggest challenge for most. Getting a concept to test can be hard work for many reasons:<\/p>\n<ul>\n<li>You can\u2019t find developers to carry out your concepts<\/li>\n<li>It may be too technically demanding<\/li>\n<li>Improvement ideas may be deemed \u2018too radical\u2019 to be tested<\/li>\n<\/ul>\n<p>If you ever come across this barrier you need to start looking at Minimum viable experiments. Think of MVE as a proof of concept. So, you have an idea of new radical navigation that is going to totally change how users interact with your website. Rather than spending hours coding and designing the new navigation, going through a round of amends, getting stakeholder approval etc, you, in essence, build a proof of concept to test the idea. The \u201cminimal\u201d part of MVE means it should test one (and only one) idea. The mechanism to test the concept as I&#8217;m going to demonstrate in a few examples below can vary however the premise is the same.<\/p>\n<p><strong>Zalando<\/strong><\/p>\n<p>Zalando a famous German clothing retailer founded in 2008. Before starting they proved their concept with just an online storefront consisting of pictures of shoes from shoe stores. When a shoe was a sold, they would run down to the local shoe shop, pop them in a box and post them to the customer.<\/p>\n<p><strong>Dropbox<\/strong><\/p>\n<p>A more famous case study comes from Dropbox. Before even having a working product, they created a video 3-minute explainer video highlighting the value of what they wanted to offer. People loved it and overnight it had 75,00 subscribers.<\/p>\n<h2>Testing your concept<\/h2>\n<p>You can test your concept in a number of ways, including:<\/p>\n<ul>\n<li><a href=\"https:\/\/staging.elixirrdigital.com\/us\/guides\/biometric-testing-for-digital-marketing\/\" target=\"_blank\" rel=\"noopener noreferrer\">Biometric testing<\/a><\/li>\n<li><a href=\"https:\/\/staging.elixirrdigital.com\/us\/2019\/11\/25\/the-case-for-ux-research-why-you-should-talk-to-users\/\" target=\"_blank\" rel=\"noopener noreferrer\">Users interviews<\/a><\/li>\n<li>Remote testing<\/li>\n<li>Landing pages<\/li>\n<li>Explainer video<\/li>\n<li>Digital prototypes<\/li>\n<li>Paper prototypes<\/li>\n<li>Virtual reality<\/li>\n<\/ul>\n<h2>TL;DR<\/h2>\n<p>Driving the internal perception of testing isn\u2019t always easy, but experimentation is a key opportunity for growth. Changing your mentality to testing and the makeup of your experimentation strategy can have a profound impact on business success and internal buy-in.<\/p>\n<ul>\n<li>Think radically and innovate<\/li>\n<li>Switch up your testing programme, test big, test what is important<\/li>\n<li>Be prepared to fail sometimes but don\u2019t let the fear put you off<\/li>\n<li>Don\u2019t let technical hurdles be a barrier and consider different ways to prove a concept<\/li>\n<li>Simplify experiments where possible to keep up momentum<\/li>\n<li>Keep innovating!<\/li>\n<\/ul>\n<p>If you\u2019d like to talk to us about <a href=\"https:\/\/staging.elixirrdigital.com\/us\/services\/cro\/\" target=\"_blank\" rel=\"noopener noreferrer\">CRO<\/a> and testing, <a href=\"https:\/\/staging.elixirrdigital.com\/us\/contact\/\" target=\"_blank\" rel=\"noopener noreferrer\">get in touch today<\/a>!<\/p>\n<p>Or if you&#8217;d like to learn more about CRO, we have a free <a href=\"https:\/\/staging.elixirrdigital.com\/us\/guides\/cro-incremental-path-success\/\" target=\"_blank\" rel=\"noopener noreferrer\">Conversion Rate Optimisation guide<\/a>, and a prerecorded <a href=\"https:\/\/staging.elixirrdigital.com\/us\/2017\/07\/07\/conversion-rate-optimisation-turning-visits-conversions-latest-webinar\/\" target=\"_blank\" rel=\"noopener noreferrer\">CRO webinar<\/a> you can listen to.<\/p>\n","protected":false},"excerpt":{"rendered":"<p>What do these brands have in common? They are not afraid to experiment. These companies have created a culture where everyone in the business is aligned and committed to testing.&hellip;<\/p>\n","protected":false},"author":23,"featured_media":2549,"comment_status":"closed","ping_status":"closed","sticky":false,"template":"","format":"standard","meta":{"_acf_changed":false,"footnotes":""},"categories":[132],"tags":[],"related_service":[69],"related_industry":[],"class_list":["post-3374","post","type-post","status-publish","format-standard","has-post-thumbnail","hentry","category-cro"],"acf":[],"card":"<article class=\"wp-component-card wp-component-card--dark wp-component-card--resource wp-component-card--post wp-component-card--full-width            wp-component-card--link js-card-link\n        \">\n            <div class=\"wp-component-card__image\">\n            <img width=\"413\" height=\"579\" src=\"https:\/\/staging.elixirrdigital.com\/us\/wp-content\/uploads\/sites\/2\/2025\/03\/CRO-lead-gen-small-413x579.png\" class=\"attachment-card-1-col size-card-1-col\" alt=\"CRO lead gen small\" decoding=\"async\" loading=\"lazy\" srcset=\"https:\/\/staging.elixirrdigital.com\/us\/wp-content\/uploads\/sites\/2\/2025\/03\/CRO-lead-gen-small-413x579.png 413w, https:\/\/staging.elixirrdigital.com\/us\/wp-content\/uploads\/sites\/2\/2025\/03\/CRO-lead-gen-small-213x300.png 213w, https:\/\/staging.elixirrdigital.com\/us\/wp-content\/uploads\/sites\/2\/2025\/03\/CRO-lead-gen-small-200x281.png 200w, https:\/\/staging.elixirrdigital.com\/us\/wp-content\/uploads\/sites\/2\/2025\/03\/CRO-lead-gen-small-71x100.png 71w, https:\/\/staging.elixirrdigital.com\/us\/wp-content\/uploads\/sites\/2\/2025\/03\/CRO-lead-gen-small-28x40.png 28w\" sizes=\"auto, (max-width: 413px) 100vw, 413px\" \/>        <\/div>\n        <div class=\"wp-component-card__content\">\n        <div class=\"wp-component-card__content-top\">\n                                                    <p class=\"wp-component-card__eyebrow\">\n                    Blog                <\/p>\n                        <a href='https:\/\/staging.elixirrdigital.com\/us\/2020\/03\/26\/conversion-rate-optimisation-how-to-build-a-culture-of-experimentation\/'>\n        <h2 class='wp-component-card__title'>\n            Conversion Rate Optimisation &#8211; How to build a culture of experimentation\n        <\/h2>\n    <\/a>        <\/div>\n                    <div class=\"wp-component-card__content-bottom\">\n                                    <div class=\"wp-component-card__description wysiwyg\">\n                        What do these brands have in common? They are not afraid to experiment. These companies have created a culture where everyone in the business is aligned and committed to testing.&hellip;                    <\/div>\n                                                                    <div class=\"wp-component-card__meta\">\n                                                    <p class=\"wp-component-card__date\">\n                                26 March 2020                            <\/p>\n                                                                            <div class=\"wp-component-card__terms\">\n                                                                                            <div class=\"wp-component-tags__tag\">\n                CRO            <\/div>\n                                                                                                            <\/div>\n                                            <\/div>\n                                            <\/div>\n            <\/div>\n<\/article>\n","_links":{"self":[{"href":"https:\/\/staging.elixirrdigital.com\/us\/wp-json\/wp\/v2\/posts\/3374","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/staging.elixirrdigital.com\/us\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/staging.elixirrdigital.com\/us\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/staging.elixirrdigital.com\/us\/wp-json\/wp\/v2\/users\/23"}],"replies":[{"embeddable":true,"href":"https:\/\/staging.elixirrdigital.com\/us\/wp-json\/wp\/v2\/comments?post=3374"}],"version-history":[{"count":0,"href":"https:\/\/staging.elixirrdigital.com\/us\/wp-json\/wp\/v2\/posts\/3374\/revisions"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/staging.elixirrdigital.com\/us\/wp-json\/wp\/v2\/media\/2549"}],"wp:attachment":[{"href":"https:\/\/staging.elixirrdigital.com\/us\/wp-json\/wp\/v2\/media?parent=3374"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/staging.elixirrdigital.com\/us\/wp-json\/wp\/v2\/categories?post=3374"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/staging.elixirrdigital.com\/us\/wp-json\/wp\/v2\/tags?post=3374"},{"taxonomy":"related_service","embeddable":true,"href":"https:\/\/staging.elixirrdigital.com\/us\/wp-json\/wp\/v2\/related_service?post=3374"},{"taxonomy":"related_industry","embeddable":true,"href":"https:\/\/staging.elixirrdigital.com\/us\/wp-json\/wp\/v2\/related_industry?post=3374"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}