Trending Now

What “test and learn” looks like in practice

One of the core attributes of an effective digital team is a focus on creating a “test and learn” culture. And what digital marketing experts mean when talking about a “test and learn” culture is one where you put an emphasis on testing your assumptions about your marketing activities, learning from those tests, then doubling down on the areas that work; in other words, fish where the fishin’s good.

To do this successfully, of course, you need data. And it can seem complicated to understand what data is most critical to your business. But there are really only a small handful of questions you need to answer, that you must have the data for, to ensure you’re well positioned to effectively test your digital marketing activities and learn from those tests.

So what is this data? I’m glad you asked.

It’s fairly straightforward to find out where to focus your efforts. First, you need to answer these five questions:

  1. What are your conversions? What are the actions you want your customers to take? Do you want them to buy on your website or mobile app? Or are you in a lead-generation business and want them to provide contact information? Each is equally valid and provides a key building block for creating a test and learn culture.
  2. How much are those conversions worth to your business? Exactly what it sounds like. If you’ve got an e-commerce site, how much is a typical transaction worth to you? If you’re using lead generation tactics, what’s a lead worth? (If you don’t know the answer to that, think about what a customer is worth, then multiply by the rate you convert leads to paying customers. If you don’t know the answer to that, start by dividing your new customers added by the number of leads generated each month.)
  3. Which pages get the most traffic? Again, pretty much what exactly what it sounds like. Which pages on your site attract the most traffic? Whether your analytics suite calls them landing pages or entry pages or what-have-you, you’re interested in finding out where prospects start their journey on your website or app.
  4. How often do customers reach your conversion page from each of your top entry points? You’ll use this data to assign an economic value to each entry page and to determine the potential value each test can deliver.
  5. What other pages send customers deeper into your purchase funnel? Most analytics tools can tell you how often any given page leads to a specific conversion action. You’ll use this data to learn which pages contribute to conversions even if they’re not top entry pages.

Armed with the answers to these five questions, you’re immediately positioned to improve your digital marketing activities.

For instance, let’s imagine you run a mid-sized enterprise software company and that one of your top entry pages leads to a conversion – in this case, submission of a lead form – 10% of the time. If we assume that each lead you convert is worth $10,000 annually to your company, each visitor to your site (or app, whatever) starting on that entry page has a potential value of $1,000 ($10,000 * 10% = $1,000). If the page gets a lot of traffic, you may want to work towards improving that 10% “micro-conversion” rate. By contrast, if the page gets very little traffic, that should lead you towards testing how to get more traffic to the page to begin with. The following graphic illustrates how to approach this for your business:

Test and learn matrix

I realize this may almost sound too good to be true. And in part, this is a simplified version of a more in-depth approach. It usually also takes some work to collect and refine the data necessary to answer each of these 5 questions for each of your top entry pages as well as the top pages leading to conversions. However the most successful marketers tend to follow the Pareto principle — that is putting most of your efforts into the areas that will get you 80% of your return. It’s not about following a complicated process; it’s about focusing on the areas with the greatest return.

Creating a test and learn culture starts and ends with data. But in the middle it depends on using that data to ask the right questions about your customer needs and generate the greatest return on your efforts. Of course, if you think I’m wrong, there’s an easy way to find out: test my theory. And learn for yourself.

Tim Peter


Tim Peter built his first website in 1995 and loves that he still gets to do that every day. Tim has spent almost two decades figuring out where customers are, how they interact with brands online, and delivering those customers to his clients’ front door. These efforts have generated billions of dollars in revenue and reduced costs.

Tim works with client organizations to build effective teams focused on converting browsers to buyers and building their brand and business. He helps those companies discover how marketing, technology, and analytics tie together to drive business results. He doesn't get excited because of the toys or tech. He gets excited because of what it all means for the bottom line.

An expert in e-commerce and digital marketing strategy, web development, search marketing, and analytics, Tim focuses on the growth of the social, local, mobile web and its impact on both consumer behavior and business results. He is a member of the Search Engine Marketers Professional Organization (SEMPO), HSMAI, and the Digital Analytics Association.

Tim currently serves as Senior Advisor at SoloSegment, a marketing technology company that uses machine learning and natural language processing to improve engagement and conversion for large enterprise, B2B companies.

Tim Peter’s recent client work covers a wide range of digital marketing activities including developing digital and mobile marketing strategies, creating digital product roadmaps, assessing organizational capabilities, and conducting vendor evaluations for diverse clients including major hospitality companies, real estate brands, SaaS providers, and marketing agencies.

Prior to launching Tim Peter & Associates, LLC, a full-service e-commerce and internet marketing consulting firm in early 2011, he worked with the world’s largest hotel franchisor, the world’s premier independent luxury hotel representation firm, and a major financial services firm, developing various award-winning products and services for his customers. Tim can be reached at tim@timpeter.com or by phone at 201-305-0055.

Join the Discussion

Your email address will not be published. Required fields are marked *

Back to top