This “T” is for Testing

This “T” is for Testing

Small-to-medium sized businesses (SMBs) can use a simple reference model for their marketing and customer insights efforts. By focusing on what I call the “Three T’s” (targeting, testing, and tracking), your business operations will be continually guided and improved by staying focused on your core target, supported by continuous testing of new products and services, and by objectively monitoring your progress over time. Today let’s take a closer look at one of the these areas: testing.

Instill a Testing Mindset

 
Testing can involve a multitude of variables, but as an SMB you need to think about two fundamental dimensions when considering a test of any kind: tests that affect your brand, and tests to determine whether your ad spend is working.
 
My colleague Joel Rubinson makes this key distinction between what he calls performance vs. brand marketing. Each supports the other; they are not in opposition to one another. In simple terms, performance marketing is focused primarily on media allocation and the optimization of your ad spending (ROAS), while brand marketing is focused primarily on finding the best ways to communicate the fundamental premise of your brand, such as your brand’s features, benefits, and desired end-user target.
 
It is in this context that I want you to think about two types of testing: what I will call brand concept testing of the brand promise (in various concept formats); and performance testing, the most commonly used form being A/B testing.
 
Brand Concept Testing
 
When we want to communicate the essence of a brand or an idea to a prospective customer, we do it with a stimulus known as a concept. A concept is an idea before it is marketed solely for testing purposes, so that we can understand consumer reactions to it. We test concepts to reduce the risk of making a mistake when launching an idea, to find the best way to describe an idea, and how to best communicate to our target audience.
 
A concept needs to communicate a compelling end-benefit or a solution to a problem using language that a target consumer can not only understand, but internalize and relate to emotionally. Concepts can differ significantly in their language, layout, image content, and other characteristics. The format of your concept will vary depending on the type of information you need for your brand and the type of test you are planning.
There are concepts written specifically for screening purposes that have very little detail or descriptive information (on purpose). There are concepts that go a little further, with more descriptive information, but still short of being fully developed. And then there are concepts that are close to finished advertising, much like you would see on a landing page or in print media. Here are three types of brand concepts that you should know:
 
Kernels are ideas or benefits presented as statements.
 
Kernels are used in screening tests to efficiently identify winners vs. losers. Kernels are evaluated on just a few measures (e.g., purchase intent, uniqueness, superiority), and each respondent sees all kernels, and each is assessed on all measures. Kernels can be attributes, benefits, or distinct ideas. This type of test is also called a “benefit screen”.
 
If kernels are distinct ideas, the analysis focuses on the top performers and profiling them on demographics, geographical areas, or other methods such as attitudinal scoring. If the stimuli are end-benefits or positioning statements, we can use tools to identify underlying themes that might convey an even bigger thematic idea.
 
White card concepts are simply words on a page without high-quality images or fluffy language.
 
White card concepts are typically comprised of 4-8 sentences, factually stating the problem, usage situation, or need; they also state the end-benefit, solution, or final result provided. White card concepts can be existing products, stand-alone ideas, line extensions, or new uses and repositionings. They can include price, flavors, sizes, dosing, brand name, packaging information, and even a basic visual (i.e., a B&W drawing). Because the goal is to test the waters in a bit more detail, some diagnostic questions are included – but the number of questions is limited because we are typically evaluating multiple concept ideas.
 
Full concepts are used to capture more complete reactions, and when fine-tuning your messaging or language is essential prior to a launch or ad spending.
Full concepts often have the benefit of qualitative insights to develop language, positioning, tone, or emotion of an ideas that showed promise in previous screening work. Full concept testing can be done “monadically” (i.e., the respondent sees one idea at a time in its own cell of respondents), or in a sequential design.
 
Full concepts are longer, written to include all that might be conveyed in the time an ad is exposed (e.g., 15- or 30-seconds). They can also be more elaborate in their situational set-up or premise, use of demonstration cases, or other info.

A/B Testing

You might think that A/B testing always provides a clear choice, but there is usually more to the story than the difference between two variables.
The A vs. B variants you are testing might be affected by a series of previous decisions made long before either A or B were evaluated head-to-head. For example, if A is your current campaign that includes search, PR, and Facebook ads, and B does not leverage the campaign you are now running, your test is already biased against B. Or, perhaps your objective was impressions, but one option delivered much higher conversions. So, interpreting results can quickly become more complicated than perhaps they first appeared.
But, for argument sake, let’s assume that A and B start from the same point, and neither will be biased by previous advertising or spending level decisions. If so, A/B testing can be interpreted unbiasedly, and executed within any number of environments, such as CRM systems (HubSpot, Salesforce, etc.), dedicated A/B testing environments such as Central Control or Unbounce, and even some popular web hosting platforms provide an opportunity to conduct simple A/B tests.
 
Mechanically, the ad testing company you work with will develop two (or more) landing pages (A, B, C, etc.) and visitors to your site will be randomly redirected to one of those variants. Google Analytics and other web traffic statistics can be utilized to determine which variant is most effective at, for example: lowering bounce rates, achieving conversions, increasing CTRs, or other metrics you choose. A/B test designs can also revolve around content of the landing page, the overall site experience, or changes to ad spend, placement, location, context/environment, and more (see above brand concept formats).
 
Scratching the Surface
 
There are a multitude of different testing and design options for you to consider as an SMB. I have given you a taste, so get out there and test! Working with a marketing insights and research expert is your best guarantee that the type of concept and testing environment is designed, executed, and analyzed effectively. At Surveys & Forecasts, LLC we have worked with many different companies to help them develop optimal brand strategies and concepts, identify which execution best communicates their brand’s proposition, and which marketing program is most effective for their limited ad dollars.

 

 

Are You an SMB? Use the Three T’s!

Are You an SMB? Use the Three T’s!

If you work for a small-to-medium-sized company (SMB) and are in a marketing role, you are no doubt strapped for resources in the form of people, money, or time. This is especially true when it comes to research for understanding customers, prospects, and how to best message and market your product or service. The day-to-day challenges of managing your business can easily get in the way of thinking and planning about ways to grow or expand.
 
A “plan” does not scream out for immediate attention. Plans assume that conditions are stable and predictable but in the new era of COVID-19, conditions are far from ordinary. As a colleague of mine recently said, “If you see lots of umbrellas, you can conclude that it’s raining, but it doesn’t tell you when it will rain next.” Or if there is a hurricane coming. The obvious challenge we are ALL facing now is how to meet future customer needs given the restrictions imposed by COVID-19, and a future that is far from certain.
What kind of planning can you do right now? Certainly, long-term planning will be challenging, but let’s start with some simple rules — what I call the “three T’s” of SMB marketing.
Targeting: involves identifying your target audience, the best way to reach your target, and the best way to communicate your story (messaging).
Work hard to make sure your user target is right. Begin to dimensionalize it by using readily available data sources. A great place to start is the US Census (business and county data patterns), and companies that sell secondary research (e.g., “pre-packaged” reports on various categories, from companies like Statista or Packaged Facts).
Ask yourself: what problem are you solving? How is your solution better than the competition? Use custom research to better define your target and refine your USP. Common descriptors are “market studies”, “positioning research”, and “market segmentation ” to understand and size your market. In some cases you can link survey data with shopper data (which can be appended to your surveys) to understand who you should target. Some of this can be done subjectively based on your own knowledge, but back up your opinions with some hard facts.
If you are in a fast moving consumer goods category (FMCG), or any category where customers have multiple buying opportunities during the year, consider targeting loyal customers or loyal competitors. They are unlikely to be consuming all of their category volume solely from either you or the other guy. This is sometimes called a “share of requirements” strategy i.e., the share your brand has of total category consumption.
As another close-in strategy, find non-buyers who fit the profile (demographically, attitudinally) of loyal customers, as this is likely to reap rewards. Initially, maximize your reach (i.e., the total number of people exposed to your message), but do not over-emphasize it. If launching a product, it is initially a numbers game. Not every consumer or prospect is equally valuable/profitable, but you have to start somewhere.
If you are lucky enough to have a marketing or media budget, now is the time to re-examine all of the possible ways to target customers… via social media (e.g., Facebook, Instagram, Pinterest, LinkedIn), advanced and addressable TV (read more from media expert Bill Harvey here), and linear (live) and local TV. But more importantly, is your messaging on-strategy?
Testing: test different messages, selling points, products, or features in each channel you advertise, to educate and communicate. Test, test, test!
Testing is an iterative, tactical process that also feeds your business strategy. The more you learn, the more your strategy will adapt. You must continuously test to find that winning message, product, or formulation for your target (or targets). Give special consideration to testing among loyal customers (if you have them) or best case prospects. As noted, loyal customers are an ideal research audience, and can provide significant insight, as they are already pre-disposed to you behaviorally and attitudinally.
 
Pay special attention to testing your creative. Experts in media attribution assign about 80% to the impact of creative (i.e., the combined impact of the raw information about your brand’s story, combined with words, images and sound) on conversion. Put another way, if your message resonates, the teacher will give you an automatic ‘B’! The rest depends on the delivery mechanism and overall customer journey. With so much fertile ground in the creative itself, focus your initial efforts here.
Many platforms allow you to A/B test different offers in real time (i.e., pricing, flavors, colors, products), messaging (different creative executions), and delivery schedules (i.e., continuous advertising, vs. flights). Testing resources here include Central Control or independent platforms like One Count. Don’t get distracted with the more sophisticated attribution modeling companies (e.g., C3 Metrics, Sequent Partners) as an SMB, you’re just not ready for them yet.
Occasionally, when I talk about doing survey research, SMB clients think I have three heads, but do not discount the power of survey research to provide insight into what consumers are looking for, or to help narrow down options for your retail store or e-commerce site. Get a free SurveyMonkey account, or use forms-based tools like Constant Contact, Google Forms, or Office 365 Forms to gather feedback. Some of these tools are basic, and you may need to graduate to a more sophisticated platform as your testing needs grow, but their basic feature set is excellent.
Here’s another idea: leave your office, go out into the world (mask on, of course), and visit some real stores! Woo-hoo! Yes, lots of commerce is done via the web, but the vast majority is still brick and mortar, and the retail environment is closest to the end customer. If you already have distribution, go visit stores where your product is on-shelf. Note what is working, and what is not. While you are there, check out your competitors, or hire a mystery shopping firm to see if there are problems in finding your product. Are competitors better or worse than you? In what ways? How can you improve?
Tracking: once you have identified your target, and you have tested and identified messages for your target, monitor how well you are doing.
 
If you can’t measure it, you can’t manage it. Develop forms of continuous reporting, i.e., sales x channel x region x segment; or customer reviews; or other forms of objective feedback. Build monitoring systems using dashboards and visualizations to know whether refinements or adjustments are needed. Consider an ongoing advisory panel comprised of customers or clients, or a heavy user panel, to give you regular feedback on your product or service. Gather ideas from distributors/resellers to learn about issues that you might be unaware of. Talk to competitors if you can. Smartly designed research can yield significant insights.
Most of all, just listen. Keep your ear close to the ground and gather feedback like a sponge. Review each customer rating through an objective lens and see how it can enhance or improve your business. Don’t have a thin skin when it comes to feedback of any kind. Customers can be especially sharp: the internet lets people hide and in turn ‘permission’ to be nasty. Take the high road.
 
Last, this doesn’t have to be expensive. Well-designed research and good judgment can go a long way to help your business thrive and grow. As your business becomes more successful and more sophisticated, the need for feedback on individual aspects of your business will increase (i.e., individual products, or new customer targets).
 
As your needs grow, consider working with an expert to help identify problem areas and to refine your overall marketing plan. After all, if your marketing problems were that easy to solve, you would’ve figured them out by now. It will be money well spent.
Surveys & Forecasts, LLC