Fail Forward

Fail Forward

There have been some recent news articles about the role of marketing insights and research, most notably Jeff Bezos of Amazon, who in his 2018 letter to shareholders said: “No customer was asking for Echo. This was definitely us wandering. Market research doesn’t help. If you had gone to a customer in 2013 and said “Would you like a black, always-on cylinder in your kitchen about the size of a Pringles can that you can talk to and ask questions, that also turns on your lights and plays music?” I guarantee you they’d have looked at you strangely and said “No, thank you.” Really? Give me a break.
 
Over the years, we have heard similar things from other executives. In a blog post covered by Bob Lederer, he relayed the reaction of Robert Granader who blogged about the reaction of several analysts at his firm, which included this gem: “Amazon surely had market research indicating that customers wanted hands-free music, home connectivity, multi-functional devices, and faster/easier searching for information. It was then Amazon’s job to develop a product to serve all of those needs. Market research tells you what you need to know, but the company has to decide how to act on it. Without market research, you’re flying blind. If Amazon didn’t know that customers wanted all of these things, there’s no way the development of the Echo would have been as successful as it was.”
 
He goes on to say “Most companies don’t have the time to “wander” through their next market, acquisition, or fundraising, so they rely on market research — because sometimes you need to get it right the first time.” [my emphasis]
 
I find the hubris of charismatic types like Bezos annoying and amusing at the same time, if that’s possible. The problem that comments like these pose is that they are being made by people with the power to persuade, which morphs into denigration. So, unfortunately, these individuals are uninformed and lack understanding about what research is and how it can be used.
 
If research is not adding value, then you’re not doing the right type of research, or you’re not asking the right kinds of questions. It’s really that simple.
 
We tend to think of research as a series of steps that must be conducted in sequence before an insight or an “aha” moment occurs. Wrong – insights can come in any sequence or order, and from any source, but objective research results are the agent of one or more controlled experiments. There is also a false belief that, simply by virtue of conducting research, it will always lead to some magical “aha” moment that is immediately actionable. This is also absurd. No one should go into any experiment with the thought of exiting the experiment with all of the tools in hand needed to build or innovate, or create, or market.
 
The whole point of research is experimentation. To test, and to often sequentially fail. We conduct experiments to prove or disprove an hypothesis, an assumption, a hunch. My old marketing research professor Russell Haley used to quip, “In business, all you have to be is right”. But what if you’re not? Do you want to shoulder that risk?
 
If in testing an hypothesis we conclude that something doesn’t appeal to consumers, or isn’t a success, or fails to meet an action standard, that doesn’t mean that research was a useless exercise. That’s entirely the point of research!
 
We should be failing forward, failing repeatedly, and hopefully failing faster to get us to the next opportunity awaiting us!
 
If we are failing forward, then we are in a continuous future-seeking mode to identify opportunities to innovate. This could be a new product or service; new opportunities for distribution; new markets, segments, or usage occasions; or other activity focused on delivering products and services to the marketplace.
 
Peter Drucker famously said that all companies have two functions: innovation and marketing. Innovation implies experimentation, and experimentation will certainly produce some results that are undesirable or unexpected – and they will be classified as “failures” – which is, again, missing the point entirely.
 
If we do not stay objective about what it is we are trying to do (in testing, experimenting, and conducting research), then research is always burdened with an emotional weight it does not deserve. In the same way, if research is improperly designed or executed, or if the research function is improperly staffed, research itself will fail much of the time. Our goal is to immunize the research function from the results it delivers.
 
The outcome that we desire is for research to simply be the playing field by which a marketing variable can be objectively evaluated, devoid of emotion or prejudice. This is much harder than it seems. Research can be conducted to confirm a decision that has already been made, or to attempt to settle an argument. Under these constraints, research has no possible chance of succeeding. When this happens, neither side really believes in research.
 
Innovation and marketing, and by extension insights and research, are critical interpreters in all well-run organizations. So don’t be afraid to fail. Fail forward – and keep going.
Robert Walker, Editor of ARF Marketing Glossary

Robert Walker, Editor of ARF Marketing Glossary

The New-York based Advertising Research Foundation ARF has released a glossary of commonly used marketing research and creative testing terms, aiming to ‘bridge the gap’ between creatives and researchers, and to help professionals keep up with the ever-changing language of marketing. Robert Walker, CEO of Surveys & Forecasts, LLC was the editor, personally reviewing over 1,000 submissions. The glossary is featured in recent editions of Forbes, Media Village, and MR Web.
 
The ARF released this resource for free on its website to those in the industry, students, and the general public who might be interested in learning more about these marketing and advertising terms. An example for “ad recall” can be found here.
 
The ARF uses industry-level research to help its 400 members enhance their marketing advertising initiatives. The ARF describes this effort as ‘the world’s first, definitive glossary’, which will provide standardized terms, and serve as an initial set of guidelines for the industry around often confusing terminology. After one such study, the ARF found a lack of trust and misalignment of terms often fuels the ‘creative-researcher disconnect’, resulting in miscommunication and wasted effort.
 
ARF Chief Research Officer Paul Donato told Forbes: “Methods of creative testing are changing very rapidly. We have recently published a survey among creatives and researchers. Creatives tend to want to use traditional methods of focus groups and ethnographies. Researchers tend to want to use biometrics, facial coding and neuroscience. The glossary attempts to bridge that gap.”
 
For more about the research and consulting services of Surveys & Forecasts, please visit our site or contact us.
 
 
Why Attention Checks Are Essential

Why Attention Checks Are Essential

Typically, when we conduct research of any type, at least two “trap questions” are included.
 
Take the following example from a 2019 study on a consumer product in which we asked: “Which word best describes two people”?
 
Did you know that more than 10% think that Walmart describes two people? These are “insights” that we can do without! Overall, 16% of the responses were (at worst) fraudulent, or (at best) inattentive.
Quality control is but one of many things we care deeply about. Please contact us to talk about how to make your customer relationships healthier through smart research and insights programs. We’re happy to chat even if there’s not a project involved. Click the icon to schedule a call.
S&F Conducts Study on 2020 Design Trends for 1stdibs

S&F Conducts Study on 2020 Design Trends for 1stdibs

1stdibs, the leading global marketplace for vintage, antique and contemporary design, has posted the results of its annual Interior Designer Trends Survey, completed by hundreds of interior designers around the world. The data reflect the tastes of design experts, informing the industry and consumers of the interior trends we will see in 2020. The findings indicate a focus on creating one-of-a-kind spaces through the use of unique, antique or customized products; a growing preference for sourcing items from local artisans and makers; green as the most on-trend color of the year; nature motifs; and an increase in the use of digital platforms for furniture purchases.

“Our partnership with 50,000 of the world’s top interior designers allows us to share the noteworthy trends anticipated for the coming year,” said Sarah Liebel, Senior Vice President and General Manager of Trade at 1stdibs. Survey responses indicate that clients want spaces that showcase unique designs. A majority of designers (55%) expect to source more artisanal and one-of-a-kind pieces in 2020, up from 49% the previous year.

Designers are increasingly using digital tools to discover pieces for their clients, and more than half (56%) say that their purchases were made online last year, compared versus 44% in stores or galleries. In addition, approximately half (49%) of designers say they shop/scan for items on Instagram.

 

Since 2017 Surveys & Forecasts, LLC has conducted this ground-breaking trends report for 1stdibs. S&F is full-service strategic research consultancy based in Norwalk, CT, and for this research conducted 700+ online interviews in Q4’19 with interior designers who are part of the 1stdibs Trade Program.
 
For more info on the findings, read the full press release here, or visit 1stdibs.
 
And let’s set up a time to discuss your research issue – click below!
SurveyMonkey & Customer Satisfaction: Perfect Together

SurveyMonkey & Customer Satisfaction: Perfect Together

Happy Birthday to SurveyMonkey, who turned 20 this week.
 

In 1999, when SurveyMonkey burst onto the scene, there were virtually no cloud-based (SaaS) DIY survey platforms in existence. Looking back, we can see that SurveyMonkey was the original “disruptor” in the online survey space: it democratized the process of gathering feedback for companies of all sizes.

 

Unlike it’s far more expensive brethren (e.g., Qualtrics, Confirmit come to mind) who use a “turnstile model” (pay per complete), SurveyMonkey is a flat rate. This lets researchers leverage the platform’s power at almost limitless scale. I can think of no other software platform that is as economical and feature-rich (see a short list of hacks below).

 

Much like disruption in other areas, everyone instinctively knew that online research would change everything. And so it was. Costs were driven lower. Project timing was vastly compressed. But there was a trade-off: the true identity of respondents was often unknown.


This opened the door to a “professional respondent” problem, automated (“bot”) survey taking, and thus outright fraud.

 

In the past 20 years, progress has been made. De-duplication technology (e.g., RelevantID) and identity technologies (e.g., Veriglif, blockchain) are creating positive disruption with solutions to improve data quality. Ultimately, newer technologies and reward structures will put more power in the hands of those who choose to participate in survey research. Data breaches have added to the pressure for more comprehensive solutions. Greater oversight and government regulation are already playing an increasingly powerful role in shaping the future of research and data collection.

 

SurveyMonkey completely changed the “price of entry” for marketing researchers and data scientists. Many tasks can be handled within an environment like SurveyMonkey. But trained professionals in marketing research understand experimental design, buyer psychology, questionnaire construction, and sources of bias that can completely invalidate a research study.

 

The question that companies must ask themselves is: do I have the skill set to grasp these issues, or to leverage the full power of this great platform?

 

As an example, here are 12 powerful SurveyMonkey hacks you should be expert in if you want to hang with the pros (you’ll need a Premier or Professional plan, but they are quite affordable):

 

  1. Block rotation: control order bias by creating identical blocks and then randomizing them. This is extremely helpful for concept screening or conjoint designs.
  2. Skip logic: use choice responses to re-direct to other questions (individual conditions by response).
  3. Advanced logic: show/hide questions/pages using multiple conditions or complex criteria.
  4. Modules: cross-link entire questionnaires by passing system variables.
  5. Stimuli: obtain reaction to concepts or full-motion video, which is easily embedded.
  6. Alerts: use the API, or services like Zapier, to send alerts and feed CRM systems or vizualization tools like Tableau.
  7. Incentives: integrate external rewards (e.g., virtual Visa or Mastercard codes) with services like Rybbon.
  8. Scoring: use algorithms to assign respondents to segments and route them through the survey.
  9. A/B Testing: this allows you to test different language for introducing a question to determine whether there is a biasing effect of wording or not. This is especially helpful in academic work.
  10. Quotas: set quotas based on specific question completion, or quotas based on total responses.
  11. Export: grab your raw data as SPSS or comma-delimited files for use in analysis packages like WinCross or visualization tools like Tableau or PowerBI.
  12. Show Off: create a custom URL for your survey to give it a more professional image, or create “white label” surveys for your company or business, or use CSS to create an entire look and feel for your business.

     

    But maybe you don’t care about these geeky details. What does this mean for you as a Research/Insights Director, Director of Analytics, Marketing VP, or a CMO?

It means that you can get world-class customer feedback for a fraction of what you are probably paying now — without paying any penalty in data quality.

Give us a call to discuss how we can work together to provide you an affordable customer satisfaction or feedback system that really works.
Using Marketing Research & Insights Intelligently To Avoid Poor Decisions

Using Marketing Research & Insights Intelligently To Avoid Poor Decisions

Do you run a marketing research and insights department, or does a function like this report to you? Having a solid research and insights function is worth its weight in gold – if it is staffed properly and has an adequate budget to complete key research tasks. But if your department is not running as smoothly as you feel it should, or if there have been missed hand-offs or errors, maybe it’s time for a tune-up – but first a little background.

Marketing research and insights teams exist because the world is an uncertain place, and the mitigation of risk (or alternatively, support of successful businesses) is an important business function. Marketing research and insights teams work best when they have the resources and autonomy to investigate customer behavior, explore trends, and the authority to (respectfully) challenge marketing assumptions that may be sub-optimal or simply wrong.

From an organizational standpoint, the head of research and insights should report to a business unit leader. Optimally, this is the President or CEO who is responsible for multiple functions, such as strategic planning, sales, marketing, R&D, customer service, and production (this assumes a traditional manufacturing model – but similar functions can be substituted for categories such as software development, financial services, e-commerce, etc).

The point is that the eyes and ears of the consumer/buyer need to have a direct pipeline to the stakeholder/business owner and key decision-makers. Research should not be beholden to the marketing function per se: the pressures of day-to-day marketing activities can easily usurp the willingness to listen to objective, fact-based decision-making found in great research departments. This is especially problematic in ad agency business models, where research and insights reports to an account team. One must ask: is the goal to understand the consumer and build the business, or simply solidify the client-agency relationship? The conflicts are obvious.

At the outset, let me make it clear that this is not a competition, nor an attempt to say one function is somehow “better than” another. Marketing research and marketing are integral to one another, yet each requires a different skill set. Marketing research is there to help marketing (and the company) succeed, working hand in glove, but with independence.
No one can argue that the pace of business is breakneck. It is unfortunate that business leaders and marketers are overwhelmed with day-to-day fires, absorbed by executional details, and frantically racing to meet promotional or product deadlines. The downside: this can severely limit their ability to focus on larger strategic and business issues, and overall brand health. The marketing function is often a casualty of limited bandwidth, strapped for resources to get even basic tasks completed.

On the flip side, marketing research is also under assault from multiple angles of attack, most notably in-house DIY research and untrained staff. A lack of thoughtful discussion and thinking can produce misleading results. This further diminishes the value and promise of what a research function could be. In today’s environment, an over-reliance on questionable algorithmic approaches, such as social listening and AI solutions, also misses the larger need to understand consumer behavior and how to build brands from that learning. At the same time, there seems to be less and less questioning of data sources and data quality: the assumption is that if it exists in digital form, it must be true. This is simply wrong.

The notion that a marketing research or insights team knows less about marketing principles than the marketing function is also a long-standing fallacy. Marketing research and insights experts have in-depth knowledge of consumer behavior, brand history, and category dynamics. Marketing research and insights can also leverage knowledge accumulated over time to guide better decisions, rather than to assume that no facts exist, so we’ll invent everything from scratch.

Here is a simple checklist to see whether you are really leveraging your marketing research and insights team to the max:
  • How do you feed your new product funnel? What role does research play in helping you generate new ideas and opportunities for future business development?
  • Do you have a planning and strategy session or process (i.e., annually) to anticipate future marketing activities? Is your marketing research and insights team invited to these meetings? If so, what role do they play? If not, why not?
  • Do your plans specify various stages of product testing, such as idea screening, concept development, or positioning and communications research?
  • How do you go about new product development and prototyping to align with your idea screening? Whether you are building a product from scratch or creating a wire-frame for a new e-commerce site, what process are you outlining?
  • Do you have an in-house product testing or evaluation function (typically part R&D), internal or external UX or sensory testing panels, or processes in place to optimize your offering?
  • Who is your target audience: what kinds of strategic research have you conducted to determine who your target audience is?
  • How do you evaluate new product introductions? Simply throw them into the marketplace and hope for the best? Or do you have a comprehensive marketing research and analytics plan to assess performance?
  • How do you benchmark ongoing business performance – are you simply looking at whether sales or units go up or down? What do your buyers say – and what do you do about it?
We know, questions are easy! But if you don’t start asking the questions about how your research function fits within the broader context of your overall new-product and innovation initiatives, chances are that you are going to go sideways rather than forward.

Needless to say, I believe in research. There are some things that research simply cannot answer: the products of genius, the subconscious, and the truly gifted inventor or designer. Research does not have all of the answers. But in the majority of cases, a business needs insights to run. Without the right team in place, your chances of success are significantly reduced.

If any of this intrigues you, or you would like to discuss the idea of building your research function into the powerhouse it needs to be, give us a call. We like discussing ways to make the research and insights function a truly beneficial one for companies of all sizes.
Surveys & Forecasts, LLC