Understanding the Qualtrics Layoffs

 

image wall street sign

I was sorry to see that Qualtrics recently laid off 780 positions (October 2023), coming on the heels of 270 layoffs back in January of 2023. This represents about 20% of the Qualtrics workforce. Having once gone through that painful experience in my career, I remember the anxiety and stress it caused when the floor dropped out from underneath me. I hope that everyone affected is able to find new opportunities as quickly as possible.

News articles from tech publications have explained the layoffs as a contraction following COVID-driven hiring and staffing up to meet demand – but Qualtrics it is not Amazon and doesn’t compete in the direct-to-consumer space, so the comparison doesn’t quite line up. So what forces are at play that may have resulted in these layoffs? I see a few inter-related things: 

  • Marketing research isn’t a high-growth business, and survey research in particular is a mature one. Big firm research growth has slowed due to a proliferation of DIY platforms, more reliance on digital evaluation (e.g., MTA, social media listening), and less need for user input at earlier stages of product development. The growth in questionnaire-based survey research is less than 2% per year.

  • The Qualtrics “experience management” strategy included horizontal expansion into other areas of the enterprise, such as human resources, that run on feedback. The growth rate of this strategy has also slowed. Small- and mid-cap organizations represent a less attractive segment because they don’t do as much research or tracking, and their projects are typically much smaller.

  • A major revenue source at Qualtrics is satisfaction tracking, especially programs built around NPS. You’ll recall that in 2003, NPS was touted as “the one number you need to grow” your business. Gartner has predicted that more than 75% of organizations will abandon NPS as a measure of success by 2025 due to a lack of correlation with metrics like sales or retention.
  • NPS programs also have great margins and are insulated (that is, once up and running, they are hard to dislodge). But with NPS programs dissolving, Qualtrics must make up that revenue with ad hoc projects and compete directly in the traditional survey space with capable lower-cost providers.
  • Qualtrics plans to spend $500 million on AI over the next four years to leverage “the world’s largest database of human sentiment”. But with AI more ubiquitous, this new strategy could be a major drag on earnings. And exactly whose sentiment will be used to train the models and shared with the rest of the world – the proprietary data of their clients? And by leaning hard into AI, even less staff may be required.
  • Perhaps the most obvious reason for the recent layoffs at Qualtrics is that Silver Lake et al (which completed its acquisition in June 2023) needs to see a return on its $12.5 billion investment. Cutting staff is the easiest lever to pull, especially if growth has slowed. That will make the balance sheet look healthy, even if growth prospects are muted.

You might recall, back in November 2018, SAP purchased Qualtrics for a hefty $8 billion. That union was touted as a way to accelerate a new “XM category”. The goal was to combine experiential and operational data to power the “experience economy”. But “experience management” didn’t seem to gain momentum,  and with a clash of cultures, SAP quickly spit out the frog it had swallowed – something I had predicted in a post back in 2018. Once all of these hard times have passed, I expect Qualtrics to be refloated as an IPO by 2026 or so. That will please the private equity folks.

For more information about our custom research services and new product development programs, please get in touch at info@safllc.com.

The Digital Marketing Alienation Problem

Consumer alienation can happen quickly. Does anyone remember New Coke? More often, it happens slowly, almost imperceptibly, because alienation is obscured by our broader human experience which is found in our collective consciousness.

While consumers seek novelty and variety, there is a saturation point. Evidence indicates that buyers are increasingly detached from brands, products, and even entire categories because of the way they are digitally over-marketed.

What do we mean by “consumer alienation”? In brief, it is the process by which consumers lose interest in brands and services due to (1) the failure of marketers to communicate with buyers and prospects in a way that is trustworthy and respectful; and (2) the emotional connection between buyers and brands has been damaged. Digital over-marketing only compounds these problems.

When companies excessively use digital marketing approaches, we (collectively as marketers) do nothing to cement the emotional bonds we hope to establish. Rather, we put people into predictable “sales funnels” (which are quite transparent to consumers, by the way) that treat consumers very robotically.

When hundred of companies use the same approach; consumers are overwhelmed. A consumer quickly realizes that they are cogs in a much bigger marketing machine (many brands x many campaigns x many time periods). Then, without a clear message and against a backdrop of digital noise, brands lose the stickiness needed to build ROI over the long term. As prospects fall further into the sales funnel, they filter out more, and fall further away from your brand. At Surveys & Forecasts, LLC we focus on important marketing developments like these with many of our clients.

Digital Marketing Creates Consumer Alienation

I suppose that we can’t blame marketers. Digital marketing reaches a target audience pretty efficiently and can promote your business when the message is clear. However, marketers are tempted to use all available resources (e.g., personal information) to stimulate consumers buying. This morphs into “depersonalization”. Consumers then feel alienated because personal information and preferences are used excessively without clear consent.. When every company and brand uses their information to market to them, trust in all brands is quickly eroded.

A brilliant colleague of mine has conducted many studies to prove that marketers can achieve significant increases in ROAS when media dollars are targeted at moderately active buyers within a category (i.e., the “moveable middle”). Yet one wonders about the linkage between heavily digitally targeted (or perhaps over-conditioned) buyers and the impact on their emotional connection to the brand long-term. Does over-targeting and over-marketing create alienation?

Sales Funnels and Trust

Sales funnels are powerful tools for marketers, but they have their drawbacks. They cause consumer alienation and can reduce trust between companies and customers by aggressively encouraging buyers to take incremental steps towards a purchase decision. Typically this starts with low-cost items (i.e., freemium trials) but quickly moves to full-priced subscriptions or premium services. This process is known as “nudging”, because it nudges you into buying more than you might otherwise want. This assumes that consumers will behave robotically rather than as intelligent beings who make reasonably rational buying decisions. The approach is fundamentally cynical, and has consequences for companies, brands, and society-at-large. Increasingly, consumers are asking: am I being manipulated yet again?

Is Technology a Solution?

Tech has the potential to improve digital marketing practices. AI and machine learning can be used to target consumers in a more modulated, ethical, and dare I say emotional way(!) with more deeply personalized, yet appropriate, marketing messages. Tech and the use of AI is already leading to consumers being over-served content that they don’t want or need. Social media platforms like TikTok, Facebook, and Instagram offer little transparency around ad serving or data collection practices.

Marketers have access to an unprecedented amount of personal data about consumers. Should they use all of it? While I am a free thinker, to avoid manipulation perhaps some regulation is needed to place limits how much information marketers can collect from users — and what strategies they are allowed to use when targeting consumers. Consumers have the power to vote with their feet and their dollars by choosing brands that respect their privacy and do not digitally abuse them.

Avoid alienating your customers with excessive digital marketing efforts by making sure that you understand what consumer alienation really is and know how it affects relationships between your buyers and your brands. Digital marketing methods can be used to create positive experiences, but only when they’re ethical, responsible, and not excessive.

To talk more about customer alienation — please reach out.. For more information about our services and customer feedback programs, please visit the Surveys & Forecasts, LLC website or get in touch at info@safllc.com.

How to Use Trade-Off Analysis

image puzzle

Potential buyers of a product or service consider many factors when deciding what to buy, and potential sellers must decide on the factors to offer and at what price. Buyers typically place their own economic self-interests first: spend the least amount of money, time, and effort to get the product or service they want. Companies want to satisfy customer needs but also have a competing objective: to find the factors that maximize appeal, revenue, and profit.

The general class of research designs that deals with intersecting (conjoined) variables in a structured manner is called conjoint analysis (covered in a previous post). Conjoint analysis involves reaction to, and statistical relationships between, factors in choice decisions. A “factor” is part of the choice criteria used to make a buying decision. A factor also has characteristics, features, or benefits that vary called “levels”. Simple examples of factors are price, quantity, and size. Some real-world examples might include:

  • An industrial paint sprayer company might offer a unit with multiple hose lengths, paint capacity, nozzle diameter, or spray wand length.
  • A new credit card with different levels of an annual fee, number of airline points per dollar spent, levels of travel protection coverage, or access to airport lounges.
  • A laptop manufacturer may offer different screen sizes, keyboard layouts, processor speed, graphics cards, memory, hard disk size, or bundled software.

In each of these examples there might be just one or two levels per factor, or perhaps many more. In its entirety, one set of combinations (factors x levels) could be rendered as a series of concept description (e.g., known as a “full profile” design) typically used in new product development and optimization. In other cases, such as competitive preference testing, options are shown as sets of choices to respondents (e.g., choice modeling or discrete choice designs). We then obtain demand estimation through intent to buy or intended volumetric consumption.

As complexity increases (more factors with more levels), the number of possible combinations of products grows exponentially. For example, four factors with three levels each produces 34 = 81 unique combinations. Theoretically, we could show all 81 combinations to a single respondent – but would we want to? Poor quality data and exhausted subjects are two good reasons not to.

Conjoint analysis solves for the problem of too many combinations by showing each subject a randomized subset of all possible combinations, also known as a partial factorial design (i.e., a subset of the complete factorial design). Features or characteristics of a product or service are sequentially exposed using concept descriptions and simple explanations. In most studies we recommend a basic explanation of the exercise to familiarize respondents with the category and tasks. Concept features and levels then vary by subject in the overall matrix of combinations. In simplistic terms, this akin to Swiss cheese: we know what the overall shape is (complete design), but there are holes inside (partial exposure).

In conjoint analysis we strive for balanced “orthogonal” designs in which an equal number of factor x level combinations are shown to a respondent, usually as a set of even numbers (i.e., 8, 12, or 16). As expected, more complex conjoint designs require much larger sample sizes for statistical reliability. From this we interpolate demand curves for each factor (e.g., price, size, quantity) and also assess overall demand for the optimal combination of factors that maximize consumer appeal. In addition to demand curves for each factor, and identification of the optimal combination of factors, additional outputs include simulation and revenue estimation for the optimal set (there may be multiple) of product configurations.

Deficiencies of Conjoint Designs

Conjoint designs assume that:

  • Screening criteria accurately reflect the true target market.
  • Respondents are consistent and rational in decision making.
  • Alternatives are meaningfully different (subtle differences may produce no test effect).
  • Realistic combinations of factors and levels are always shown (non-confounding design).
  • Buyers and buying decisions seek maximum benefits at the lowest price. This may not be true depending on a category, such with overwhelming altruistic or social cause benefits.
  • Price has linear and important, but not overwhelming, influence on choice. Respondents may quickly become sensitized to pricing which may exaggerate true differences.

As you might tell from the above, the design and the screening criteria, as well as the factors and levels chosen for exposure, are a huge factor in making sure that the conjoint results ultimately make sense. A simulator provides scenario testing using different combination of features and using the utility scores that were generated from the respondent sample. Conjoint utility scores are converted to a scaled value (in the above case, a 65% interest level). When applied against an interested target or segment, an estimate of penetration can be developed. Sales estimation would need to be confirmed with additional forecasting and analysis (an additional stage of work).

From the same research study, a max-diff analysis of individual features was performed (i.e., based on preference ranking). Scores are preference “votes” based on a series of choice exercises, ranked from high to low. You can see from this slide that higher paint transfer efficiency (through the nozzle), ease of operation, higher paint transfer efficiency (from container), reduced mist, and less likelihood of bursts or droplets were the top items. Mechanical function items were lower on the preference hierarchy

This snapshot attempted to show the range of conjoint designs and approaches that could be used depending on a client’s needs. Each individual design is based on the considerations of the business decision that needs to be made and the number and complexity of choices to be evaluated by respondents.

For more information, please contact:
Bob Walker, CEO
Surveys & Forecasts, LLC
https://safllc.com
+1.203 255.0505

Conjoint Analysis: What It Is and Why It Matters

In today’s crowded marketplace, it’s more important than ever to understand what drives consumer preferences. That’s where conjoint analysis comes in. Conjoint analysis is a research method used to understand how consumers value different attributes of a product or service.

At its core, conjoint analysis involves presenting consumers with a series of hypothetical product or service profiles, each containing different combinations of attributes. Respondents or prospects must make choices which require that they “trade off” between options. For example, if you were conducting conjoint analysis for a new car, you might present participants with combinations of attributes, such as price, fuel efficiency, horsepower, and style. By analyzing the choices consumers make between these profiles, including price, researchers can determine the relative importance of each attribute in driving consumer preference.

There are two main types of conjoint analysis: traditional full-profile conjoint analysis and adaptive conjoint analysis. Traditional full-profile conjoint analysis presents participants with a fixed set of product profiles, while adaptive conjoint analysis uses a computer algorithm to adjust the profiles presented to each participant based on their previous choices.

Conjoint analysis has many applications in marketing research. It can be used to optimize product design, pricing, and marketing messaging. For example, if a company is considering launching a new product with different feature sets at different price points, conjoint analysis can help determine the optimal combination of features and price to maximize sales.

Conjoint analysis can also be used to understand how different customer segments value different attributes. This can include emotional drivers, such as attitudes and beliefs when building a brand’s core positioning. By analyzing the choices of different demographic groups, researchers can gain insight into how different segments of the market value different features.

While conjoint analysis can be a powerful tool for understanding consumer preferences, it’s important to keep in mind a few limitations. For example, conjoint analysis assumes that consumers make rational choices based on the features presented to them. In reality, consumers may be influenced by factors outside of the product attributes themselves, such as brand loyalty, emotional appeal, or social issues that affect their choice criteria. Price is also highly biasing, hence options must be presented in a realistic context.. Additionally, conjoint analysis is only as good as the attributes and levels included in the analysis, so it’s important to carefully consider which attributes to include.

Overall, conjoint analysis can be a valuable tool for marketers looking to understand consumer preferences and optimize their product offerings. By presenting hypothetical product profiles and analyzing consumer choices, conjoint analysis can provide insights into how different attributes drive consumer preference, helping companies make data-driven decisions about product design, pricing, and marketing.

Buyers of your product or service will consider many factors when deciding what or how to buy, and as a company you must decide on what to offer, and at what price, to maximize profit. If your product development roadmap has stalled, conjoint analysis is definitely something to consider. For more information about conjoint analysis or other research services, please visit the Surveys & Forecasts, LLC website or get in touch at info@safllc.com.

Are You Marketing to the “Moveable Middle”?

Companies that focus on buyers who have bought your brand – even at a minimal level – are significantly more likely to shift more of their total share of consumption to you. First you must find them, and then target them effectively with incremental ad spending.

A recent study by the Mobile Marketing Association focused on a common consumer category and showed that those with a 20%-80% propensity to buy a brand are much more responsive to incremental advertising. Those living in the “tails” of the buyer distribution are either (a) basically non-responsive because they buy so little from you, or (b) are already so loyal that additional ad spending has no incremental effect. Within this middle band of buyers, the power of your incremental targeted advertising is very strong. The bonus: ad campaigns built around the moveable middle also improved reach.

So who are these buyers in the so-called “moveable middle” of your brand’s overall profile of users? Unlike promotionally-driven “brand switchers”, the moveable middle segment represents buyers at many different levels of past purchase behavior who relate to your brand story. Their responsiveness to advertising grows as their share of category needs approaches the center of this distribution. Decreasing marginal returns occur at the tails. The movable middle holds many more attitudinally receptive, persuadable buyers as defined by their mid-range probability of buying your brand.

The result of this recent research shows that the moveable middle of a company’s product user base can be 5x-10x more responsive to advertising than buyers at the tails. This makes incremental advertising and marketing spending against this middle segment of buyers an incredibly fertile area to allocate incremental ad dollars because the return on ad spend (ROAS) is so high. There are several reasons why this is true:

  • Those who are already buying your company’s products or services are not buying all of their category needs solely from you. This volume can be significant, but it is likely hidden from you. This implies that they have much larger volumetric needs than they are directly telling you as one manufacturer.
  • There is a high probability that products in the category have not been effectively differentiated, and benefits or features that are important to buyers have not been captured by you. Additional ad spending highlights those differences and motivates additional purchases. Optimizing your messaging is clearly indicated here, too.
  • Buyers who are already buying 20%-80% of their category needs from you are more receptive to your message. This forces them to exclude other alternatives once your message is received.
  • The movable middle already has the advantage of familiarity with your brand or product. They know the things you can provide. Advertising doesn’t need to work as hard among people who have familiarity. It doesn’t have to generate awareness: rather it simply refreshes you in consumers’ minds.

Marketing and advertising plans focused on the moveable middle almost always yield better response curves to incremental media spend than dollars spent on reach and frequency. Recent academic research has attempted to dispel this notion. They believe that marketers should target broadly (i.e., to all buyers). It is true that buyers continuously enter and exit a category, hence on its face this makes some intuitive sense. However, this thought process (a) ignores that buyer entry and exit can be quite slow, and as a result (b) the ROAS of a reach-only based plan will be low. It takes significant amounts of time and ad spend to generate even small increases in awareness-to-trial conversion. A company may not have a 3-, 5-, or 10-year window to see if their strategy was effective at bringing in new buyers. By then, the company could be out of business!

Certainly, some ad spending must focus on long-term brand building, but with increased direct and digital relationships with customers (1st party data), it makes no sense to ignore your own ability to target those we know are receptive to your product story. Focusing on the movable middle is an “outcomes” or “performance-based” marketing concept that complements your longer-term brand building initiatives. Strategic brand marketing is needed to support the core product story and promote user differentiation, but properly targeted media delivery generates much higher reach-to-conversion, and therefore longer-term retention of the customer to the business. And it has the nice side effect of increasing reach, too.

Caveat: over-targeting or over-promoting can have negative longer-term consequences that can diminish responsiveness to additional media spending: there must be a balance. Exclusively focusing on the movable middle at the expense all other initiatives to build brand equity fails to recognize that new buyers do enter the category from sources other existing buyers. But the evidence that focusing on the moveable middle of your own brand’s buyer distribution is a smart and effective way to start..

At Surveys & Forecasts, LLC we have conducted numerous targeted media and research programs that focus on the movable middle, and proved the ROAS power of incremental spend. For more information, contact us info@safllc.com. We look forward to hearing from you!

Improving Acquisition Success in Family Offices

In the acquisition process, revenue metrics are critical to assess business value. However, the need to assess customer health is often overlooked. In customer-facing businesses, this is especially dangerous.

Without a clear “line of sight” into customer satisfaction and retention, an acquiring company (e.g., family office, VC, or angel investor) may overlook evidence that indicates an acquisition may not result in incremental revenue or synergy with existing businesses.

For businesses that are sold using a revenue multiplier, a significant miscalculation can result in a lower exit price. Both family offices and business owners do not realize the hidden factors that can negatively impact a sale. As the deal size grows, those risks increase.

Conversely, hidden positive factors can surprise to the upside, and support a significantly better acquisition price or sales story. As part of an acquisition and revenue assessment, looking at the entirety of your customer or user base is essential to understand the real value of the business now and into the future.

Who benefits from a revenue and customer health assessment?

Investors and family offices of every size can benefit, but there are three distinct beneficiaries of a revenue optimization and customer health assessment when a business is bought or sold. They are:

  • The business owner who wants to maximize his or her exit value.
  • The potential buyer (family office, angel investor, or VC) who wants to minimize the price paid.
  • Another party who may be in dispute with the owner, and who wants to minimize the price that they pay (or conversely, maximize their ownership share of the business).

Conflicting interests can be addressed through a well-executed revenue and customer health assessment using research. The approach used by Surveys & Forecasts, LLC evaluates revenue potential and customer health in a systematic and independent manner:

  • We employ a variety of tools to estimate prospects for growth, forecast volume, share, and satisfaction.
  • We profile relevant products, brands, and services to assess your competitive position.
  • We combine findings to provide an unbiased estimate of revenue potential. We can combine this with financial professionals who have the tools to assess performance in the absolute and relative to a peer group.
  • We work with clients on a per project or ongoing retainer basis to provide guidance and market intelligence for the business.

Additional detailed information can be found here, To discuss whether a revenue optimization and customer health assessment is appropriate for an acquisition your office is considering, please get in touch at info@safllc.com or at +1.203.255.0505.

Surveys & Forecasts, LLC