Consumer Packaged Goods Market Research: What the Data Won’t Tell You

Consumer packaged goods market research is the practice of gathering and analysing information about shoppers, competitors, category dynamics, and retail environments to inform product, pricing, distribution, and communication decisions. Done well, it reduces the gap between what a brand assumes about its buyers and what those buyers actually do. Done poorly, it produces expensive decks that confirm what the marketing team already believed.

The CPG sector is one of the most research-intensive environments in marketing, partly because the margins are thin, the shelf competition is brutal, and the consequences of a misjudged launch are immediate and visible. That pressure creates a temptation to over-rely on research as a decision-making shield rather than a decision-making tool.

I have spent time working with brands across FMCG, retail, and consumer goods categories, and the pattern is consistent: the brands that get the most from their research budgets are not the ones running the most studies. They are the ones who are ruthlessly clear about what decision each piece of research is meant to inform. If you cannot name the decision before you commission the research, you are not doing research. You are doing reassurance.

What Makes CPG Market Research Different From Other Categories?

CPG operates under conditions that most other marketing categories do not face simultaneously. Purchase cycles are short, sometimes daily. Decisions are often habitual rather than considered. Distribution is a competitive variable in its own right. And the relationship between brand equity and shelf performance is non-linear, meaning a brand can be well-regarded and still lose at the point of purchase because its packaging blends into the fixture or its price point sits in the wrong tier.

This creates a research environment where attitudinal data (what consumers say they think and feel) frequently diverges from behavioural data (what they actually buy). A shopper might tell you in a focus group that they prioritise natural ingredients. At shelf, they pick the product with the most prominent promotional flash because the price difference is £0.60 and they are in a hurry. Both data points are true. Neither one alone is sufficient.

The other structural difference is the role of the retailer. In most categories, the brand controls its own distribution channel or at least has a direct relationship with the end buyer. In CPG, a major grocery retailer sits between the brand and the shopper, controlling ranging decisions, shelf placement, promotional calendars, and increasingly the data that brands use to understand their own performance. That creates a research dynamic where some of your most important intelligence is filtered through a commercial partner with its own interests.

For a broader look at how market research fits into strategic planning across categories, the Market Research and Competitive Intel hub covers the full range of methods and frameworks worth understanding.

Which Research Methods Actually Work in CPG?

There is no shortage of research methodologies available to CPG brands. The question is not which method is best in the abstract. It is which method is best suited to the specific decision you are trying to make. Getting this wrong is expensive, not just in research spend but in the opportunity cost of acting on data that was never fit for purpose.

Retail scan data and POS analytics are the foundation of most CPG research programs. This is transactional data pulled from point-of-sale systems, either directly from retailer partnerships or through panel providers. It tells you what sold, where, at what price, and in what promotional context. It does not tell you why, and it has a significant blind spot: it only captures what happened in stores where you have distribution. If your brand is absent from a channel or a region, that absence is invisible in the data.

Consumer panels track purchase behaviour at the household level over time, which gives you a longitudinal view that scan data cannot provide. You can see penetration rates, purchase frequency, basket composition, and switching behaviour. The limitation is that panels are a sample, not a census, and in fragmented or niche categories the sample sizes can become unreliable quickly.

Shopper observation and eye-tracking are underused in CPG relative to their value. Watching how shoppers actually move through a category, where their eyes go first, which products they pick up and put back, and how long they spend at fixture, produces insight that no survey can replicate. When I have seen brands invest in this kind of observational work, the findings almost always challenge assumptions that were embedded in the brand team’s thinking for years.

Qualitative research, including focus groups, depth interviews, and ethnographic home visits, is most valuable in CPG when the question is about meaning rather than measurement. Why does this category feel relevant or irrelevant to this shopper’s life? What role does this product play in a household routine? What would have to change for a non-buyer to consider switching? These are questions that numbers cannot answer.

Digital behavioural data is increasingly relevant even in predominantly offline categories. Search volume trends, social listening, and review analysis can surface emerging needs and category tensions before they appear in retail data. The signal is noisier than structured research, but it moves faster. At lastminute.com, I saw how quickly search data could reveal consumer intent shifts in real time, and that instinct for reading digital signals early has stayed with me across every category I have worked in since.

How Do You Build a Research Program That Informs Real Decisions?

The most common failure mode in CPG research is not methodological. It is structural. Research gets commissioned by the insights team, delivered to the marketing team, and filed by the commercial team. The three groups that most need to act on the findings are not in the same conversation, and the research ends up informing a presentation rather than a decision.

Building a research program that actually moves commercial decisions requires starting with the decision architecture, not the research calendar. What are the five or six decisions that will most affect this brand’s performance over the next 12 months? Range extension or rationalisation. Pricing repositioning. Channel expansion. Pack format change. Media budget allocation. Each of those decisions has a specific information gap, and research should be designed to close that gap, not to produce a general category understanding.

I have sat in enough agency pitches and client briefings to know that “we want to understand our consumer better” is not a research brief. It is an expression of anxiety. The brands that spend their research budgets well are the ones who can say: “We need to decide whether to launch a premium tier in the next financial year, and we need to know whether there is a credible price ceiling in this category and whether our brand has the permission to reach it.” That is a brief you can design research around.

Timing matters as much as methodology. In fast-moving categories, a six-month research program that produces a definitive answer to a question that was already decided three months ago is not insight. It is archaeology. CPG brands operating in volatile categories, particularly those exposed to commodity price swings, promotional competition, or rapid own-label growth, need research cadences that match the pace of the category, not the comfort of the research agency.

What Does Competitor Intelligence Look Like in CPG?

Competitive intelligence in CPG is partly structural and partly behavioural. The structural layer is relatively straightforward: market share data, distribution coverage, pricing architecture, promotional frequency, and new product development activity. Most of this is available through syndicated data providers or can be assembled from retail audit data and public sources.

The behavioural layer is harder and more valuable. How is a competitor positioning itself with different retailers? What is its ranging strategy by channel? Where is it investing in media and shopper marketing? What claims is it making on pack, and are those claims resonating with shoppers? This kind of intelligence requires active monitoring rather than periodic reporting, and it requires someone who is synthesising signals across multiple sources rather than reading a single dashboard.

One area that CPG brands consistently underinvest in is understanding the competitive set from the shopper’s perspective rather than the brand’s perspective. A brand might define its competitive set as other products in its immediate sub-category. The shopper might be making a completely different trade-off, choosing between your product and a meal kit, or between your product and eating out. If your research is only looking at within-category competition, you are missing the actual substitution behaviour that is driving your volume trends.

Tools like Hotjar’s product design research tools are more commonly used in digital product contexts, but the underlying principle, understanding how real users interact with a product or interface rather than how designers assume they do, translates directly to CPG shopper research. The question is always: what is the gap between what we designed and what the shopper experiences?

How Should CPG Brands Use Retailer Data Without Being Captured By It?

Retailer data is one of the most powerful inputs available to a CPG brand and one of the most dangerous. It is powerful because it is granular, current, and directly tied to the commercial environment where your brand lives or dies. It is dangerous because it is provided by a commercial partner whose interests are not identical to yours.

A major grocery retailer sharing category insight with a supplier is not doing so out of generosity. It is doing so to support a ranging or promotional conversation, to encourage investment in a particular format or channel, or to justify a change to shelf allocation that benefits the retailer’s own-label range. None of that makes the data wrong, but it should make you careful about how you interpret it and what decisions you allow it to drive.

The practical answer is triangulation. Any significant commercial decision that rests primarily on retailer-provided data should be tested against at least one independent source. Consumer panel data, your own direct-to-consumer or e-commerce sales where available, and independent shopper research can all provide a check on the picture that a retailer is presenting. If the stories align, you can act with more confidence. If they diverge, that divergence is itself valuable information.

Measuring brand health independently of retailer data is also worth taking seriously. Moz’s breakdown of why brand measurement matters is rooted in a digital context, but the argument applies equally in CPG: if you only measure what the retailer measures, you will only see what the retailer wants you to see.

Where Do CPG Research Programs Most Commonly Go Wrong?

Having worked across agencies that served CPG clients at various scales, I have seen the same failure patterns repeat with enough consistency to be worth naming directly.

Confirmation bias in research design. The brief is written by people who already have a view, and the research is unconsciously designed to validate it. This shows up in survey question framing, in the selection of focus group stimuli, and in how findings are filtered before they reach senior decision-makers. Good research agencies push back on briefs that are leading the witness. Many do not.

Treating awareness metrics as a proxy for brand health. Awareness is easy to measure and often looks good, which makes it a popular reporting metric. But in CPG, a shopper can be fully aware of your brand and still reach past it to pick a competitor. The metrics that matter are penetration, purchase frequency, and the reasons for non-purchase among aware non-buyers. Those are harder to measure and less flattering, which is probably why they appear in fewer board decks.

Conflating category growth with brand performance. In a growing category, almost every brand looks like it is doing well. The question is whether you are growing faster or slower than the category, and whether you are building the kind of penetration and loyalty that will hold when category growth slows. I have seen brands celebrate three years of double-digit growth only to discover that they had been riding a category wave and had actually been losing share the entire time.

Under-investing in pre-launch research and over-investing in post-launch analysis. There is a tendency in CPG to commission extensive tracking studies after a launch to understand what went wrong, while skimping on the concept testing, pack research, and price sensitivity work that might have prevented the problem. Post-launch research is valuable, but it is expensive learning. The same budget spent earlier in the process is usually worth more.

Ignoring the research that already exists. Early in my career, when I was building things from scratch with almost no budget, I learned quickly that the most valuable resource is often the one you already have access to but have not fully used. The same is true in CPG research. Most large brands are sitting on years of consumer data, tracking studies, retail audits, and shopper research that has never been properly synthesised. Before commissioning new research, the question should always be: what do we already know, and what is the specific gap that new research would fill?

For anyone building or reviewing a CPG research strategy, the Market Research and Competitive Intel hub has additional frameworks for structuring research programs that connect to real commercial decisions rather than just producing insight for its own sake.

How Is Digital Changing CPG Market Research?

The shift toward e-commerce in grocery and FMCG, accelerated significantly in recent years, has changed the data landscape for CPG research in ways that are still working themselves out. Online grocery generates a level of behavioural data granularity that physical retail never could: search terms used, products viewed but not purchased, basket abandonment points, the effect of product page content on conversion. This is genuinely new intelligence for categories that previously had to infer most of this from surveys and observation.

The challenge is that most CPG brands are still predominantly offline businesses, and the shopper behaviour on a grocery app does not always translate cleanly to in-store behaviour. A product that performs well in search-driven online grocery may struggle on a physical fixture where it is competing on visual distinctiveness rather than keyword relevance. Research programs need to be designed with channel specificity in mind rather than assuming that digital insight generalises to all purchase contexts.

Social listening and community monitoring have also become more relevant as a signal layer. Consumer conversations about food, health, household products, and personal care categories are extensive and often candid in ways that structured research is not. Understanding how language and sentiment shift in social contexts can surface emerging needs and category tensions before they appear in retail data or structured tracking. The signal is noisier than structured research, but it moves faster, and in CPG, speed of insight can be a genuine competitive advantage.

Privacy changes are also reshaping what is possible with digital data in CPG research. The deprecation of third-party cookies and increasing restrictions on data collection have reduced the precision of digital audience targeting and, by extension, the precision of digital consumer research. Brands that built their insight capability on third-party data are having to rethink their approach. Privacy-compliant research methodologies are becoming a strategic requirement rather than a compliance checkbox.

The broader shift in how marketers think about data investment is worth acknowledging. The pressure to double down on digital data capability is not new: MarketingProfs documented the anticipated surge in digital data spending well over a decade ago. What has changed is that the infrastructure now exists to act on that ambition, but the analytical capability to interpret the data well has not kept pace with the volume of data being generated.

What Does Good CPG Research Output Actually Look Like?

The output of CPG market research should be a decision, or at minimum a clear recommendation toward a decision, not a summary of findings. This sounds obvious. It is not how most research reports are written.

A good research output in CPG answers three questions. First: what did we find? Second: what does it mean for this specific commercial decision? Third: what should we do as a result? If the report answers the first question thoroughly and gestures vaguely at the second and third, it is a data document, not a research output.

The best research presentations I have seen, across agency and client-side contexts, are ones where the insight team has done the hard work of translating findings into implications before they walk into the room. They have not just reported that price sensitivity is higher than expected. They have said: at the current price point, our modelled volume at launch is X, and if we move to the lower price point, the volume case looks like Y, but the margin case looks like Z, and here is our recommendation. That is what research is for.

Cadence matters too. A single annual deep-dive is not a research program. It is a snapshot. CPG categories move continuously, and a research program should include a mix of continuous tracking (brand health, distribution, pricing), periodic deep dives (category dynamics, shopper segmentation, innovation pipeline validation), and rapid-response capability for when the market does something unexpected. Building that kind of layered program requires a clear view of what each layer is for and how the outputs connect to the commercial calendar.

About the Author

Keith Lacy is a marketing strategist and former agency CEO with 20+ years of experience across agency leadership, performance marketing, and commercial strategy. He writes The Marketing Juice to cut through the noise and share what works.

Frequently Asked Questions