How to Evaluate a Digital Marketing Agency Before You Sign

Evaluating a digital marketing agency well is one of the most commercially important decisions a marketing leader makes. The wrong choice costs you time, budget, and often internal credibility. The right one compounds over years. Most evaluation processes focus on the wrong signals, which is why so many businesses end up disappointed six months into a contract.

A sound evaluation framework looks past the pitch deck and the case studies and asks harder questions: about how an agency actually thinks, how it manages commercial accountability, and whether its working model fits your business, not just its portfolio.

I spent more than two decades on the agency side, including running an agency through a period of significant growth and a commercial turnaround. I have been in hundreds of pitches, on both sides of the table. I have seen agencies win business they were not equipped to deliver, and I have seen clients choose the wrong partner because they were dazzled by a polished presentation from a senior team that would never actually work on their account. What follows is how I would approach an agency evaluation if I were doing it today.

If you want broader context on how agencies operate and what separates the good ones from the rest, the Agency Growth & Sales hub covers the full landscape, including how agencies are structured, how they price, and what the relationship looks like from the inside.

What Does a Good Agency Evaluation Actually Test?

Most evaluation processes test presentation skills. The agency that wins is often the one with the best slide design, the most confident presenter, or the most impressive-sounding client list. None of that tells you much about what it will be like to work with them in month four, when the initial enthusiasm has faded and the real work has started.

A well-designed evaluation tests four things: strategic thinking, commercial accountability, operational fit, and cultural alignment. Not all four carry equal weight for every business, but skipping any of them leaves a blind spot that tends to surface at the worst possible moment.

Strategic thinking is about whether the agency understands your market and your problem, not just your brief. Ask them to push back on something in your brief. If they agree with everything, that is a red flag. The best agency relationships I have seen, and the ones that lasted longest, were built on a degree of productive tension. You want an agency that will tell you when you are wrong.

Commercial accountability is about whether the agency is willing to be measured. Not every agency will agree to performance-linked fees, and that is not always the right model anyway. But any agency worth working with should be able to articulate clearly what success looks like, how it will be measured, and what happens when performance falls short. Vague answers here are a warning sign.

How to Structure Your RFP Before the Pitches Start

Before you invite any agency to pitch, you need a clear brief. This sounds obvious, but the number of businesses that go to market with a vague request for “digital marketing support” is remarkable. A poorly defined brief attracts agencies that are good at pitching, not necessarily good at delivering.

A strong RFP for digital marketing services does several things at once. It communicates your actual business problem, not just your marketing wish list. It sets out your budget parameters honestly, because asking agencies to pitch without a budget range wastes everyone’s time and produces proposals that are either wildly over-engineered or deliberately vague. It also signals to the agency what kind of client you will be, which matters more than most businesses realise.

Good agencies are selective. They turn down briefs that are not a fit. If your RFP is unclear, poorly structured, or asks for speculative creative work without compensation, you are less likely to attract the agencies you actually want. You are more likely to attract the ones who will pitch anything.

Include in your RFP: your business objectives (not just marketing objectives), the channels you are considering, your current performance baseline, your internal team structure, your decision-making timeline, and a clear statement of what you will and will not evaluate on. The more specific you are, the better the responses you will get, and the easier the evaluation becomes.

What to Look For in the Pitch Itself

When I was running new business at agency level, I noticed that the pitches we lost on quality were almost always the ones where we had not fully understood the client’s commercial context. The pitches we lost on politics or relationships were a different matter. But the quality losses came from pitching solutions before we had properly diagnosed the problem.

Watch for the same thing in reverse when you are evaluating. An agency that leads with a channel recommendation before it has asked about your customer acquisition economics is telling you something important about how it thinks. Channels are a means to an end. An agency that leads with “we think you should be doing more on paid social” before it understands your margin structure, your customer lifetime value, or your existing conversion rates is working backwards from its own capability set, not from your business problem.

Ask every agency the same set of questions, and ask them in the same order. This makes comparison much easier and stops you being swayed by the order in which you see the pitches. Some specific questions worth including:

• What would you not do for a business like ours, and why?
• Tell us about a client relationship that did not work out. What happened?
• Who will actually work on our account day to day, and what is their experience level?
• How do you report on performance, and how often?
• What does your onboarding process look like, and how long before we should expect to see meaningful results?

The question about who works on your account is particularly important. It is common in agency pitches for senior people to present and junior people to deliver. That is not inherently wrong, but you should know the structure going in. Ask to meet the team that will actually run your account, not just the people who closed the deal. Personalisation in the pitch process is a positive signal, but it needs to extend to the actual working relationship, not just the presentation.

How to Read Case Studies Without Being Misled by Them

Case studies are the primary evidence most agencies offer, and they are also the most carefully curated part of any pitch. Every agency shows its best work. The question is not whether the results are real, it is whether they are relevant and whether the agency actually understands why they happened.

Push on causality. If an agency shows you a case study where organic traffic doubled, ask what specifically drove that. Was it a technical fix, a content programme, a link acquisition effort, or did the client’s brand get a lift from something unrelated to the agency’s work? Good agencies can answer this precisely. Agencies that cannot tend to conflate correlation with contribution.

Ask for a case study that did not go to plan. How an agency handles failure tells you far more about its culture and its client relationships than its highlight reel does. I have sat in Effie Award judging sessions and seen the work that gets entered versus the work that actually moved business. The gap is sometimes significant. Effectiveness is harder to demonstrate than creativity, and it is harder to fake in a real conversation.

Also consider whether the case studies are from businesses that resemble yours. An agency that has delivered strong results for direct-to-consumer e-commerce brands may think very differently about a B2B professional services client. The skills overlap, but the commercial logic is different. The range of services an agency offers matters less than whether it has applied those services in a context that is genuinely comparable to yours.

Specialist Agency or Full-Service: Which Evaluation Framework Applies?

The answer to this question shapes everything about how you evaluate. A specialist SEO agency and a full-service agency are not interchangeable, and evaluating them on the same criteria produces a distorted picture.

Understanding what a full-service marketing agency actually means in practice is a useful starting point. The term covers a wide range of operating models, from genuinely integrated agencies with in-house capability across all channels to holding company structures that are essentially a collection of specialist agencies under one roof. The billing model and the actual working structure can be very different from what the name implies.

If you are evaluating a specialist agency, focus your assessment on depth of expertise in that specific channel, the quality of their methodology, and how they integrate with your other partners or internal teams. If you are evaluating a full-service agency, the integration question becomes central. How do the teams actually work together? Is there a single strategy lead who coordinates across channels, or are you effectively buying a bundle of separate services that will need to be coordinated on your side?

Some businesses are better served by a lead agency with specialist partners than by a single full-service provider. Others benefit from the simplicity of a single point of accountability. There is no universal answer, but the question is worth resolving before you start the evaluation, not after you have received the proposals.

The Commercial Model: What the Contract Tells You

I have seen more agency relationships sour over contract terms than over creative disagreements. The commercial model is where an agency’s actual priorities become visible, and it is worth scrutinising carefully before you sign anything.

Retainer structures are the most common model in digital marketing. An inbound marketing retainer, for example, typically bundles strategy, content, and channel management into a monthly fee. The question is what that fee actually covers, how scope is defined, and what triggers an out-of-scope conversation. Agencies that are vague about scope boundaries tend to use scope creep as a revenue mechanism. That is not always cynical, sometimes the work genuinely expands, but you should understand the mechanism before you are in the middle of it.

Look at the notice period. A 90-day notice period is standard and reasonable. Anything longer than that, especially combined with a minimum term of 12 months, is worth questioning. It is not necessarily a dealbreaker, but it does shift the risk profile of the relationship in the agency’s favour. If the agency is confident in its ability to deliver, it should not need to lock you in for extended periods to protect its revenue.

Also look at how the agency handles data ownership. Your CRM data, your ad account data, your analytics data: all of it should remain yours, and access should be non-negotiable. Agencies that manage accounts in their own master accounts rather than client-owned accounts create a dependency that makes switching harder. That is sometimes a practical decision rather than a deliberate tactic, but the effect is the same.

Understanding how agencies handle their own finances, including how they account for media spend, third-party tools, and subcontracted work, is also worth understanding. The financial structure of a marketing agency affects how it prices, how it reports, and where its commercial interests lie. Transparency here is a positive signal.

Channel-Specific Evaluation: What to Ask About Specific Services

Different channels require different evaluation criteria. A paid search specialist should be able to walk you through their bidding philosophy, their approach to match types, their view on automation versus manual control, and how they think about attribution. If they cannot, they are probably managing campaigns by following platform recommendations, which is a low-skill approach that rarely produces strong results.

Early in my career, I ran a paid search campaign for a music festival and saw six figures of revenue come in within roughly 24 hours from a relatively simple campaign. The insight was not technical, it was commercial: understanding what the customer actually wanted to buy and making it easy to find. Good paid search thinking has not changed much since then. It is still about commercial intent, relevance, and friction reduction. Ask any agency you are evaluating to describe their approach in those terms, and see how they respond.

For social media, the evaluation question is about strategy versus execution. Many businesses outsource social media marketing because the execution is time-consuming, but the strategic decisions, voice, positioning, audience targeting, should not be outsourced entirely. Ask the agency how it handles the boundary between what it decides and what the client decides. Agencies that want full creative control without client input tend to produce work that is polished but disconnected from the business.

For SEO, ask about their approach to technical audits, their content methodology, and how they think about link acquisition. The range of approaches in SEO is wide, and the quality gap between good and mediocre practitioners is significant. Ask them to explain something they would not do, and why. The answer tells you more than a list of what they offer.

Evaluating Agencies for Niche or Specialist Contexts

Some industries require agencies with specific sector knowledge. The evaluation criteria shift when the business context is highly specialised. A firm looking at marketing for staffing agencies, for example, needs a partner who understands the dual-sided nature of that market, the need to attract both clients and candidates, and the compliance considerations that shape what can and cannot be said. Generic digital marketing experience is not sufficient on its own.

When sector knowledge matters, ask for it directly. Ask the agency to describe the specific challenges of your industry, and listen for whether they are speaking from experience or from research done the night before the pitch. The difference is usually audible. Experienced practitioners speak with specificity. People who have done surface research speak in generalities.

That said, sector experience is not always the most important factor. I have seen agencies with deep vertical expertise become complacent, recycling the same thinking across every client in that sector. And I have seen agencies from adjacent industries bring genuinely fresh thinking that a sector specialist would never have offered. The question is whether the agency can demonstrate that it understands your specific commercial problem, not just your industry category.

How to Make the Final Decision Without Defaulting to Gut Feel

At some point, you have to decide. And at that point, most people default to gut feel, which is not entirely wrong. Relationships matter, and if you cannot imagine having a difficult conversation with the agency team, that is worth factoring in. But gut feel should be the final input, not the primary one.

Build a simple scorecard before the pitches start, and score each agency against it after each pitch while the details are fresh. Include criteria across the four areas I mentioned earlier: strategic thinking, commercial accountability, operational fit, and cultural alignment. Weight them according to what matters most for your specific situation. A business that has strong internal strategy but weak execution capability will weight operational fit differently from one that needs strategic leadership from its agency.

Reference checks are underused. Most businesses ask for references and then treat them as a formality. Call the references, and ask specific questions. Ask about a time when something went wrong and how the agency handled it. Ask whether the team that pitched is the team that delivered. Ask whether they would renew the contract if they were starting again. The answers to those questions are more useful than anything you will hear in the pitch room.

One final thing. The agency that is right for you today may not be right for you in three years. The best agency relationships evolve, but they also have natural end points. Build a review process into the contract from the start, not as a threat, but as a discipline. It keeps both sides honest and prevents the drift that tends to set in when a relationship is no longer being actively managed.

The Agency Growth & Sales hub goes deeper on how agencies operate commercially, how they structure their teams, and what the best client-agency relationships actually look like. If you are in the middle of an agency search, it is worth spending time there before you make a final call.

About the Author

Keith Lacy is a marketing strategist and former agency CEO with 20+ years of experience across agency leadership, performance marketing, and commercial strategy. He writes The Marketing Juice to cut through the noise and share what works.

Frequently Asked Questions