How to Evaluate a Marketing Agency Before You Hire One

Most companies evaluate marketing agencies too late in the process. By the time the agency is presenting work, the conversation has already shifted toward chemistry, creative ideas, case studies, and price.

Those things matter. But they are not the best predictors of whether the relationship will work.

A better agency evaluation starts earlier, with a more basic question: does this agency understand the business problem well enough to solve the right one?

How to evaluate a marketing agency

The best way to evaluate a marketing agency is to judge it across six areas: problem definition, strategic thinking, team quality, operating fit, measurement discipline, and commercial alignment.

An agency can be excellent at its craft and still be wrong for your company. A great paid media agency is not useful if your actual problem is weak positioning. A strong creative shop will not fix broken lead management. A sophisticated SEO partner will not solve a sales process that cannot convert demand.

The job of the evaluation process is to separate capability from fit.

The 4As recommends that agency searches begin with a detailed discussion of business goals, marketing objectives, service expectations, capabilities, compatibility, and economic expectations. That is a better starting point than asking agencies to respond to a long list of tactical requirements.

1. Start with the problem you are hiring the agency to solve

Before you evaluate an agency, evaluate your own brief.

Leadership should be able to explain the problem in business terms. For example:

"We need more qualified pipeline from enterprise accounts" is stronger than "we need LinkedIn ads."

"We are losing share in a category where competitors sound the same" is stronger than "we need a rebrand."

"We need to improve conversion between inquiry and opportunity" is stronger than "we need better landing pages."

The first version defines the business problem. The second jumps to a tactic.

That distinction matters because agencies will naturally respond to the scope they are given. If the brief prescribes the solution too early, you may end up selecting the agency that executes the requested tactic most convincingly rather than the partner that recognizes the deeper issue.

A strong agency should be willing to challenge the brief when the evidence suggests the problem has been framed incorrectly.

2. Evaluate how they think, not just what they have done

Case studies are useful, but they are easy to overvalue.

A polished case study tells you what happened in another company, with another team, another budget, another market, and another set of constraints. It does not automatically tell you how the agency will approach your business.

Ask how they reached the conclusion.

What did they believe the original problem was? What did they test? What changed their mind? What did they stop doing? Which assumptions turned out to be wrong? How did they decide where to invest next?

You are evaluating the quality of their judgment.

McKinsey has noted that strong agency relationships depend on more than scope. They also require alignment around operating model, talent, culture, incentives, and metrics. That is important because the work rarely stays inside the neat boundaries of the original pitch once the relationship begins.

A useful agency should be able to explain its thinking clearly enough that your leadership team can challenge it.

3. Meet the people who will actually work on the account

One of the easiest mistakes in an agency search is choosing the pitch team instead of the delivery team.

Senior leaders often lead presentations because they are persuasive and experienced. That is reasonable. The problem comes when those people disappear after the contract is signed.

Ask directly:

• Who will lead the account day to day?

• Who will be responsible for strategy?

• Who will actually execute the work?

• How much senior involvement should we expect after onboarding?

• What happens if a key team member leaves?

• How many accounts does the lead strategist manage?

You are not only buying the agency brand. You are buying access to a specific group of people.

The strongest proposal can become a weak relationship if the team assigned to the account does not have the experience, capacity, or authority that the pitch implied.

4. Test whether the agency can work inside your marketing system

Agencies do not operate in isolation.

They depend on internal marketing, sales, operations, finance, technology, executives, and sometimes other agencies. The more complex your organization becomes, the more important this operating fit becomes.

Ask how the agency works when another partner owns part of the customer journey. Ask how they handle disagreements about attribution. Ask what they need from sales. Ask how they share data. Ask how they escalate decisions. Ask who should own strategy when several partners are involved.

A useful partner should understand where its responsibility starts and stops.

One warning sign is an agency that treats every adjacent business problem as evidence that you should buy more services from them. Another is an agency that refuses to engage with the rest of your marketing system and reports only on the metrics inside its own scope.

Green Mo. approaches agency management as part of a broader marketing system because the real question is not whether each vendor is performing in isolation. It is whether all of the pieces are working toward the same business objective.

5. Define success before the contract is signed

If the success criteria are vague during the pitch, they will usually stay vague after the work begins.

Do not wait until the first quarterly review to decide what performance means.

The agency should understand which outcomes matter, which metrics it can directly influence, which indicators are shared with other teams, and which factors sit outside its control.

For a demand generation partner, success might include qualified opportunities, pipeline contribution, conversion by source, acquisition economics, and the quality of demand, not simply leads.

For a brand partner, the measures may be different, but the same principle applies. The company and agency should agree on what evidence would indicate progress.

This does not mean forcing every agency into a simplistic performance contract. It means making the accountability model explicit.

McKinsey's research on agency relationships emphasizes the importance of aligned incentives, data transparency, and shared metrics. Agencies cannot be meaningfully accountable when the company withholds the data required to evaluate the customer journey.

6. Understand the commercial model

Price matters. It should not be evaluated in isolation.

Two agency proposals can have similar monthly fees and very different economics.

Understand what is included, what is billed separately, how senior time is allocated, whether production is marked up, how media fees work, what technology costs are passed through, and how out-of-scope work is handled.

Also understand how the agency makes money.

There is nothing wrong with an agency earning a healthy margin. A sustainable partner needs to attract and retain good talent. The issue is whether the commercial model creates incentives that conflict with your goals.

If an agency earns more every time media spend increases, leadership should understand that incentive. If it is paid by deliverable volume, it may naturally favor producing more deliverables. If the model is retainer-based, understand what capacity you are actually reserving.

Commercial transparency matters more than chasing the lowest price.

Do not confuse chemistry with fit

You should like the people you hire.

Agency relationships involve disagreement, pressure, shifting priorities, and imperfect information. Trust matters.

But chemistry is not the same as fit.

A charismatic team can still lack the right expertise. A presentation can feel exciting while avoiding the difficult questions. A team that agrees with everything leadership says during the pitch may become frustrating later because it never challenges weak assumptions.

One of the most useful questions to ask during an agency evaluation is:

"What do you think we are wrong about?"

A serious answer can tell you a great deal about how the agency thinks, how much preparation it did, and whether it is willing to behave like a partner rather than a vendor trying to protect the sale.

Red flags during an agency evaluation

Several behaviors should make leadership slow down.

• The agency guarantees outcomes it cannot fully control.

• The senior pitch team cannot clearly identify who will do the work.

• The agency talks almost entirely about channels rather than the business problem.

• Reporting focuses on activity without explaining how success will be evaluated.

• Every problem appears to require another service the agency happens to sell.

• The agency is reluctant to discuss data access, ownership, fees, or responsibilities.

• The proposal depends heavily on tactics before there is agreement on strategy.

None of these automatically means the agency is bad. They are signals that the operating relationship may become difficult.

Use a scorecard, but do not outsource the decision to it

A structured scorecard can make an agency review more disciplined.

The value of a scorecard is not mathematical precision. It is forcing decision-makers to agree on the criteria before they become attached to a presentation.

A practical scorecard might evaluate:

• Understanding of the business problem

• Strategic quality

• Relevant capabilities

• Quality of the assigned team

• Operating compatibility

• Measurement and reporting approach

• Commercial transparency

• Cultural fit

• Confidence in the team's ability to challenge leadership

Weight those criteria based on the actual problem you are trying to solve.

Do not let a point system create false certainty. The scorecard should improve the discussion, not replace executive judgment.

The agency should fit the marketing system, not become the marketing system

An agency can be a valuable extension of the business. It should not become the only place where marketing strategy lives.

The company still needs internal ownership of priorities, budgets, customer strategy, agency coordination, and performance expectations.

That becomes particularly important when several specialists are involved. Someone inside the business needs to determine which partner should do what, which programs deserve investment, and whether the combined system is producing the intended result.

The best agency relationships work when the company knows what it needs from the partner and the agency knows how it contributes to the larger strategy.

If you cannot clearly evaluate your agencies, the problem may not be the agencies

Sometimes the difficulty is upstream.

The company has no defined marketing strategy. Ownership is fragmented. Metrics are inconsistent. Sales and marketing disagree on what a qualified lead is. Agencies receive conflicting instructions from multiple executives.

In that environment, even a strong agency can struggle.

Before replacing a partner, leadership should determine whether the issue is agency performance or the system the agency is being asked to operate inside.

Green Mo. works with a limited number of companies at a time. If your company is struggling to evaluate agency performance, coordinate multiple partners, or determine whether the real problem is strategy, systems, leadership, or execution, apply for a Marketing Systems Audit to identify where the gaps are and whether there is a fit to work together.