How to Evaluate Marketing Agency Performance (Without Getting Played)

You hired a marketing agency. They send you a monthly report. It has graphs. It has green arrows pointing up. It mentions impressions and reach and click-through rates. It looks professional. But you have a nagging feeling you are not actually sure whether they are doing a good job.

You are not alone. Most businesses struggle to evaluate agency performance because the agency controls the narrative. They choose which metrics to report, which benchmarks to reference, and how to frame the data. This guide gives you the tools to cut through that and judge what is really happening.

Metrics That Matter vs Vanity Metrics

Let us start with the distinction that changes everything. Vanity metrics make the report look good. Business metrics tell you whether you are making money.

Vanity Metrics (Look Impressive, Mean Little)

• Impressions: How many times your ad was shown. This tells you almost nothing about whether it worked. A million impressions with zero sales is a million wasted impressions.
• Reach: How many unique people saw your ad. Same problem. Reach without action is noise.
• Click-through rate (CTR): The percentage of people who clicked. CTR is useful as a diagnostic tool for ad creative, but by itself it tells you nothing about revenue. A high CTR to a page that does not convert is just expensive traffic.
• Social engagement: Likes, shares, comments. Unless your business model is to collect likes, these are not performance indicators.

Business Metrics (Actually Tell You Something)

• Cost per acquisition (CPA): How much it costs to acquire a customer. This is the number you build a business on.
• Return on ad spend (ROAS): Revenue generated divided by ad spend. Tells you whether your advertising is profitable.
• Cost per qualified lead (CPQL): How much it costs to generate a lead that meets your qualification criteria. More useful than raw CPL for businesses with a sales process.
• Revenue attributed to marketing: Total revenue that came from marketing-sourced leads or channels.
• Customer lifetime value vs acquisition cost: The ratio that determines long-term profitability of your marketing investment.

If your agency's monthly report does not prominently feature CPA, ROAS, or revenue attribution, ask them why. If they cannot explain the relationship between their work and your revenue, that is a red flag.

Reporting Red Flags

Agency reports can be structured to hide poor performance. Here are the patterns to watch for:

Cherry-Picking Time Periods

An agency that reports month-over-month growth when the previous month was their worst ever is telling a misleading story. Always ask for year-over-year comparisons and consistent reporting periods. A good agency shows you trends, not snapshots.

Platform Metrics Without Business Context

"Your Google Ads campaign achieved a 4.2% CTR, which is above the industry average of 3.1%." That sounds great. But if those clicks are not converting into enquiries or sales, the CTR is irrelevant. Always ask: so what? What did those clicks actually produce?

Focusing on Activity Rather Than Outcomes

"This month we created 12 new ad creatives, published 4 blog posts, and optimised your Google Ads campaigns across 6 ad groups." Activity reporting describes what the agency did, not what it achieved. You are not paying for their time. You are paying for results. Reports should lead with outcomes and use activity as supporting context.

No Comparison to Targets

If your agency does not set performance targets or benchmark against agreed goals, there is no standard to judge them against. Every engagement should have clear KPIs set at the start. Monthly reports should show actual performance vs those KPIs. Green means on track. Red means behind. Simple.

Avoiding Lead Quality Conversations

If you raise concerns about lead quality and the agency deflects by talking about volume or CPL, they are avoiding the real issue. Volume without quality is waste. An honest agency will dig into lead quality data with you and adjust targeting accordingly.

Contract Structures That Protect You

The structure of your agency contract says a lot about how they operate.

Long Lock-In Contracts

Some agencies require 12-month minimum contracts with no break clause. This protects the agency, not you. If performance is poor at month three, you should not be trapped until month twelve. A 3-month initial term with monthly rolling thereafter is reasonable. It gives the agency time to show results and gives you the freedom to leave if they do not.

Management Fees as a Percentage of Spend

Some agencies charge a percentage of your ad spend as their management fee. This creates a perverse incentive: the more you spend, the more they earn, regardless of results. A flat fee or a fee based on performance milestones aligns incentives better.

Who Owns the Ad Accounts?

Your ad accounts should belong to you. If your agency creates accounts under their own management platform and you cannot access them directly, you are at their mercy. If you leave, you lose all campaign data, audiences, and learning. Insist on ownership from day one.

Questions to Ask Your Agency

These questions will tell you a lot about whether your agency is performing and being honest about it:

• "What is our cost per qualified lead this month, and how does it compare to last month?"
• "Which campaign or channel is generating the most revenue, not just leads?"
• "What did you test this month, and what did you learn?"
• "What is not working, and what is your plan to fix it?"
• "Can you show me the actual ad account data, not just a summary?"

An agency that answers these confidently and transparently is one you can trust. An agency that deflects, changes the subject, or gets defensive is one you should watch carefully.

When to Fire Your Agency

Not every bad month means you should fire your agency. Performance fluctuates. But there are clear signals that the relationship is not working:

• Consistently missing agreed KPIs for three or more months with no credible plan to improve
• Lack of transparency about what they are doing or how they are spending your budget
• Inability or unwillingness to explain their strategy in terms you understand
• Defensive reactions to questions or feedback
• High staff turnover on your account, resulting in loss of context and momentum
• You feel less informed about your own marketing than before you hired them

Before firing, have a direct conversation. Sometimes the problem is a communication breakdown that can be fixed. Set a 30-day improvement plan with specific, measurable targets. If those targets are not met, you have a clear, fair basis for ending the engagement.

How to Set Your Agency Up for Success

Agency performance is not entirely the agency's responsibility. Clients who get the best results from agencies tend to do several things well:

• Provide clear business objectives, not just marketing briefs
• Share sales data and lead quality feedback regularly
• Give timely approvals on creative and copy
• Make time for regular strategy calls, not just email check-ins
• Trust the agency's expertise in their domain while holding them accountable for results

The best agency relationships are genuine partnerships. Both sides invested. Both sides accountable. Both sides pushing for better outcomes. If that is what you are looking for, here is how we work.

Frequently Asked Questions

What should a marketing agency report include?

At minimum: cost per acquisition or cost per qualified lead, return on ad spend, revenue attribution, performance vs agreed KPIs, a summary of what was tested and learned, and a clear plan for the next month. If your report is mostly impressions and CTR, it is not telling you enough.

How long should I wait before judging agency performance?

For paid advertising, 60-90 days is a fair evaluation window. For SEO, 4-6 months. The first 30 days are typically setup and initial testing. Set milestone reviews at 30, 60, and 90 days so you can track progress without waiting too long to spot problems.

Should my agency have access to my analytics?

Yes. Your agency needs access to your analytics, CRM, and any data that connects marketing activity to business outcomes. Without this, they are optimising blind. Give them access but maintain ownership of all accounts and data. You should be able to see everything they see.

What is the difference between CPA and CPL?

CPL (cost per lead) measures how much it costs to generate a lead, usually a form fill or phone call. CPA (cost per acquisition) measures how much it costs to acquire an actual paying customer. For businesses with a sales process between lead and sale, CPA is the more meaningful metric because it accounts for lead quality and sales conversion rate.