Why Most Marketing Reports Lie to You (And the Three Questions That Cut Through) | We Own Leads Skip to main content
← All Insights
Marketing 6 min

Why Most Marketing Reports Lie to You (And the Three Questions That Cut Through)

The monthly report from your marketing agency almost certainly showed improvement. Almost none of it was real. Here are the five ways marketing reports mislead SME owners, why agencies produce them that way, and the three questions that surface the truth.

The report on your desk right now

Pull up the most recent monthly marketing report your agency or your in-house marketer sent you. The one with the charts, the green arrows, the words "up 40%" somewhere near the top. It almost certainly shows improvement. And almost none of that improvement is real.

This is not usually malice. Most marketers who build reports like this are responding to the same set of incentives: tools that surface the metrics that always grow, clients who want to see improvement, and a reporting culture that rewards storytelling over honesty. The result is a monthly document that answers the wrong questions beautifully.

The five ways marketing reports mislead

1. Vanity metrics that always grow

Impressions. Reach. Followers. Social engagement. These numbers have one thing in common: they accumulate. An ad campaign that ran for 30 days will always have more impressions than one that ran for 14. A social account that has posted weekly for a year will always have more followers than one that started last quarter. Showing impressions month over month produces a line that goes up by default, whether the business is growing or not.

2. No baseline comparison

"Website visits up 40%" from what. Over what period. Compared to which benchmark. Most reports show the current month's numbers against the previous month, which is the easiest comparison to flatter. A slow month followed by a normal month shows as "40% recovery." A normal month followed by a slightly-better-than-normal month shows as "12% growth." Neither tells you whether the business is actually performing better than it was a year ago, or two years ago, or against seasonally adjusted expectations.

3. Cost-per-lead hiding cost-per-paying-customer

This is the most common lie in marketing reporting, and the most expensive. Most reports show cost-per-lead, because cost-per-lead is low. R180 per lead sounds reasonable. But if only 1 in 12 of those leads becomes a paying customer, the actual cost of acquisition is R2,160. If the average customer spends R3,500 once and never returns, the campaign is losing money. The report hides this by stopping its chain of logic at the word "lead."

4. Attribution pile-on

In most marketing stacks, every channel that touched a customer's journey takes credit for the sale. Google Ads claims the conversion. Facebook Ads also claims it. Email claims it again. The SEO report claims it too. If you added up the claimed revenue across every channel in a month, it would often exceed the business's actual revenue by 200%. Each platform optimises for its own attributed wins, which means the total "value delivered" number in a report can be double or triple the real business outcome.

5. Survivor bias in case studies

The "wins" section of a report always features campaigns that worked. What is almost never in the report is a list of the campaigns that quietly died: ads that were paused after a week, landing pages that tested worse than the control and were archived, keywords that never produced a customer. The silent losses vanish from the narrative. An agency that launched ten campaigns and killed seven of them can still write a report that only describes the three survivors.

The three questions that cut through

1. "What is our cost per paying customer this month, not cost per lead?"

This one question reveals more than the other four combined. If the agency or marketer cannot answer it, the reporting is not measuring what actually matters to the business. If the answer is two to five times higher than the cost-per-lead, the business is paying to manufacture leads that never buy. Either outcome is important. The absence of a real answer is the most important finding.

2. "What was this number exactly twelve weeks ago?"

Twelve weeks is long enough to ignore noise and short enough to act on. Most reports show month-over-month, which is noisy, or year-over-year, which is slow. A rolling twelve-week comparison is what separates trend from drift. If twelve-week numbers are not in the report, they should be in the next one.

3. "If we turned off this channel tomorrow, what would actually drop?"

This is the attribution question reframed. The answer is almost never "everything the report claims." For most SME marketing stacks, switching off a given channel causes a measurable but modest revenue dip, because customers who were going to buy find another path. The honest report distinguishes incremental revenue (revenue that would not have happened without the channel) from attributed revenue (revenue the channel claims credit for). Most reports do not.

Why agencies produce these reports (and why it is mostly not malice)

Most marketers are not trying to deceive their clients. They are navigating three structural forces. First, the reporting tools they use (Google Ads, Meta Ads Manager, HubSpot) are designed to surface metrics that flatter the tool, because the tool's vendor benefits from clients staying on it. Second, clients who ask for "good news" get good news, because agencies who deliver hard truths often get fired. Third, the measurement work that would produce honest attribution is expensive and invisible, and most clients do not pay for it.

The combination produces the monthly report you have on your desk. Fixing it does not start with finding a new agency. It starts with asking the three questions above.

What to demand from your next report

Tell your agency, or your in-house marketer, that starting next month the report needs three additions. One: cost per paying customer, calculated by dividing total spend by the number of first-time paying customers in the period. Two: a rolling twelve-week baseline for every headline metric. Three: a list of what was tested that did not work, with the reasons and the decisions to kill or keep.

The response to these requests will tell you more about the agency than any of their charts ever did. An agency that welcomes the questions is one worth keeping. An agency that resists them is telling you why the current report looks the way it does.

Common Questions

What if my agency tells me cost-per-paying-customer is impossible to calculate?

It is not impossible, it is inconvenient. Every ad platform and CRM on the market can join marketing spend to customer records with enough effort. If they are unwilling to do the work, that is a signal about how they are structured, not about the data.

Are impressions and reach useless numbers?

Not useless, but mis-placed. They belong in a brand-awareness campaign with explicit brand-lift goals, not in a performance marketing report. The problem is not that they exist, the problem is that they dominate reports that are supposed to be measuring lead and revenue generation.

If attribution is unreliable, how do I know where my revenue really comes from?

Ask new customers directly during onboarding: "How did you hear about us?" Aggregate the answers monthly. It will not match what any platform reports, because it is self-reported, but the gap between the two is itself data. If Google Ads claims 60% of conversions and only 15% of customers mention Google when asked, you have an attribution problem worth investigating.

Is this a problem with agencies, or with in-house marketing teams too?

Both. The structural forces (tool bias, flattery incentive, measurement cost) apply inside the business as well. An in-house marketer reporting to an owner has the same incentive to surface good news as an agency reporting to a client. The fix is the same: the three questions, asked consistently.

Want advice specific to your market?

Two options, zero pressure. Get a free written audit (no call required) or book a 20-minute strategy call.

Get a free audit Or book a call