Monday, November 16, 2026

The measurement conversations agencies can’t afford to avoid

What happens when an incrementality test reveals that a campaign isn’t delivering the results an agency has been reporting?

Challenging established performance figures can make for difficult client conversations, but avoiding them risks undermining trust.

Mees Frima, Partner Success Manager at Billy Grace, explains why agencies should embrace uncomfortable findings and turn greater measurement transparency into stronger client relationships…

Mees Frima at Billy Grace
Mees Frima, Billy Grace.

Nobody’s immune to ‘the hedge’!

Most people know the Homer Simpson “hedge” meme. Ned Flanders appears and Homer slowly backs into a hedge until he disappears.

It has endured because the instinct is familiar: sometimes disappearing feels easier than having an awkward conversation.

I see a version of this in marketing measurement. An incrementality test produces a result that does not match the client’s dashboard. Perhaps a channel is receiving credit for sales it would not, in fact, have generated. The temptation can be to note the finding internally, adjust expectations and wait for a better moment to raise it.

Running the test is no longer particularly difficult. The methodology is well established and the technology has become easier to use. The harder part can be explaining what the result means.

The good news? That part has just become easier.

Why the silence happens

The problem is rarely the data itself. It is what the data appears to say about the decisions that came before it.

An agency might have spent the past year recommending a particular channel, reporting on its performance and defending the budget allocated to it.

An incrementality test can show that the channel was contributing less than platform reporting suggested. That is an uncomfortable finding to take to a client. It can feel like admitting that the agency was wrong. And that can induce anxiety, not because agencies avoid scrutiny, but due to a sensible desire to want to keep working with the client and continue to improve their performance.

Image by StockSnap from Pixabay
Stress tests: Data can report different things.

Platform attribution and incrementality are measuring different things. A platform can report that an ad appeared somewhere in a customer’s path to purchase. An incrementality test asks a different question: would that purchase have happened without the advertising?

The distinction can produce materially different answers. Finding that difference is useful because it gives the agency and client better information for the next budget decision.

There is another concern. Once an agency tells a client that its previous reporting gave an incomplete picture, an obvious question follows: why didn’t we know this before?

In my experience, agencies tend to worry about that question more than clients do. A clear explanation of what has changed in the measurement, what the test found and how the agency proposes to respond is usually more useful than defending an old number.

What changes when you go first

The agencies I see building the strongest client relationships still produce uncomfortable findings. The difference is how they handle them.

They take the result to the client rather than waiting to be asked. They explain how the test was constructed and what it can and cannot establish. And they arrive with a proposed response.

That might mean moving some budget to another channel, changing the campaign mix or running another test before making a larger decision. The important thing is that the finding becomes part of a decision rather than simply another number in a report.

One agency partner described the effect to me in simple terms. After you have brought a client an uncomfortable result and helped them decide what to do about it, the relationship changes.

You are less likely to be seen simply as the team buying media and more likely to be involved when the next decision is being made.

That shift is becoming more relevant as marketing measurement changes. Third-party identifiers have become less reliable and privacy changes have made some forms of tracking harder. At the same time, the major advertising platforms still have an obvious interest in demonstrating the value of the advertising sold through them.

Platform data remains useful, but it cannot always answer the question advertisers ultimately care about: what happened because we spent this money?

Independent measurement gives agencies another way to answer it. Inevitably, that sometimes means producing an answer that does not match the dashboard.

Having the conversation

There is no need for an elaborate script. The finding itself is usually the best place to start. Explain what the test found, then show how it was reached.

The client needs enough information to understand why the result differs from the numbers they have been seeing and how much confidence to place in it.

Image by Gerd Altmann from Pixabay
Time to talk: Sharing information is key.

It also helps to put the result in practical terms. If a channel is less incremental than previously assumed, the useful question is not who got the old number wrong. It is where that money might produce a better return.

The agency should also have a next step. In some cases that will be a budget change. In others it may be another test or a period of monitoring. Measurement rarely produces perfect certainty, so the response should reflect how strong the evidence actually is.

Stepping out from behind the hedge

The first of these conversations can feel disproportionately difficult. An agency is effectively volunteering information that may prompt questions about its own previous recommendations.

But avoiding the finding does not make it less true. It simply means the client is making decisions without information the agency already has.

That is why the Homer Simpson comparison feels apt. There is a brief temptation to disappear into the hedge.

The more useful response is to bring the finding into the room, explain what it shows and work out what to do next.