Latest / MBA Training Marketing / When marketing analytics lies to you: what CMOs need to know in 2026
Transcript
- 0:00Welcome to the Leaders Insights Podcast.
- 0:08Today's episode, when marketing analytics lies to you, what CMOs need to know in 2026.
- 0:14Your dashboard says your marketing is working.
- 0:17You're telling me it might be lying to my face.
- 0:19Not lying exactly.
- 0:21Confidently wrong, which is worse, because a liar at least knows the truth exists.
- 0:25Start me at zero.
- 0:26Where does the lie come from?
- 0:27The foundation.
- 0:29Every number on your dashboard is built on data that got collected, tagged, and stitched
- 0:34together by systems that make assumptions.
- 0:37If the assumptions are junk, the number is junk, but the chart still looks gorgeous.
- 0:42Give me a concrete example.
- 0:43Attribution.
- 0:44That's the model deciding which ad or email gets credit for a sale.
- 0:49Most companies use last click, meaning whatever the customer touched right before buying wins.
- 0:54So Google search gets the trophy every time.
- 0:57Why is that wrong?
- 0:58They did click the search ad.
- 1:00Because they only searched your brand name after seeing three weeks of your ads elsewhere.
- 1:05Last click is like giving the award for the marathon to whoever's standing at the finish
- 1:09line.
- 1:10Google's own studies push against it.
- 1:13And Google sells the search ads, so read that how you like.
- 1:16So the CMO cuts the top of funnel spend because it isn't converting and search looks like
- 1:21a genius.
- 1:22Exactly.
- 1:23I watched a retailer do this in 2025.
- 1:26But brand awareness spend 40% because the dashboard said it drove nothing.
- 1:32Sales dropped 11% the next quarter.
- 1:34The dashboard never linked the two because it wasn't built to.
- 1:38That's terrifying.
- 1:39What else is quietly broken?
- 1:41Tracking loss.
- 1:43Since browsers killed most third-party cookies, the little files that follow you across sites,
- 1:48a huge chunk of activity just goes dark.
- 1:51Your tools guess to fill the gap.
- 1:53Guess how.
- 1:54Modeling.
- 1:55When the data's missing, the platform invents a plausible number based on patterns.
- 2:00Meta and Google both do this now.
- 2:02It can be 60, 70% modeled on some campaigns.
- 2:06And nowhere on the screen does it say, we made most of this up.
- 2:10Hold on.
- 2:11Most of a number could be an estimate, and I'd never know.
- 2:13Correct.
- 2:14And because the vendor built the tool and sells the ad space, the estimate tends to
- 2:18flatter the vendor.
- 2:19Shocking, I know.
- 2:21What does this actually cost a company?
- 2:24Not flowing to the wrong channels.
- 2:26If 20% of a $50 million budget is misallocated because attribution is lying, that's $10 million
- 2:32a year buying you a nice-looking chart and not much else.
- 2:36Alright, I'm a smart exec, new to this, and now paranoid.
- 2:40How do I build measurement I can trust?
- 2:42Three habits.
- 2:43First, incrementality testing.
- 2:46Turn a channel off in some regions, leave it on in others, and see what actually changes.
- 2:51If sales don't move when you kill a channel, that channel wasn't doing the work.
- 2:56You're telling CMOs to deliberately stop advertising somewhere.
- 2:59For two weeks in a couple of markets, it costs you a little revenue and buys you the
- 3:04truth, which is cheaper than misfiring for a year.
- 3:07eBay famously did this with search ads years back and found a chunk of spend was buying
- 3:12clicks from people already coming to them.
- 3:15What's the second habit?
- 3:16Reconcile your numbers against reality.
- 3:19Your ad platforms will claim they drove more sales than your finance system recorded actual
- 3:24sales.
- 3:25When the marketing math exceeds the money in the bank, someone's counting the same
- 3:29customer three times.
- 3:31And the third?
- 3:32Demand a confidence label.
- 3:34Ask your team for every key metric.
- 3:36Is this measured or modeled, and how much?
- 3:39If nobody can answer, that's your answer.
- 3:42Isn't this just going to slow everything down and annoy the analytics team?
- 3:46A little.
- 3:47But right now, the analytics team is handing you certainty they can't back up, and you're
- 3:51spending real money on it.
- 3:54Mild friction beats confident nonsense.
- 3:56If a CMO does one thing tomorrow morning, what is it?
- 4:00Pull your single biggest spending channel and ask one question.
- 4:04How much of its reported results are actually measured versus modeled?
- 4:08Just that number.
- 4:10If your team can't tell you by end of day, you found your problem before you found
- 4:14your answer.
- 4:15Uncomfortable homework.
- 4:17That's the good kind.
- 4:18Done.
- 4:19Want to know where you actually stand?
- 4:21Take the CMO self-assessment at MBA-training.com.