Latest / MBA Training Data / Data ROI to the board: why attribution models backfire
Transcript
- 0:00Welcome to the Leaders Insights Podcast.
- 0:07Today's episode, the CFO who almost killed the data team and what saved it.
- 0:12In 2019, a major UK retailer nearly axed its entire data team because the CFO didn't
- 0:18believe a single number they gave him.
- 0:20One budget cycle from the guillotine.
- 0:22What actually saved them?
- 0:24A boring reconciliation, honestly.
- 0:27The data team had been reporting revenue figures that didn't match finance's ledger.
- 0:32The official book of record the CFO signs off on.
- 0:35Not wildly off, just enough.
- 0:372% here, a rounding gap there.
- 0:40And once a CFO catches you being wrong once, every number you produce after that is guilty
- 0:45until proven innocent.
- 0:462% doesn't sound like a firing offense.
- 0:49It isn't the 2%.
- 0:50It's what 2% signals.
- 0:52If your data team can't tie out to the numbers finance already trusts, the CFO's logic
- 0:57is simple.
- 0:59Why am I paying 11 people to give me a version of reality I have to double check?
- 1:04That team was costing north of a million pounds a year and producing dashboards nobody
- 1:08in the boardroom would quote.
- 1:10So what did they actually do?
- 1:12Walk me through it.
- 1:13They stopped trying to be clever and started reconciling.
- 1:17Every headline metric the board saw got tied line by line to the finance ledger before anyone
- 1:22presented it.
- 1:23When there was a gap, they explained it in one sentence.
- 1:26This includes returns finance books next month.
- 1:30Instead of hiding it.
- 1:31Within two quarters, the CFO stopped auditing them.
- 1:35That's almost humiliatingly basic.
- 1:37You're telling me the fix wasn't some clever model?
- 1:40The fix is always humiliatingly basic.
- 1:43Everyone wants the data team doing machine learning.
- 1:46Algorithms that predict who'll buy what.
- 1:48Nobody wants to fund the person who checks that yesterday's sales number matches the
- 1:52till.
- 1:53But trust is built at the boring layer, not the shiny one.
- 1:57Get the arithmetic right and you earn permission to do the fancy stuff.
- 2:01Play devil's advocate for the CFO for a second.
- 2:04Wasn't he right to be suspicious?
- 2:06Completely right.
- 2:07That's the uncomfortable part.
- 2:10Data teams love to paint the finance chief as the villain who doesn't get it.
- 2:14He got it perfectly.
- 2:15He knew a number he couldn't defend to an auditor was worse than no number because it
- 2:20invited bad decisions dressed up as insight.
- 2:23The team's arrogance was assuming their sophistication excused their inaccuracy.
- 2:28So how does a chief data officer avoid ending up in that chair?
- 2:32One cycle from being dismantled.
- 2:34Pick one number the business already cares about and already has an official version of.
- 2:39Match it perfectly, publicly.
- 2:41You want the CFO to see your dashboard and his ledger agree to the penny.
- 2:45And then you never let that break again.
- 2:47That single reconciled figure is your credibility deposit.
- 2:51Spend it carefully.
- 2:52And if the numbers genuinely can't match because the systems disagree?
- 2:57Then you say so out loud before someone catches you.
- 3:00These two systems define a sale differently.
- 3:03Here's the gap.
- 3:04Here's which one you should trust for what.
- 3:06That sentence saves more data teams than any technology.
- 3:10The death spiral starts when you pretend a gap doesn't exist and someone finds it
- 3:14in a board meeting.
- 3:15You've been a CDO.
- 3:17Have you ever been the one holding the wrong number?
- 3:20Of course.
- 3:21Early on, I presented a customer churn figure.
- 3:24The share of shoppers who stopped buying.
- 3:26That was a full six points off because I'd counted people who'd just paused, not quit.
- 3:31The commercial director spotted it in real time.
- 3:34I wanted the floor to swallow me.
- 3:36But I fixed it in front of everyone the next week.
- 3:39And that recovery bought me more trust than being right would have.
- 3:42So being wrong openly beats being right quietly.
- 3:45Every time.
- 3:46The retailer's team learned that.
- 3:48They're still running today, by the way, and doing the predictive work they wanted
- 3:52all along because they earned it by being trustworthy first.
- 3:56Give me the one thing a listener does tomorrow morning.
- 3:59Take your single most quoted metric and reconcile it against whatever finance calls
- 4:04the truth.
- 4:05If they don't match, you have your priority for the week.
- 4:09Don't build another dashboard until that one number is bulletproof.
- 4:12Boring and exactly right.
- 4:14Thanks for this.
- 4:15That's it.
- 4:16The CDO decision tools are live at MBA-training.com.