Latest / MBA Training Data / Data literacy programs: change decisions, not courses
Transcript
- 0:00Host: Welcome to the Leaders Insights Podcast. Today's episode, data literacy programs that actually
- 0:10Host: change behavior. Most data literacy programs are a waste of money, true or false?
- 0:16Expert: True, and I'll be more precise. About 80% of them are training people to pass a quiz,
- 0:21Expert: not to make a different decision on a Tuesday afternoon.
- 0:24Host: That's a big number. Where does it come from?
- 0:27Expert: Gartner, the research firm, has been tracking this, and their surveys keep landing in the
- 0:32Expert: same place. A majority of chief data officers say their literacy efforts haven't moved
- 0:38Expert: a business metric they can name. When your own sponsors can't name the outcome, that's
- 0:43Expert: the tell.
- 0:44Host: But people do learn the tools. They can build a dashboard now. Isn't that progress?
- 0:49Expert: They learn vocabulary. They can say statistical significance, whether a result is real or just
- 0:55Expert: noise, at a dinner party. That's not the same as a category manager killing a promotion
- 1:00Expert: because the lift was inside the margin of error. Knowing and behaving are different muscles.
- 1:06Host: So what do the good programs actually do differently?
- 1:09Expert: They start from the decision, not the syllabus. At one European retailer I worked with, we
- 1:15Expert: didn't run a course. We picked 11 recurring decisions, pricing changes, store staffing,
- 1:20Expert: which products to delist, and rebuilt each one so the data was in the room when the decision
- 1:26Expert: was made.
- 1:27Host: Give me a concrete example. What changed on the floor?
- 1:30Expert: Delisting. Store managers used to drop products on gut feel. Nobody buys this. We put a simple
- 1:36Expert: rule in front of them. Units sold, margin, and whether the item pulled shoppers who bought
- 1:42Expert: nothing else. Within two quarters, they were delisting 30% fewer items, and revenue on
- 1:48Expert: that shelf category went up because they'd been cutting quiet earners.
- 1:52Host: You didn't teach them anything though. You just gave them a rule.
- 1:55Expert: Exactly, and that's the heresy. The best literacy intervention is sometimes to teach
- 2:00Expert: nobody and just change the default in front of them. Behavior first. Understanding follows.
- 2:07Expert: Most programs do it backwards and wonder why the classroom glow fades in three weeks.
- 2:11Host: That sounds like you're admitting people can't be taught to think with data.
- 2:15Expert: I'm admitting a course won't do it. Adults don't change how they decide because
- 2:19Expert: of a Tuesday workshop. They change when the new way is easier than the old way and someone
- 2:24Expert: they respect does it first. That's not pedagogy. That's plumbing and peer pressure.
- 2:30Host: Peer pressure. So this is a manager problem, not a training problem.
- 2:34Expert: It's mostly a manager problem. If a director overrules the numbers in every meeting to
- 2:38Expert: go with their gut, no amount of literacy training survives contact with that. I've
- 2:44Expert: seen a bank spend seven figures on an academy while the head of lending publicly ignored
- 2:48Expert: the risk model. Guess what everyone learned? They learned the numbers are decoration.
- 2:54Expert: Decoration you're contractually required to nod at. The fix wasn't more training.
- 2:58Expert: It was making that director defend, in writing, why he was overriding the model.
- 3:04Expert: Overrides dropped by half in a month. Turns out people trust their gut a lot less when
- 3:08Expert: they have to spell out the reason. Let me push on your ROI claim. Board-level
- 3:13Host: return. Can you actually attribute a euro to this stuff?
- 3:17Expert: Only if you set it up to be attributable, which almost nobody does. You pick the 11 decisions,
- 3:23Expert: you baseline them, you measure the outcome. Margin, waste, override rate. The retailer's
- 3:29Expert: delisting change alone was worth low single-digit millions a year. I can defend that number
- 3:34Expert: because we measured the decision, not attendance. And the vendors selling literacy platforms.
- 3:40Host: The ones with the completion badges? They report engagement. Logins, courses finished,
- 3:46Expert: badges earned. Their own case studies almost never show a business metric because their
- 3:51Expert: product can't touch the decision. Read those with a very cold eye. High completion,
- 3:56Expert: zero behavior change, is a common and expensive outcome.
- 4:00Host: So if I run one of these programs, what do I do Monday morning?
- 4:04Expert: Stop counting who finished the training. Pick the three decisions your business repeats
- 4:08Expert: most often. Write down how they're made today and put the relevant number physically
- 4:12Expert: in front of the person at the moment they decide. If behavior doesn't shift in a quarter,
- 4:18Host: your problem was never literacy. Done. Want to know where you actually stand?
- 4:23Host: Take the CDO self-assessment at MBA-training.com.