Latest / AI Conversations / Why AI Won't Fix Your Dysfunctional Organization

Transcript

Why AI Won't Fix Your Dysfunctional Organization · AI Conversations

• 0:00
  SPEAKER_00: So, Maren, I've been thinking about this idea of weekly AI check-ins, right?
• 0:04
  SPEAKER_00: And the the host of the podcast, Dr.
• 0:06
  SPEAKER_00: Marilyn Carroll, she talks about how it's not just about agility, which is what most people are seeing.
• 0:13
  SPEAKER_00: She's saying it's something else entirely.
• 0:15
  SPEAKER_00: What do you um what do you make of that?
• 0:18
  SPEAKER_01: Yeah, it's it's interesting because on the surface, it absolutely looks like agility.
• 0:23
  SPEAKER_01: I mean, you've got these short conversations, 15 minutes, sometimes less, where teams are asking, what did the system do this week?
• 0:31
  SPEAKER_01: Where did it perform well?
• 0:32
  SPEAKER_01: Where did it drift?
• 0:33
  SPEAKER_01: What surprised us?
• 0:34
  SPEAKER_01: And you'd think, oh, okay, that's just, you know, being being more agile, being more responsive.
• 0:40
  SPEAKER_01: But she makes this really crucial point that it's organizations trying to keep up with systems that are no longer behaving in predictable ways.
• 0:49
  SPEAKER_01: Does that does that make sense?
• 0:50
  SPEAKER_00: Mm-hmm.
• 0:51
  SPEAKER_00: Yeah, it's it's almost like um we've had this framework for so long where, I mean, we treat transformation like a project.
• 0:59
  SPEAKER_00: You define the strategy, you roll out the tools, you train people, you measure adoption.
• 1:04
  SPEAKER_00: And she's saying that model worked when systems were stable, but AI systems aren't.
• 1:10
  SPEAKER_00: They're they're changing based on data inputs, usage patterns, context, how people interact with them.
• 1:16
  SPEAKER_00: So the moment you finalize a strategy, you've already lost alignment.
• 1:20
  SPEAKER_00: It's like trying to hit a moving target with a with a fixed arrow.
• 1:24
  SPEAKER_01: Exactly.
• 1:25
  SPEAKER_01: That's a great point.
• 1:26
  SPEAKER_01: And that's why these weekly check-ins are emerging.
• 1:29
  SPEAKER_01: They're not replacing strategy because leaders don't care about strategy, they're replacing strategy because strategy alone can't keep up anymore.
• 1:37
  SPEAKER_01: We what we're seeing is that the systems themselves are dynamic, and our traditional uh strategic planning cycles are just too slow to adapt to that.
• 1:46
  SPEAKER_00: Right.
• 1:47
  SPEAKER_00: And then she gets to what she calls the real issue, which I found really profound.
• 1:52
  SPEAKER_00: It's not about learning, it's not about productivity, it's this question: do we still understand how decisions are being made inside our own organization?
• 2:01
  SPEAKER_00: Because once AI starts influencing recommendations, approvals, prioritization, customer interactions, you start to lose visibility.
• 2:10
  SPEAKER_00: And when that visibility drops, authority starts to shift, not intentionally, not maliciously, but structurally.
• 2:18
  SPEAKER_01: Yeah, from humans to systems, from explicit rules to probabilistic outputs, from governed decisions to emergent behavior.
• 2:26
  SPEAKER_01: And that's uh that's a huge shift that I think a lot of people are maybe not fully grasping the implications of yet.
• 2:33
  SPEAKER_00: Yeah, I mean, it's almost like you're you're you're giving away the keys to the car without realizing you've done it.
• 2:39
  SPEAKER_00: And then she goes into this gap that nobody talks about.
• 2:42
  SPEAKER_00: She says weekly check-ins create awareness, but awareness is not governance.
• 2:48
  SPEAKER_00: Could you uh unpack that a little bit?
• 2:50
  SPEAKER_01: Yeah, she says it again.
• 2:51
  SPEAKER_01: Awareness is not governance.
• 2:54
  SPEAKER_01: And it's because asking what happened this week is very different from asking, was that decision authorized to happen in the first place?
• 3:02
  SPEAKER_01: And most organizations cannot answer that second question.
• 3:05
  SPEAKER_01: Not in real time, not at the moment of execution.
• 3:08
  SPEAKER_01: So you can be aware of what the system did, but that doesn't mean you have control over whether it should have done it or if it was within the boundaries you set.
• 3:17
  SPEAKER_00: It's like knowing what your kid did after they've already done it versus actually setting the rules beforehand.
• 3:23
  SPEAKER_00: And this isn't happening in isolation.
• 3:26
  SPEAKER_00: She points out signals everywhere: leadership teams and middle managers not aligned on AI priorities, education systems experimenting with AI policy from the ground up, research showing promise, but still very limited evidence.
• 3:39
  SPEAKER_00: All of this points to one thing.
• 3:41
  SPEAKER_00: We are integrating AI into decision making faster than we are redesigning authority.
• 3:47
  SPEAKER_01: Yeah, and that gap is where the real risk lives.
• 3:50
  SPEAKER_01: That's that's the core problem here.
• 3:53
  SPEAKER_01: We're putting these systems in place that are making decisions, influencing decisions, but we haven't updated our framework for who has the authority to make those decisions or what those boundaries are.
• 4:04
  SPEAKER_00: So what does this mean for leaders?
• 4:06
  SPEAKER_00: I mean, she says weekly AI check-ins are a good start, keep them, but don't stop there.
• 4:12
  SPEAKER_00: You have to move from observing system behavior to governing system behavior at the moment of action.
• 4:18
  SPEAKER_00: What does that practically look like?
• 4:20
  SPEAKER_01: That means asking who has the authority to act, under what conditions, what are the boundaries, and what happens when those boundaries change?
• 4:28
  SPEAKER_01: Because if the system is making or influencing decisions, those answers have to be built into the system itself.
• 4:35
  SPEAKER_01: It's not enough to just watch it.
• 4:37
  SPEAKER_01: You have to embed that governance within the actual system's operation.
• 4:41
  SPEAKER_00: So the organizations that win in this next phase of AI, it won't be the ones that learn the fastest, but the ones that govern learning as it happens.
• 4:49
  SPEAKER_00: The weekly check ins aren't the destination.
• 4:52
  SPEAKER_00: They're the signal that leadership is beginning to recognize something deeper.
• 4:56
  SPEAKER_00: AI is not just changing work, it's changing decision authority.
• 5:01
  SPEAKER_00: And that, uh, that's a leadership responsibility.
• 5:04
  SPEAKER_00: It's a significant shift in how we think about um our roles.