Latest / C-Suite Perspectives / How AI Coaching Is Redefining Leadership Development
Transcript
- 0:00Welcome to C-Suite Perspectives, a signature series by The Conference Board.
- 0:04I'm Diana Scott, Center Leader of the US Human Capital Center at The Conference
- 0:09Board, and the guest host of this podcast.
- 0:12Today we'll discuss how AI coaching is transforming leadership and the
- 0:16future of workforce development.
- 0:18Joining me is Allan Schweyer, Principal Researcher, Human Capital Center.
- 0:23Welcome, Allan.
- 0:27Allan, your report suggests AI coaches could soon deliver
- 0:3090% of workplace coaching.
- 0:33That's a pretty aggressive figure.
- 0:35What does that imply for the future architecture of talent development
- 0:39inside large organizations?
- 0:42It means that potentially the benefits of coaching, which you know, is one of
- 0:46the most effective development tools available in the workplace, could be
- 0:50made available to every worker and every manager for about 90% of their everyday
- 0:57coaching needs according to our research.
- 0:59But that doesn't mean that human coaches go away.
- 1:03AI handles routine coaching, like goal tracking, feedback, rehearsal,
- 1:08meeting preparation, nudges, after-action learning, and so on.
- 1:12While human coaches then focus mostly on senior executives, like
- 1:17they always have, where the decision stakes are high and to help navigate
- 1:21complex relationships and so on.
- 1:25You, you think about the kinds of organizations that are doing this.
- 1:3090% is a pretty high figure.
- 1:32You do highlight some examples of companies that are piloting
- 1:35AI coaches enterprise wide.
- 1:38What separates those organizations that can scale successfully from those that
- 1:43actually get stuck in the pilot phase?
- 1:47First, to do this right, you should test multiple solutions
- 1:50with dozens of end users-- workers, and managers-- ideally in pilots.
- 1:56Then these workers and managers should report back on things like ease of
- 1:59use, accuracy of the information the AI coach delivers, and obviously
- 2:05applicability to their work.
- 2:07Leaders should choose a solution that embeds in the flow of work.
- 2:10And by that I mean it should be able to integrate with email, with any
- 2:15collaboration tools like Teams or Slack that the organization uses, even
- 2:20HRIS and other systems, so that the AI can draw from those sources and
- 2:26also engage with the worker within the systems that they use every day.
- 2:30That's really important.
- 2:32Another thing is that organizations should also establish some
- 2:36cross-functional governance, involving HR, technology leaders, legal, obviously
- 2:42procurement professionals and so on, to develop standards, especially
- 2:47around data security and privacy.
- 2:48Because nothing will shut this down faster if people don't trust it.
- 2:53So select a supplier that can clearly meet your criteria around privacy.
- 2:58And then monitor too.
- 3:00You can't just implement it and leave it.
- 3:03You have to look at issues like language glitches when it speaks
- 3:07to people in different languages.
- 3:09There are sometimes issues, hallucinations, which we
- 3:11see with AI in general.
- 3:14And then having escalation procedures where a person being coached with
- 3:18AI might cross the line in terms of what they discuss with it.
- 3:21So how do you deal with things like that?
- 3:23It's complicated, like everything else we do.
- 3:25Right, Diana?
- 3:26It's not as easy as it looks.
- 3:29Yeah.
- 3:29You bring up a really important point.
- 3:31Individuals in an organization, you talked about how they
- 3:34have to actually trust this.
- 3:36Is that something in your research that you were able to dive into?
- 3:40How do you get individuals to actually trust this system and how do you get
- 3:45them to trust that this system is not going to reveal their deep, dark secrets?
- 3:51Yeah, it's a real challenge because the more you use AI coaching, the more people
- 3:58who are using it in the organization, the more valuable the data and content
- 4:03they create becomes to the organization.
- 4:06And yet you cannot violate the individual conversation with the AI coach.
- 4:12All that information has to be held and used in the aggregate.
- 4:16To do that, first, use things like your business resource groups or
- 4:20your employee resource groups to ensure that you have some inclusive
- 4:25adoption so that everyone has an opportunity to use this if they want to.
- 4:30And then focus on establishing and keeping trust by giving opt-in controls.
- 4:35If you're going to link the AI to a person's calendar or email, ask their
- 4:40permission first and honor their preferences if they don't want that done.
- 4:45Also, of course, only use the data in the aggregate.
- 4:49Most of the suppliers that we spoke to, Diana, they do this for you.
- 4:54They keep the data at their end and they do not give the organization any access
- 4:59to individual coaching conversations.
- 5:03I assume when you're communicating that becomes a very important thing
- 5:06that you communicate to the users.
- 5:09The fact that it is not housed in the company, it's actually
- 5:13housed with the outside provider.
- 5:15That must give a sense of comfort to the actual user.
- 5:20So that probably builds trust.
- 5:22It sounds like to be successful in implementing this system,
- 5:27you're talking about making this coaching part of daily work.
- 5:31Typically, when somebody is being coached, it can't all be on the individual.
- 5:37You've gotta provide some sort of nudges.
- 5:39You've gotta give direction before, during, and after coaching.
- 5:43How does that work when the coach is not a person?
- 5:47Talk a little bit about that.
- 5:49Yeah, for sure.
- 5:50It's a machine.
- 5:51We've gotta keep remembering that the AI coach is not a person.
- 5:54But it feels like a person, right?
- 5:56I mean, I've heard it actually feels like a person.
- 5:59Feels like a person and over 90% of participants in our experiments said
- 6:02that it really does a good job with empathy and showing understanding.
- 6:06So it draws people in.
- 6:07They start talking to it, they share things with it that they
- 6:11might not even share with a trusted friend because they might be
- 6:14embarrassed to say certain things.
- 6:16There's an AI coach and you should try to keep remembering
- 6:20that it isn't a real person.
- 6:23But one of the real potentially transformative benefits of AI coaching
- 6:28is that it can be embedded, as you say, in the flow of their work.
- 6:32But that means it's kind of always looking over your shoulder.
- 6:35If it's turned on and you're doing your email or you are just having a
- 6:40conversation on Teams, it's observing both ends of the conversation, by the way.
- 6:46And it might offer you a suggestion, might remind you that this person reacts better
- 6:53to this type of an approach and that type.
- 6:54It might do that in real time in some cases.
- 6:56That can be annoying to some people and extremely helpful to other people.
- 7:00So again, it comes back to the opt-in.
- 7:03If I feel that's helpful to me, then I want to turn it on.
- 7:06I think leaders should encourage that, though.
- 7:09Not enforce it, but encourage it so that they do get used to the AI.
- 7:14If you think about the AI is maybe not a person but someone who is a discreet
- 7:21colleague that really only cares about your success, then all of us could
- 7:26benefit from that sort of teammate.
- 7:28We just have to get used to it being over our shoulder and offering us advice
- 7:33without us soliciting that advice.
- 7:36Yeah.
- 7:37So now I'm sitting in my seat as a chief human resources officer (CHRO).
- 7:40What kind of cultural levers do you think a CHRO can really use
- 7:46to make this AI coaching stick?
- 7:49Because you're talking about piloting it and having to then
- 7:53embed it into the culture.
- 7:55What makes it go beyond just being a tool and actually becoming a habit?
- 8:01Well, I think it's some of the things we talked about before.
- 8:03You mentioned good communication, ensuring that everyone knows the
- 8:07conversations that they are having with their AI coach are confidential,
- 8:11giving them that ability to opt in.
- 8:13That's the table stakes, right?
- 8:15You have to start there.
- 8:17And then you need to really be good about selecting a solution that is
- 8:23user friendly, that does embed, that isn't overly over your shoulder.
- 8:27It doesn't need to be telling you what you're doing wrong every five minutes.
- 8:32It needs to have judgment in a lot of ways, artificial judgment, so
- 8:36that people appreciate nine out of 10 of the nudges they receive.
- 8:40Let's say if that's your bar, that they see the benefit of being
- 8:43told about their blind spots.
- 8:45We have a really good case study that talks about a person who was
- 8:49ready to demote an individual that had only promoted a few months before
- 8:53because that person was not showing the type of initiative and risk taking
- 8:58that was required for the position.
- 9:00But the AI, in looking through the past sessions, the one-on-ones that the two
- 9:06had, looking back at the manager's own blind spots and that individual's cultural
- 9:13differences, was able to show the manager that maybe their definition of taking
- 9:19initiative was quite a bit different than the employees given their background.
- 9:22I think a manager might appreciate that.
- 9:24And when you can have those kinds of small wins, I think over time the CHRO's job in
- 9:30convincing workers to adopt this and use it regularly will be solved in most cases.
- 9:35Diana, just the last point there, we've seen organizations go from pilot and
- 9:41then over the course of 90 to a 100 days, expand that to several thousand
- 9:45employees and then over the course of a year to upwards of 100,000 employees.
- 9:50Everyone has a access to it and is achieving use rates, which means not
- 9:55using it once but coming back and using it again and again, of 75% to 80%.
- 10:01That's amazing.
- 10:02I want to go back to the point that you just made, when you talk about the leader
- 10:07actually being coached, essentially, to think differently by the AI coach who's
- 10:16been employed to coach the employee.
- 10:20That signifies to me a mindset shift from the part of the leader
- 10:26that is really significant.
- 10:28So the coach is actually not only coaching the employee but perhaps
- 10:33coaching the manager as well, which is a different way to think about this.
- 10:36That is something that you might talk about a little bit because
- 10:40I think that's significant.
- 10:41That's different than how I think a lot of people view coaching.
- 10:44They think it's all always just one way.
- 10:46This is a two way coaching effort, right?
- 10:51Yeah, absolutely.
- 10:52We interviewed quite a few leaders in organizations who have begun
- 10:55to implement or are in different stages of implementing AI coaching.
- 10:58And one of the things that they talked about was that they said, especially when
- 11:02they're bringing in a new manager, someone who's been an individual contributor,
- 11:07making that very difficult transition for the first time to leading other people.
- 11:13And how big a gap there often is in skill sets there.
- 11:17And how an AI coach can really accelerate their ability to become an effective
- 11:23manager quickly and maybe not have to go through all of that pain, making
- 11:28mistakes, and so on, to become the type of manager who is better at coaching others.
- 11:33So, absolutely.
- 11:34I think one of the benefits of AI coaching is that it can coach the coach.
- 11:38We have a big section of the paper, by the way, around that.
- 11:41How does AI help human coaches, whether they are manager coaches or
- 11:48professional certified executive coaches?
- 11:51And there's a great deal of potential there for an AI coach
- 11:56to be a coach's assistant.
- 11:59Yeah, and I think what you're saying, there is really AI coaching
- 12:02reshaping the whole psychological contract between employer, employee.
- 12:07It really is reshaping how we think about growth, perhaps privacy and trust as well.
- 12:13And I don't know if you have some comments about that, but this is big.
- 12:17Yeah.
- 12:17In the paper we say it's potentially transformative and that word's
- 12:21thrown around a little bit.
- 12:22But I think in this case it's likely true.
- 12:26It's too early to say but if you think about what AI coaching can do, we've
- 12:32talked about it performing 90% of routine coaching for every worker, for
- 12:37every manager across the organization.
- 12:39We've talked about it helping managers become better coaches.
- 12:42We've talked about helping professional certified executive
- 12:46coaches become better coaches.
- 12:48What we haven't talked about very much is how, in the aggregate, it can give
- 12:52a CHRO access to an unprecedented level of real-time workforce intelligence
- 13:00insights that come from hundreds and then thousands of coaching sessions.
- 13:07And imagine that we work with engagement surveys.
- 13:10We do them once a year, twice a year, and so on.
- 13:12We scour the results and try to make some changes.
- 13:15And that's self-reported data.
- 13:17This is actual data, real conversations coming constantly, every day across
- 13:22hundreds of conversations that a CHRO can act on in the aggregate again,
- 13:28to see patterns and insights that can help them improve the culture.
- 13:32So I do, I agree.
- 13:33I think this is a big deal and is potentially
- 13:37transformative for organizations.
- 13:40Thank you.
- 13:40We're going to take a short break now and we'll be right back with more of
- 13:44my conversation with Allan Schweyer.
- 13:49Welcome back to C-Suite Perspectives.
- 13:51I'm your host, Diana Scott, Center Leader of the US Human Capital
- 13:55Center at The Conference Board.
- 13:56I'm joined by Allan Schweyer, Principal Researcher from the Human Capital Center.
- 14:01Allan, we were talking right now about the transformative nature of this AI coaching
- 14:07tool and we were beginning to delve into the kind of access to information that
- 14:13CHROs might have by using this tool.
- 14:16Let's talk a little bit more about that.
- 14:18I want to dive into that.
- 14:19For CHROs presenting to boards or talking to their chief financial officers (CFOs),
- 14:25what do you think the most persuasive way to frame the return on investment (ROI)
- 14:30or the strategic value of AI coaching?
- 14:32Suppose you have a budget of, let's just say, $1 million per coaching.
- 14:36And with that $1 million, you can have so many hours of very expensive
- 14:40human coaching, $400 or $500 an hour or more, for your executives and
- 14:44you generally exhaust your budget in most years by providing human
- 14:50executive coaches to your leaders.
- 14:52And then you expect your managers to act as coaches as well.
- 14:55Maybe even in some organizations you talk about peer coaching and you provide
- 14:59some learning and training around that.
- 15:01But you know, people are limited.
- 15:03They have limited time.
- 15:05Of course, managers have a greater span of control than they've ever had.
- 15:08We know.
- 15:09And it adds up in terms of the cost of time.
- 15:13If you take that $1 million budget, maybe you carve out a little piece to
- 15:16license, or I don't, I'm not gonna say a little piece, but a much less expensive
- 15:21piece, to license a secure and private AI coaching platform that gives AI coaching
- 15:28to everyone, then you could expect pretty hefty, I think, impact on ROI.
- 15:35Because, again, we know effective coaching is one of the best developmental tools.
- 15:40We also know from our research, and I mentioned this earlier, that
- 15:44people find that it provides concrete advice, next steps, is empathetic,
- 15:49is understanding, and so on.
- 15:51So if you help your workforce, whether that's 5,000 or 100,000 people or
- 15:57whatever number it is, become better at conversations and better at
- 16:02understanding the people they work with.
- 16:04One of our CEOs put it well.
- 16:05He said, "You can raise the collective emotional intelligence, the EQ of
- 16:09the organization, by 10 points," something the CEO said he'd been
- 16:13looking to do for years and years and was able to do with AI coaching.
- 16:18So then you can imagine an organization that just functions:
- 16:21better well-being, better collaboration, less negative conflict.
- 16:26No, you don't want everyone agreeing with each other, but positive conflict
- 16:30because people are being coached on how to work with each other more effectively.
- 16:35That is one side, so you expand it to your whole workforce.
- 16:38It takes care of, like we say, about 90% of the routine coaching at a
- 16:42price that's far less than what you would pay for human coaching.
- 16:45This reserves human coaching, again, for the big decisions, the decisions
- 16:51that executives tend to make for emotionally fraught conversations
- 16:55where values and ethics might come in or complex relationships.
- 16:59So you're actually focusing that human coaching better than you were in the past.
- 17:03So there's ROI in that, and then of course there's large potential ROI in
- 17:08the collective insights you receive from having AI coaching across the enterprise.
- 17:15Can you talk a little bit more about that?
- 17:17You started to talk about that before our break.
- 17:19There is real insight that comes from that.
- 17:22Describe a little bit about what that might be and how that might be helpful
- 17:26to executives across the company, to the CHRO, or even to a board in terms of
- 17:32understanding a little bit more about the ethos and the culture of the organization.
- 17:37Yeah.
- 17:38It's always good to start this with emphasis on privacy and never looking
- 17:42into people's AI, coaching conversations.
- 17:45People have to be a 100% certain you're not going to do that or
- 17:47they're just not going to use it.
- 17:48So once you've solved that, you've earned the trust, you've kept the trust, then
- 17:53you should look at the aggregate data.
- 17:57Your supplier, if you're using an external AI coaching
- 18:00provider, can help you with that.
- 18:02You can use it to look at patterns as they're developing.
- 18:06So this could be employee sentiment, it could be like an engagement survey.
- 18:10You're using it to understand how your employees are feeling, what
- 18:15kinds of tasks they're asking their AI coach to help them with, which
- 18:20can inform learning and development.
- 18:22As you go a little bit more granular, you might learn about issues within divisions.
- 18:27Gets a little more dangerous when you look down to the team level because
- 18:30you're getting closer to the individual.
- 18:31But you might look at issues that could be arising, emergent issues
- 18:36that you could resolve more quickly if you understand what's happening.
- 18:39These are all cultural things.
- 18:41Insights that you get from conversations that people have with their AI coaches
- 18:47in the aggregate really can affect every aspect of human capital management.
- 18:52If you think about it, it can give you insights into the emerging skills.
- 18:57There are some organizations that are using it to build skills,
- 19:00to help build skills taxonomies as they become skills-based
- 19:04or skills-first organizations.
- 19:06They're extracting that type of intelligence, definitely helping with
- 19:10more precise learning and development, how to keep employees engaged.
- 19:15You could also infer skills and interest to think about how you might optimally
- 19:20deploy people and teams with this data.
- 19:23It can be used in workforce planning.
- 19:26The uses we're still discovering.
- 19:29In the paper we have some vignettes that we've taken out
- 19:33from talking to organizations.
- 19:34You'll see in the paper uses in recruiting, uses in inclusion
- 19:41and belonging, use cases also for workforce planning, and, by
- 19:46the way, health and well-being.
- 19:49It sounds like there's a treasure trove of data and information and
- 19:52learning that can come out of this.
- 19:54You alluded to this.
- 19:55Obviously, as you begin to analyze communication and behavior patterns
- 20:01and everything, you begin to delve into some potentially dangerous areas.
- 20:06So talk a little bit about some of the ethical guardrails that you
- 20:11might need to put in place before you think about full-scale deployment.
- 20:16What are some of the things that companies are doing just to make sure that they're
- 20:20guarding against crossing any lines?
- 20:23Yeah.
- 20:24We haven't talked about the difference between generic
- 20:29large generative AI models.
- 20:30Your ChatGPTs and Copilots and Geminis.
- 20:34These are where most organizations tend to start.
- 20:38You have a curious human resources leader who says, "I'm going to try this
- 20:43for my own career development," or, "I'm going to do something over here
- 20:46with an AI coach." And then they're intrigued and maybe they're the catalyst
- 20:49for something like a formal pilot.
- 20:52The thing about the solutions that are the generic, ChatGPT and so
- 20:56on, is they are owned or licensed.
- 20:59There is a version of that on your servers in your organization.
- 21:04You cannot say in those circumstances that the organization could not access
- 21:08individual conversations because they can.
- 21:11You could guarantee that they won't but it's a little harder because you can't
- 21:15say that they can't, if you follow.
- 21:17The solutions that are purpose built for AI coaching, and some of the
- 21:22ones that we tested, are the ones who will put that firewall between the
- 21:27organization and individual conversations.
- 21:29So that could be an important part of it.
- 21:33You want to adopt a privacy-by-design solution, whatever it is.
- 21:38That means encryption of these conversations.
- 21:42Retention because when you retain coaching conversations over time,
- 21:48the data's bigger and better.
- 21:50You've got historical conversations to look back at and to synthesize
- 21:56with current conversations.
- 21:58You don't want to necessarily delete them but you do have to have some
- 22:03standards around how long you're going to retain a coaching conversation.
- 22:07Obviously aggregate only reporting.
- 22:09Keeping a human in the loop for sensitive topics, to intervene when
- 22:15necessary, to be like an ombudsman.
- 22:17If someone has a question or a challenge to what's going on in the organization.
- 22:22You should be, as I mentioned, aligning.
- 22:25It's usually driven by the chief human resource officer or a senior leader in
- 22:31that group, but bring legal in early on.
- 22:34Bring communications in early on.
- 22:36Leverage your employee resource groups.
- 22:39And, I mentioned, don't make employees use it.
- 22:44Don't tell employees that you're going to integrate it with
- 22:46their calendar and their emails.
- 22:48Ask for permission, offer opt-in for these types of things, and
- 22:53then come up with a series of trust metrics so you can track how many
- 22:57times are people challenging this?
- 23:00What is your opt-in?
- 23:01That's a really good one, right?
- 23:02Where if you've said you can opt-in to have the AI integrate with your
- 23:07calendar, email and other systems, what percentage of your workforce
- 23:11is saying, okay versus no, right?
- 23:13Because that shows trust.
- 23:14So have some metrics and track those and see how you're doing
- 23:18so you have a trust barometer.
- 23:20Sounds really like great advice.
- 23:22From a global perspective, we know that there's some growing
- 23:25divergence between the EU's AI Act approach and, obviously, what's a
- 23:30little bit more flexible in the US.
- 23:33How should organizations think about that when they're deploying
- 23:36AI and talent development?
- 23:39Yeah, I think this one's a simple one.
- 23:41It sounds like it could get very complex if you try to overthink it.
- 23:45There's also differences between states and the US as in terms
- 23:50of privacy rules and laws.
- 23:53So I think the right thing to do for any organization is to look at everywhere
- 23:58that they operate, whether that's internationally or across different
- 24:02states in this country, and default to the strictest of those regimes.
- 24:07That's especially true for Europe because, as you mentioned, it's got some of the
- 24:11most protections for the individual.
- 24:14So just fall to the standards of the strictest regime and you should be okay.
- 24:19That makes sense.
- 24:20Final question for you, Allan.
- 24:22As you look about five years out, do you think AI is going to make leadership
- 24:26development more human or is it going to risk making it more mechanized?
- 24:32And does that give you optimism about where this is headed?
- 24:36Yeah, that's the question of the day.
- 24:38If you'd asked me that before we started this research, I would've said it'll
- 24:42become more automated and mechanized.
- 24:45But I think paradoxically, it'll make it more human if it's designed well.
- 24:50You know why?
- 24:51Because, first, the 90% of coaching that we're talking
- 24:54about is routine, everyday stuff.
- 24:57This leaves more time for human coaches to attend to the 10%, the coaching that deals
- 25:02with values, emotion, corporate politics, complex relationships with stakeholders
- 25:07inside and outside the organization.
- 25:09Those things that AI really cannot do.
- 25:12We haven't talked about that too much but there's a lot
- 25:14that AI coaching can't do yet.
- 25:17This could change in five years but we're talking about now.
- 25:21And I know we're talking about five years out but I'm going to say I still
- 25:24think it's going to be more human.
- 25:26When AI acts as a human coach's assistant, for example, it
- 25:30remembers prior conversations.
- 25:32It can help the human coach remember what you talked about three
- 25:36sessions ago and why that should be brought into the next conversation.
- 25:39It can do administrative things like that.
- 25:41And what happens when it takes those things off the human coach's plate?
- 25:45It frees a human coach to be more human, to focus on human issues
- 25:49rather than administrative issues.
- 25:51We talked about AI accompanying worker, being that teammate
- 25:54looking over their shoulder.
- 25:56If it can anticipate their needs like we've been talking about and help
- 26:00them strengthen their relationships with team members, that's gonna
- 26:04make the workplace a happier, more friendly and collaborative place.
- 26:10So I think more human.
- 26:11All bets off if we get some form of super intelligence in the next five years
- 26:15or something of that nature, then, you know, then I'll be wrong about this.
- 26:20I love your optimism, Allan, and I'll take that AI makes us more human.
- 26:27It's an augmentation tool.
- 26:28It makes us more human.
- 26:29I'll take it.
- 26:30And thank you for joining us today, Allan.
- 26:34Thank you.
- 26:34I appreciate it.
- 26:35And thanks to all of you for listening to C-Suite Perspectives.
- 26:39I'm Diana Scott, and the series has been brought to you by The Conference Board.