Latest / How I Work / How AI is changing the way you think (and how to fight back) with Prof Scott Anthony
Transcript
- 0:01Speaker 1: What happens to our ability to think critically when we
- 0:04Speaker 1: start outsourcing it to AI all the time? My guest today,
- 0:09Speaker 1: Professor Scott Anthony, is one of the world's leading experts
- 0:13Speaker 1: on innovation and disruption, and he believes that how we
- 0:16Speaker 1: use AI today could shape the future of our judgment,
- 0:20Speaker 1: our creativity, and even our careers. Scott is a professor
- 0:25Speaker 1: at the tuch School of Business. He's also the former
- 0:27Speaker 1: managing partner at Innosite, the firm co founded by the
- 0:30Speaker 1: Lake Clayton Christensen, and the author of several books, including
- 0:34Speaker 1: his latest one, Epic Disruptions. In this conversation, he shares
- 0:38Speaker 1: how AI is transforming the way he teaches, consults and thinks,
- 0:43Speaker 1: and why he draws a very firm line on where
- 0:46Speaker 1: he will never let AI do the work. By the
- 0:50Speaker 1: end of this episode, you'll know exactly how to leverage
- 0:53Speaker 1: AI as a teammate without letting it hollow out your
- 0:57Speaker 1: critical thinking skills. Why protecting your judgment is more important
- 1:03Speaker 1: than ever so if you've ever wondered, am I thinking
- 1:06Speaker 1: less deeply than I used to? This episode might just
- 1:10Speaker 1: change the way you work. Welcome to How I Work,
- 1:23Speaker 1: a show about habits rituals and strategies for optimizing your day.
- 1:27Speaker 1: I'm your host, doctor Amantha Imber. I want to start
- 1:34Speaker 1: by talking about change, because obviously a lot of your
- 1:37Speaker 1: work in the last couple of decades has involved massive
- 1:42Speaker 1: change in helping organizations navigate that, and I dare say
- 1:46Speaker 1: in both our careers, AI is the biggest disruptor that
- 1:51Speaker 1: we have both seen. Is that fair to say? Would
- 1:54Speaker 1: you say the Internet was larger Scott or are we
- 1:57Speaker 1: going with AI? Yeah?
- 1:58Speaker 2: Time of course will tell on this, but I suspect
- 2:01Speaker 2: time will ultimately judge AI as the biggest disruptor in
- 2:04Speaker 2: our lifetime. And who knows what will come after this,
- 2:06Speaker 2: but at least of what we have seen thus far,
- 2:09Speaker 2: just the pervasive impact of it and really changing the
- 2:12Speaker 2: way that knowledge is created and transmitted and processed. That
- 2:16Speaker 2: has so much ubiquity, it's hard for that not to
- 2:19Speaker 2: have cascading disruptive effects.
- 2:21Speaker 1: So I want to know, then, what are the biggest
- 2:24Speaker 1: changes that it's made to the way you work? As
- 2:27Speaker 1: a business professor.
- 2:28Speaker 2: I am in the maybe somewhat advantage position compared to
- 2:33Speaker 2: some of my colleagues. I've only been teaching for three years,
- 2:35Speaker 2: so there's not that much I have to unlearn as
- 2:37Speaker 2: opposed to people who might be my age but have
- 2:40Speaker 2: been teaching for longer than three years.
- 2:42Speaker 3: But whatever.
- 2:43Speaker 2: But really you're seeing a change just about everything. Change
- 2:46Speaker 2: the way that you're doing research, change the way you're
- 2:49Speaker 2: putting together courses, change the way that you're running your classes,
- 2:52Speaker 2: change the way that you're assessing students. And we can
- 2:56Speaker 2: go deeper in each of these areas, but I think
- 2:58Speaker 2: that the headline is AI is to a degree changing
- 3:02Speaker 2: everything that's happening in universities, which really isn't a surprise.
- 3:05Speaker 2: I mean, what is a university. It's the creation and
- 3:08Speaker 2: dissemination of knowledge of words.
- 3:11Speaker 3: And what is AI?
- 3:12Speaker 2: Generator of AI very good at it's very good at
- 3:15Speaker 2: putting together words in unique ways. So those two things
- 3:18Speaker 2: come together in a kind of predictable sort of way.
- 3:21Speaker 1: I do want to dig into learning, and we will
- 3:23Speaker 1: go there and also teaching as well. But first, one
- 3:26Speaker 1: of the things that when we last spoke that was
- 3:29Speaker 1: not a recorded conversation, one of the things that intrigued
- 3:31Speaker 1: me most is your latest book, Epic Disruptions. Your clause
- 3:37Speaker 1: with Harvard, who's your publisher, had what I thought was
- 3:40Speaker 1: quite a unique AI clause. Can you tell me about
- 3:43Speaker 1: what they stipulated for your book?
- 3:45Speaker 2: Absolutely, and in preparation for this, I got the actual
- 3:48Speaker 2: language from it, which I hoped them any trouble with Harvard,
- 3:51Speaker 2: But I'll explain that the why behind it, which I
- 3:53Speaker 2: think will help. The exact clause is authors shall not
- 3:57Speaker 2: generate or use content for the work and collaborate with
- 4:00Speaker 2: or buy artificial intelligence tools SLASH applications without the prior
- 4:05Speaker 2: written consent of publisher. So I called it the thou
- 4:08Speaker 2: shalt not use AI clause again without coordinating with the publisher.
- 4:12Speaker 2: And when you first see that, you're like, oh, that
- 4:14Speaker 2: sounds kind of dragconian. But what's behind that. Well, it's
- 4:17Speaker 2: still unclear if work is generated by AI what that
- 4:21Speaker 2: means for copyright. And if you're a publisher and you
- 4:24Speaker 2: care about copyright, that's a really big deal. So if
- 4:27Speaker 2: you're reporting something to be original work but it's actually
- 4:30Speaker 2: plagiarized or not original work, that could be a real problem.
- 4:33Speaker 3: So, of course there are.
- 4:34Speaker 2: Ways that you can and should and do use AI
- 4:37Speaker 2: during the writing process, but the idea here is don't
- 4:40Speaker 2: outsource it, and if you do, please tell us not
- 4:43Speaker 2: Please tell us you must tell us.
- 4:45Speaker 1: I found that interesting because I'm working on my fifth
- 4:50Speaker 1: book at the moment with Penguin Random House, and there
- 4:52Speaker 1: was no AI clause with them, which, after having that
- 4:55Speaker 1: discussion with you, made me think, hmm, maybe it's in
- 4:59Speaker 1: there now since I signed contracts. Maybe they're making all
- 5:01Speaker 1: their authors do that. But I was intrigued. And so
- 5:04Speaker 1: then in your book writing process, how did you use AI?
- 5:09Speaker 2: If it all so the research and writing of the
- 5:12Speaker 2: chapters and just brief overview of the book epic disruptions
- 5:15Speaker 2: eleven innovations that.
- 5:16Speaker 3: Shape our modern world. This is a history book.
- 5:19Speaker 2: It starts with gunpowder, it goes up to the Apple iPhone,
- 5:22Speaker 2: with then a conclusion looking at disruptions that are in
- 5:25Speaker 2: process today. But there's a lot of research. So the
- 5:28Speaker 2: actual research of the chapters and the writing of the
- 5:30Speaker 2: chapters I did independently. What I used AI for was
- 5:35Speaker 2: to brainstorm, so what are really the epic disruptions that
- 5:39Speaker 2: should make the short list? I had some thoughts I
- 5:42Speaker 2: parried with open AI, chat GPT to come up with
- 5:45Speaker 2: some additional thoughts, kicked around ideas and so on, titling
- 5:48Speaker 2: what's the right way to title and trying to pull
- 5:50Speaker 2: out what are some of the themes that I'm seeing?
- 5:52Speaker 3: Is it three? Is at five?
- 5:54Speaker 2: Those kinds of things that are not in the writing,
- 5:57Speaker 2: but really in some of the things that wrap around it.
- 5:59Speaker 2: I found a to be incredibly helpful, not always perfect
- 6:02Speaker 2: at the end, you know, you have to own it yourself,
- 6:04Speaker 2: but if you're trying to expand your thinking, it's a
- 6:07Speaker 2: really useful tool.
- 6:08Speaker 1: I know you're obviously an early adopter of Jenai, and
- 6:11Speaker 1: I imagine your approach to prompting and getting the best
- 6:14Speaker 1: out of it has evolved. Tell me how you use
- 6:17Speaker 1: it as a brainstorming partner.
- 6:19Speaker 2: A lot of it is context engineering, you know, making
- 6:22Speaker 2: sure that you put in place the right parameters so
- 6:25Speaker 2: that you are getting a legitimately different perspective on things.
- 6:29Speaker 2: So whether that's taking on a different role, or it's
- 6:32Speaker 2: saying let's be a skeptic or let's be a supporter
- 6:35Speaker 2: or whatever, trying to make sure that you a set
- 6:38Speaker 2: the context where you're going to get something that is
- 6:40Speaker 2: what you're looking for, which might be something that's as
- 6:43Speaker 2: novel as possible or something that's more fine tune as possible,
- 6:47Speaker 2: whatever it is. The second is multiple tools My favorite
- 6:50Speaker 2: at the moment are Claude and chat Shept, So I'll
- 6:53Speaker 2: play them off each other so i'lle be simultaneously brainstorming
- 6:57Speaker 2: a topic. I'd be like, oh, the other one said this,
- 6:59Speaker 2: what do you think?
- 7:00Speaker 3: Think about that?
- 7:01Speaker 2: And at some point they converge because all the foundational
- 7:04Speaker 2: stuff will get you to the same place, but they
- 7:06Speaker 2: actually will start sometimes in very different places. And of
- 7:08Speaker 2: course we know if we use the systems, sometimes the
- 7:11Speaker 2: exact same prompts will go in different directions, just depending
- 7:15Speaker 2: on whatever is the magic that's happening underneath the hood.
- 7:18Speaker 2: But those two things are really trying to say, let's
- 7:20Speaker 2: push for the personas and get the context right and
- 7:23Speaker 2: then using different models. Those are the two things that
- 7:25Speaker 2: I found to be the most helpful.
- 7:27Speaker 1: I will quite often when I'm working on quite a
- 7:31Speaker 1: big project where I want to get different views, I
- 7:33Speaker 1: will quite often have the same prompt in CHETJPT Claude
- 7:38Speaker 1: and Gemini and then finish with ask me you know
- 7:41Speaker 1: any questions so you can be ninety five percent confident
- 7:43Speaker 1: and doing a great job. And it's quite interesting the
- 7:46Speaker 1: different questions that I'll get back when it's a task
- 7:49Speaker 1: that could go in several different directions, So I do
- 7:53Speaker 1: love that as a way and kind of sparring them
- 7:56Speaker 1: against each other I found really useful. One of the
- 7:59Speaker 1: things that I wonder as I think a lot of
- 8:02Speaker 1: people and particularly knowledge workers that you know, whose value
- 8:05Speaker 1: is in their thinking use AI a lot, is I wonder, firstly,
- 8:10Speaker 1: what's going to happen to our ability to think critically?
- 8:13Speaker 1: And then what's going to happen to our ability to
- 8:17Speaker 1: maintain good judgment? And I want to know for you
- 8:21Speaker 1: with the thinking critically, how do you think about that
- 8:24Speaker 1: for yourself? And do you worry am I going to
- 8:27Speaker 1: lose the ability to think critically if I kind of
- 8:29Speaker 1: crossed that line where I've suddenly outsourced just a little
- 8:32Speaker 1: bit too much to AI?
- 8:33Speaker 2: Yeah, it is something that I worry about a lot.
- 8:36Speaker 2: I worry even more about for my students and even
- 8:38Speaker 2: more for my children. So as you've got then three
- 8:41Speaker 2: generations there, You've got me nineteen seventy five, my kids
- 8:45Speaker 2: who were born between two thousand and five and twenty sixteen,
- 8:48Speaker 2: and then the students who generally are about thirty years old,
- 8:51Speaker 2: so the average day of birth would be about whatever
- 8:53Speaker 2: that is, nineteen ninety five. It really is being very
- 8:57Speaker 2: clear about the lines. I'm trying to do something that
- 8:59Speaker 2: does rep present original thinking. I just can't outsource that.
- 9:03Speaker 2: I can't ask AI for a first draft of something
- 9:06Speaker 2: I tried, you.
- 9:07Speaker 3: Know, when it first came out. Of course, I'm going
- 9:09Speaker 3: to play around with it.
- 9:10Speaker 2: So I'm like, okay, I've got an idea for a
- 9:12Speaker 2: new class, please, is not a curriculum for me? And
- 9:14Speaker 2: A the output was not particularly good, and B my
- 9:18Speaker 2: brain wasn't in it. I hadn't thought about it, I
- 9:20Speaker 2: hadn't processed it, I hadn't struggled, et cetera. So now
- 9:23Speaker 2: when I'm working on a new course, certainly I'll say, okay,
- 9:26Speaker 2: this bit of it, I need to think about some
- 9:28Speaker 2: additional readings, or I want to think about some of
- 9:31Speaker 2: the principles I want to teach here, so I'll get
- 9:34Speaker 2: help to sharpen. But ownership of the integration it has
- 9:38Speaker 2: to be by me or else. That's just a skill
- 9:40Speaker 2: that's going to lapse. So that, to me is the
- 9:42Speaker 2: most important thing. Drawing the line and being really clear
- 9:46Speaker 2: about where you draw that line. There are other tasks
- 9:48Speaker 2: that are less critical where I'm very happy to outsource.
- 9:51Speaker 2: More so as an example, I was facilitating a panel
- 9:54Speaker 2: discussion a couple months ago, and that was pretty much
- 9:57Speaker 2: churn and burn. You know, here are my panel us,
- 10:00Speaker 2: make me smarter about who they are, give me a
- 10:03Speaker 2: few good questions.
- 10:04Speaker 1: Task.
- 10:04Speaker 2: Okay, that's great raw material. I can then turn that
- 10:06Speaker 2: into a finished product. But I was totally fine with
- 10:09Speaker 2: first draft being done by AI. But when you really
- 10:12Speaker 2: need to turn on the critical thinking and reasoning, first
- 10:14Speaker 2: draft by AI, I think the research shows is really
- 10:17Speaker 2: really dangerous.
- 10:19Speaker 1: It's interesting because I it would have been about a
- 10:22Speaker 1: year ago now. I had an executive from Google on
- 10:26Speaker 1: the show and they were talking about how their default
- 10:30Speaker 1: was to use AI or Gemini for the first draft
- 10:34Speaker 1: of everything as a place to start. And I kind
- 10:37Speaker 1: of get that because the blank page in any kind
- 10:40Speaker 1: of work can be a little bit confronting. No One,
- 10:42Speaker 1: particularly writers like us, like a blank page. But then
- 10:46Speaker 1: how do you decide like because I imagine sometimes it
- 10:50Speaker 1: is a fine line. The example that you've given is
- 10:52Speaker 1: quite stark. But are there examples where m you're kind
- 10:57Speaker 1: of on the fence about whether to use A to
- 11:00Speaker 1: help do the thinking versus you sit and struggle with
- 11:05Speaker 1: it and do the hard unpleasant deep work yourself.
- 11:09Speaker 2: So you know, last term, I had sixty five students
- 11:12Speaker 2: in one of my classes, and there's qualitative feedback that
- 11:15Speaker 2: comes from the sixty five students, and the easy thing
- 11:18Speaker 2: to do is to dump it all in chat shept
- 11:20Speaker 2: and say, tell me the three themes that you see here.
- 11:23Speaker 2: And I did that, except I said, I want the
- 11:26Speaker 2: three themes that you see. I want the biggest outlier
- 11:29Speaker 2: that you see that is negative and that's positive, and
- 11:32Speaker 2: I want something random that you can throw back me.
- 11:35Speaker 2: And then I went and did the same thing over
- 11:37Speaker 2: at Claude. So again tried to have it go through
- 11:39Speaker 2: multiple models, so I didn't fall into the easy trap
- 11:41Speaker 2: of saying, Okay, this is set to warm, so it's
- 11:44Speaker 2: going to tell me that the very nice things my
- 11:46Speaker 2: students had to say, and I'll just be all done
- 11:48Speaker 2: and moved on. So I tried to make sure that
- 11:50Speaker 2: I balanced the big efficiency gains that I got from
- 11:53Speaker 2: not going through every word of everything while also being provoked.
- 11:57Speaker 2: And then I was so interested in the feedback I
- 11:59Speaker 2: did in the end go back and read all of it.
- 12:01Speaker 2: So it didn't end up saving any time at all,
- 12:02Speaker 2: but it was fun to look at it from various angles,
- 12:05Speaker 2: so you know, that is the thing that again back
- 12:07Speaker 2: to the conversation we had about the different ways that
- 12:10Speaker 2: you contact engineering, set perspectives. If you do, put some
- 12:14Speaker 2: things that will force you to critically reason into your
- 12:17Speaker 2: prompts so that what you're getting back is not just
- 12:20Speaker 2: the answer, but is an answer with outliers and as
- 12:24Speaker 2: you said, questions for consideration. Those I think are great
- 12:28Speaker 2: things that can help make sure we don't lose that
- 12:30Speaker 2: is that again, I think it is probably the most
- 12:33Speaker 2: important thing we're going to have to struggle with over
- 12:35Speaker 2: the next decade. And I worry, in a parallel to
- 12:38Speaker 2: what we saw in the book, that many of the
- 12:41Speaker 2: early adopters of AI are going to say, what have
- 12:43Speaker 2: we done? They'll say, at first, this is great, We've
- 12:46Speaker 2: got all these efficiency gains, and then X number of
- 12:49Speaker 2: years in the future they will have hollowed out their
- 12:51Speaker 2: ability to actually do things, and they'll say, we got
- 12:54Speaker 2: something wrong when we did this short term gain but
- 12:57Speaker 2: long term pain.
- 12:58Speaker 1: Yeah. I really are worry about people's ability to think critically.
- 13:03Speaker 1: I mean, as humans, where we're programmed to go down
- 13:05Speaker 1: the path of least resistance, and that is to outsource
- 13:08Speaker 1: our thinking to AI, and I worry, like I feel
- 13:13Speaker 1: it in myself that it takes willpower to go Okay,
- 13:16Speaker 1: I need to sit here and I need to sit
- 13:18Speaker 1: in discomfort, and I need to do the thinking. And
- 13:22Speaker 1: I do choose to do that because integrity is valued
- 13:26Speaker 1: of mine. But I think it's you know, it's also
- 13:29Speaker 1: like I can see how a lot of people who
- 13:32Speaker 1: are known for their thinking and their quality of their thinking,
- 13:35Speaker 1: it's really easy to go down that path. And you know,
- 13:37Speaker 1: like I kind of look at what LinkedIn has become,
- 13:41Speaker 1: where you know thinkers that I used to follow kind
- 13:44Speaker 1: of like that is not you. You have not generated that.
- 13:48Speaker 1: Why am I even on LinkedIn? How do you feel
- 13:50Speaker 1: now about that as a platform, Like you're very active
- 13:52Speaker 1: on it, but what is your view of what's going
- 13:54Speaker 1: on there and how you're approaching it yourself as someone
- 13:57Speaker 1: who is you know, a great thinker?
- 13:59Speaker 2: Well, ye, first of all, thanks for calling me a
- 14:01Speaker 2: great thinker sub days better than others. But you know,
- 14:03Speaker 2: a couple of years ago, I was participating in offsite
- 14:07Speaker 2: with a bunch of senior leaders from a large organization
- 14:11Speaker 2: and they said, we want some stimuli, and we want
- 14:13Speaker 2: stimuli not from you, but from younger voices. So I
- 14:16Speaker 2: asked my son Charlie, who was seventeen years old at
- 14:19Speaker 2: the time, to come in and share a perspective about AI,
- 14:22Speaker 2: and he said, look, everyone in my school is using
- 14:24Speaker 2: it all the time, and the thing I really worry
- 14:26Speaker 2: about is that we're going to end up like those
- 14:28Speaker 2: really obese humans in the movie Wally that have completely
- 14:32Speaker 2: lost their capacity to think about anything. None of the
- 14:35Speaker 2: metaphor we were talking about is you know, back in
- 14:37Speaker 2: the day when we were in high school, you could
- 14:40Speaker 2: go to the bathroom and you could buy the answers
- 14:42Speaker 2: to the test. You know, someone at the stall next
- 14:44Speaker 2: to you would have the answer key or whatever. And
- 14:46Speaker 2: people didn't do that because it was just so blatantly
- 14:49Speaker 2: obviously cheating. But now when you go to a large
- 14:52Speaker 2: language model and you ask for a first draft to something,
- 14:55Speaker 2: it doesn't feel like cheating, So, you know, it just
- 14:58Speaker 2: it feels different. And you talked about acting with integrity,
- 15:01Speaker 2: but you could also argue that people are using the
- 15:04Speaker 2: best tools available to be able to get the best
- 15:06Speaker 2: answers they can. So, you know, back to what we
- 15:08Speaker 2: are thinking about on campus, how do you actually go
- 15:11Speaker 2: and design educational experiences that encourage people to learn that
- 15:17Speaker 2: help them sit with the discomfort you talked about, teach
- 15:20Speaker 2: them to be comfortable in that discomfort, and then go
- 15:23Speaker 2: and assess them in a way that goes and says, Yes,
- 15:26Speaker 2: use the best tools that you can, but make sure
- 15:28Speaker 2: we're also developing critically as human beings.
- 15:31Speaker 3: It's an incredibly hard topic.
- 15:33Speaker 1: It's really good segue into your work in the business school,
- 15:37Speaker 1: the Taxical of Business, one of the top business schools
- 15:39Speaker 1: in America, Like, how is your approach to teaching what
- 15:45Speaker 1: I'm sure are incredibly smart minds, but who do have
- 15:49Speaker 1: access to AI and who theoretically can outsource their thinking?
- 15:53Speaker 1: How do you design a course and then assess these
- 15:56Speaker 1: students in this new world that we're in with great care?
- 16:00Speaker 3: That's the short answer.
- 16:02Speaker 2: That have some advantage in that the courses that I
- 16:05Speaker 2: teach are generally not fined and apply a mathematical formula
- 16:09Speaker 2: or use an off the shelf framework, but more around
- 16:13Speaker 2: critical thinking, really, and how do you deal with uncertainty
- 16:16Speaker 2: and how do you go and act when the data
- 16:18Speaker 2: is telling you not to and hear the voice that
- 16:20Speaker 2: doesn't speak and that stuff isn't regurgitation of frameworks that
- 16:24Speaker 2: you find in books. It's going and puzzling through things together,
- 16:27Speaker 2: very discussion oriented courses and so on, so along some dimensions.
- 16:31Speaker 2: I think it is easier in that context to do
- 16:34Speaker 2: what I do, which is tell students please use AI
- 16:37Speaker 2: to go and go through the case material or to
- 16:39Speaker 2: come up with first answers to questions.
- 16:41Speaker 3: But we're going to be in a room.
- 16:43Speaker 2: We're going to put ourselves in the shoes of a
- 16:45Speaker 2: participant or a case protagonist.
- 16:48Speaker 3: We're going to talk about it, and the laptops.
- 16:49Speaker 2: Are going to be closed and the cell phones are
- 16:51Speaker 2: going to be off. So you know, whatever you've done
- 16:53Speaker 2: to prepare, that's fine, But fifty percent of your grade,
- 16:56Speaker 2: then it is the discussion quality that we have in class.
- 16:59Speaker 2: So it's pushing on that in class experience and discussion.
- 17:02Speaker 2: That's point number one.
- 17:04Speaker 3: Point number two.
- 17:05Speaker 2: I'm thinking, and this is still emergent, thinking about how
- 17:08Speaker 2: do you assess learning in different ways? So I started
- 17:11Speaker 2: a couple terms ago giving people an option for the
- 17:14Speaker 2: final assignment.
- 17:15Speaker 3: The old final assignment.
- 17:16Speaker 2: Was take everything we learned in class, write a paper
- 17:19Speaker 2: about some company, some leader, apply learning from class. The
- 17:23Speaker 2: new option is take everything we learned in class, find
- 17:26Speaker 2: a leader, give me two hundred words about why you
- 17:28Speaker 2: pick this leader. Then design an AI tool to help
- 17:32Speaker 2: them learn something that you learned in class. And the
- 17:35Speaker 2: most critical thing I learned about that is and show
- 17:38Speaker 2: me your work. So the output I kind of care about.
- 17:42Speaker 2: What I really care about is the exact prompts you use,
- 17:45Speaker 2: the back and forth you had with the large language models,
- 17:48Speaker 2: the critical thinking you displayed, blah blah blah blah blah,
- 17:51Speaker 2: because I learned the first run. And sometimes you get
- 17:53Speaker 2: these very very elegant outputs that had a lot of
- 17:56Speaker 2: mess that went into them. I'm like, this is you
- 17:58Speaker 2: didn't do much work and actually did a ton. And
- 18:01Speaker 2: then sometimes you see these things where the output looked
- 18:03Speaker 2: super sophisticated, but the students did basically no work and
- 18:07Speaker 2: had no understanding. So if you don't see the work,
- 18:09Speaker 2: you don't understand that. And then finally, I sample size
- 18:12Speaker 2: the one. But I ran an experiment the last term
- 18:15Speaker 2: where I did a thirty minute interview with the student
- 18:18Speaker 2: at the end of the term and said, we're going
- 18:20Speaker 2: to try this out, just see what it's like. But
- 18:21Speaker 2: pick a situation, let's talk, so you know, just trying
- 18:25Speaker 2: to figure out different ways to assess whether people really
- 18:27Speaker 2: have learned, in some cases leaning into AI, in some
- 18:30Speaker 2: cases going about as old school as you'll go. And
- 18:33Speaker 2: this is an example of one of something that every
- 18:36Speaker 2: educator is thinking about right now.
- 18:37Speaker 1: Now, I do want to talk about consulting and the
- 18:40Speaker 1: context you worked in the world of management consulting for
- 18:45Speaker 1: I want to say about twenty years Scott nailed it. Yeah, fantastic. Yeah.
- 18:49Speaker 1: And during that time you were managing partner of you know, Site,
- 18:54Speaker 1: which is the firm that the late Clayton Christiansen started,
- 18:57Speaker 1: and that is how we connected when you were you know,
- 19:00Speaker 1: several years ago. So I want to understand, like, if
- 19:04Speaker 1: you were still working in consulting, how do you think
- 19:07Speaker 1: you would be using AI for client work.
- 19:11Speaker 2: I want to give you a historical example first, then
- 19:13Speaker 2: I'll come answer it. So, you know, fourteen forty Gudenbergen
- 19:16Speaker 2: team comes up with the printing press. We know the
- 19:18Speaker 2: basic story. The world changes. The thing that I just
- 19:21Speaker 2: want to reflect on is who is Gudenberg's first actual customer. Well,
- 19:25Speaker 2: it's the Catholic Church and it makes a lot of
- 19:26Speaker 2: sense dominant organization.
- 19:28Speaker 3: It's time.
- 19:29Speaker 2: Not that many Bibles could be created if you have
- 19:31Speaker 2: to hand inscribe them. The printing press makes it much
- 19:34Speaker 2: easier for the Catholic Church to disseminate the Bible that
- 19:37Speaker 2: looks good in the beginning. Martin Luther picks up the
- 19:40Speaker 2: very same technology and the Reformation happens, and the Catholic
- 19:43Speaker 2: Church might ultimately regret the fact that it helped the
- 19:47Speaker 2: fund and innovation that yes, helped u spread the Bible,
- 19:50Speaker 2: but also kind of tore the church apart. And I
- 19:53Speaker 2: tell this story because I think you're going to see
- 19:56Speaker 2: a very similar story for the major consulting companies and
- 19:58Speaker 2: artificial intelligence. Right now, it's a great time for a
- 20:01Speaker 2: lot of the consultancies. But I think you're going to
- 20:03Speaker 2: see two things. I think one, clients are going to say,
- 20:07Speaker 2: we actually don't need a consultancy. There's a lot more
- 20:09Speaker 2: that we're now capable of doing ourselves. A number two,
- 20:13Speaker 2: we have hollowed out the consultancies will say a lot
- 20:16Speaker 2: of our capabilities. So we've got a generation of leaders
- 20:19Speaker 2: that can go and provide eye to eye advice to
- 20:22Speaker 2: top senior leaders and have great judgment and so on.
- 20:25Speaker 2: But the efficiency gains that we got mean that we
- 20:27Speaker 2: don't have another generation that comes after it. I think
- 20:30Speaker 2: we're going to see both those things happen over the
- 20:32Speaker 2: course of the next five to ten years.
- 20:34Speaker 3: If I were in the field now, I.
- 20:36Speaker 2: Would be doing all the things that I think smart
- 20:38Speaker 2: people are doing, which is show up to client meetings,
- 20:41Speaker 2: being even smarter, have teams work even faster, have multiple
- 20:44Speaker 2: possibilities being considered in ways that you couldn't do before,
- 20:48Speaker 2: really live up to the full possibility what you can do.
- 20:51Speaker 2: I was at a small company, but now a small
- 20:54Speaker 2: company can look like a big company because you have
- 20:56Speaker 2: all these tools you can take advantage of. That's if
- 20:59Speaker 2: I was still at that company. The thing I also
- 21:01Speaker 2: would be thinking really hard about is is.
- 21:03Speaker 3: This the right model?
- 21:04Speaker 2: You know, in a site, like many people in consultancy
- 21:07Speaker 2: got a traditional pyramid model, and people are beginning to say, well,
- 21:11Speaker 2: maybe it's diamonds where you've got you know, a few people.
- 21:15Speaker 2: Maybe it's something that is an inverted pyramid where actually
- 21:18Speaker 2: you have more people at the top who are the
- 21:21Speaker 2: good judgment people that can advise senior clients, and they
- 21:24Speaker 2: don't need to have the people who are doing all
- 21:26Speaker 2: the work at the bottom. I don't know the answer
- 21:28Speaker 2: to that, but I certainly would be thinking really hard
- 21:31Speaker 2: about the new models that are going to be emerging.
- 21:33Speaker 1: If you were still working with junior consultants, how would
- 21:37Speaker 1: you be teaching them to think critically?
- 21:40Speaker 2: AI essentially is your new teammate, your new intern, whatever
- 21:44Speaker 2: metaphor you want to use. It's got amazing superpowers. Sometimes
- 21:48Speaker 2: it does some really weird things like make stuff up
- 21:51Speaker 2: or dramatically underperform some things you think it's going to
- 21:54Speaker 2: be good at. The way you figure these things out
- 21:56Speaker 2: is by working very closely with it, never ever outsourced
- 22:00Speaker 2: to it, and recognize life is better in teams and
- 22:03Speaker 2: research shows life is actually sociologically better with AI, as
- 22:07Speaker 2: long as you don't do too much with it and
- 22:09Speaker 2: now source too much to it. But make sure that
- 22:11Speaker 2: you are pushing and using it to augment versus replacing,
- 22:16Speaker 2: because that will be a very short sighted and destructive path.
- 22:19Speaker 2: I mentioned Bobby Hansen before. In his book Leaders Make
- 22:22Speaker 2: the Future that the third edition, he said, you know,
- 22:24Speaker 2: one of the most important things that a future has
- 22:27Speaker 2: to do is be very precise on language, because the
- 22:30Speaker 2: right language will pull you somewhere, the wrong language will
- 22:33Speaker 2: push you away from And he writes in his fifty
- 22:36Speaker 2: years doing this. Artificial intelligence is the worst name for
- 22:39Speaker 2: a new technology he has ever seen, because artificial makes
- 22:43Speaker 2: it sound like it's replaceative, and what you really want
- 22:45Speaker 2: is augmented, where it is something that allows you to
- 22:48Speaker 2: stretch and push and develop further, and that is the
- 22:50Speaker 2: thing I would really be pushing among the young talent
- 22:54Speaker 2: at the organization.
- 22:55Speaker 3: Don't stop thinking. Once you stop thinking, it's kind of over.
- 22:58Speaker 1: If you're finding this conversation with Scott Anthony as helpful
- 23:01Speaker 1: as I am, stay with us because in the second half,
- 23:05Speaker 1: Scott reveals why he has started thinking about his life
- 23:08Speaker 1: in five year cycles, and also his advice for improving
- 23:12Speaker 1: your ability to think critically in the age of AI.
- 23:19Speaker 1: If you're looking for more tips to improve the way
- 23:22Speaker 1: you work can live. I write a short weekly newsletter
- 23:25Speaker 1: that contains tactics I've discovered that have helped me personally.
- 23:29Speaker 1: You can sign up for that at Amantha dot com.
- 23:32Speaker 1: That's Amantha dot com. How would you be approaching recruitment
- 23:42Speaker 1: because I feel like I'm seeing a lot of companies
- 23:44Speaker 1: really struggle with this, particularly in those early stages where
- 23:48Speaker 1: you're not having those in depth interviews face to face
- 23:52Speaker 1: because I mean even virtual interviews these days, you know,
- 23:55Speaker 1: I hear all sorts of stories about an AI going
- 23:58Speaker 1: on in the background and putting out answers to questions
- 24:02Speaker 1: that people are being asked. What would you do to
- 24:05Speaker 1: test the ability of someone to think? In this day
- 24:08Speaker 1: and age.
- 24:08Speaker 2: What I would wish for is a way to be
- 24:11Speaker 2: in a physical location with someone and have a conversation
- 24:14Speaker 2: with them. I think, just the ability to actually have
- 24:17Speaker 2: a conversation with somebody and not ask how many taxi
- 24:21Speaker 2: cabs are there in New York City or whatever, but
- 24:24Speaker 2: just see the way that they approach issues. The approach
- 24:27Speaker 2: I followed what I was interviewing in a sight is
- 24:29Speaker 2: I said, would give people here are ten disruptions that
- 24:33Speaker 2: are in process right now, or ten companies that have
- 24:35Speaker 2: been called disruptive. Pick any one of them and come
- 24:38Speaker 2: up with a point of view, are they actually disruptive?
- 24:41Speaker 2: And if you were caught in a lift with the CEO,
- 24:43Speaker 2: what would you say to them? And I did that
- 24:46Speaker 2: for two reasons.
- 24:47Speaker 3: One, I want to.
- 24:47Speaker 2: See what they did with it, and then two, once
- 24:49Speaker 2: we're in a room together that I can push them
- 24:51Speaker 2: and they've had the benefit of being able to think
- 24:53Speaker 2: about it for some period of time.
- 24:55Speaker 3: And we'd have fun.
- 24:57Speaker 1: You know.
- 24:57Speaker 2: Sometimes people would go and produce a PowerPoint tech. I
- 24:59Speaker 2: didn't ask them to do that, but sometimes people would.
- 25:01Speaker 2: Sometimes I get a Microsoft word memos. Sometimes people would
- 25:04Speaker 2: just talk. But it was a really good way just
- 25:06Speaker 2: to get into a conversation where you could see how
- 25:08Speaker 2: someone thinks. I don't know a better way to do it,
- 25:11Speaker 2: you know, I mean you could say psychometric tests or whatever, perhaps,
- 25:15Speaker 2: but you know, I mean, as we know, anything can
- 25:17Speaker 2: be gamed these days.
- 25:18Speaker 3: It's not easy.
- 25:19Speaker 1: We talked about critical thinking. I want to talk about
- 25:22Speaker 1: good judgment. How do you help your students develop the
- 25:26Speaker 1: ability to have good judgment? I feel like, and maybe
- 25:29Speaker 1: this is a flawed assumption, but the longer you do something,
- 25:32Speaker 1: the more experience you develop. Generally your judgment becomes better
- 25:37Speaker 1: and better because it's the collection of all the different
- 25:40Speaker 1: experiences that you've had. But how do you think about
- 25:44Speaker 1: the ability to have good judgment and to improve that ability?
- 25:48Speaker 2: I would like to think that experience makes you better
- 25:51Speaker 2: at having judgment, but I think at least some research
- 25:54Speaker 2: and data would suggest you get some real blind spots.
- 25:57Speaker 3: Is you're used to.
- 25:59Speaker 2: Defaulting to certain things and if the situation changes. And
- 26:02Speaker 2: with that, what I really try to do is I
- 26:05Speaker 2: try to essentially give students heuristics and say, what you're
- 26:08Speaker 2: going to do or what you're going to get are
- 26:11Speaker 2: rules of thumbs, mental models, way to think through things
- 26:15Speaker 2: that essentially can help you. So it's not that you
- 26:17Speaker 2: as an individual have judgment. It's you've got a tool
- 26:21Speaker 2: that you can use, and what you have to figure
- 26:22Speaker 2: out is what is the right tool to use in
- 26:25Speaker 2: a context. And this is the thing that I learned
- 26:28Speaker 2: from Clay Christiansen. You know, he used to joke that
- 26:30Speaker 2: his wife Christine would say the famous disruptive line diagram
- 26:34Speaker 2: that's in all of his stuff, it was etched onto
- 26:36Speaker 2: his glasses. Everywhere he looked, he saw disruption. I wear
- 26:39Speaker 2: contact lenses, so the models are like fused under my eyes,
- 26:43Speaker 2: so you know, everywhere I look, I see it. And
- 26:45Speaker 2: that's sometimes maybe a tiny bit of a curse, but
- 26:48Speaker 2: what it really is is a blessing. It allows you
- 26:50Speaker 2: to see things that you wouldn't otherwise see. And whenever
- 26:53Speaker 2: someone asks Clay what's your opinion or your viewpoint about
- 26:56Speaker 2: extra y, Clay would say, I've got no viewpoints or opinions.
- 26:59Speaker 2: The model has a viewpoint, and he was such a
- 27:02Speaker 2: good social scientist. When that didn't happen, he'd say, oh, great,
- 27:05Speaker 2: we found an anomaly, something that didn't fit.
- 27:07Speaker 3: Therefore the bottle must be wrong in some way. Let's upgrade.
- 27:11Speaker 2: The vision of our school is to develop wise, decisive
- 27:13Speaker 2: leaders that better the world through business. A wise leader,
- 27:17Speaker 2: in my view, is one who has a whole range
- 27:19Speaker 2: of tools that they can use and knows when to
- 27:22Speaker 2: use them and how to use them.
- 27:24Speaker 1: I love that, and I guess the follow one question
- 27:27Speaker 1: from that, like, when you yourself are looking at creating a
- 27:31Speaker 1: new model or a framework with which to view the world,
- 27:35Speaker 1: what role does AI play in helping augment your thinking
- 27:40Speaker 1: or does it not play a role there?
- 27:42Speaker 2: I have an idea that's been bouncing around the back
- 27:45Speaker 2: of my head for a few years now, and this
- 27:47Speaker 2: is what does it really take to be a leader
- 27:50Speaker 2: that can successfully navigate today's world of radical uncertainty? A brand,
- 27:55Speaker 2: the idea, adaptive capacity. And the idea basically is you
- 27:58Speaker 2: need three things. You need metacognition, which means you think
- 28:02Speaker 2: about how you think and have lots.
- 28:03Speaker 3: Of models at your disposal.
- 28:05Speaker 2: You need equanimity, the ability to pause so you don't
- 28:08Speaker 2: get overwhelmed with all these models that you have in
- 28:10Speaker 2: your head at a paradox mindset that allows you to
- 28:13Speaker 2: take perceive tensions and turn them into possibilities. As I've
- 28:17Speaker 2: been advancing my thinking about this, AI number one has
- 28:20Speaker 2: been a research partner, so use some of the emerging
- 28:23Speaker 2: research capabilities to say that idea about.
- 28:26Speaker 3: There not being anything like this, is that true?
- 28:29Speaker 2: What else do you see out there? What research you
- 28:31Speaker 2: see blah blah blah blah blah. So a research partner.
- 28:34Speaker 2: Number two an experiment designer. So I have been trying
- 28:37Speaker 2: to think about ways to actually go and test this, validated, etc.
- 28:41Speaker 3: So this will be the sort of thing where I
- 28:43Speaker 3: will idly go and brainstorm. I was thinking about this,
- 28:45Speaker 3: what do you think, etc. Etc. I have a thought
- 28:48Speaker 3: about doing synthetic research.
- 28:50Speaker 2: I've not done that, but I thought it would be
- 28:51Speaker 2: really cool if you were to actually use AI to
- 28:54Speaker 2: create a simulation to go in test hypotheses. That is
- 28:57Speaker 2: beyond my current capabilities, but something that is on the
- 29:00Speaker 2: list of things to continue to push. Barring from slow
- 29:03Speaker 2: productivity from caw Newport, I work on a five year
- 29:06Speaker 2: timeline for some of these things. So I want to
- 29:08Speaker 2: crack this in the next now four years, since I
- 29:10Speaker 2: set that a year ago, so I'm okay with not
- 29:12Speaker 2: having synthetic research yet, but that's an area that I'm
- 29:15Speaker 2: watching to see if that's something that you actually can't
- 29:18Speaker 2: do with any materiality.
- 29:19Speaker 1: Tell me more about this five year cycle. I'm curious.
- 29:23Speaker 1: I did not know that about you.
- 29:24Speaker 2: So caw Newport, who I know. You're a fan of
- 29:28Speaker 2: his book Slow Productivity. I was one of the best
- 29:30Speaker 2: books I read a couple of years ago, and he
- 29:33Speaker 2: had this idea, you know, slow down, slow down. Don't
- 29:35Speaker 2: think necessarily about what you're doing over the next week, month,
- 29:39Speaker 2: or quarter, but really think about what are your aspirations
- 29:42Speaker 2: over a five year time period. As they said, when
- 29:44Speaker 2: you relax the timeline, you're able to just handle things
- 29:47Speaker 2: moving at different paces. So when I did this a
- 29:50Speaker 2: year ago, I said three things that I would like
- 29:53Speaker 2: to do professionally over the next five years. One, I
- 29:56Speaker 2: want to crack this adaptive capacity idea. Two, I want
- 30:00Speaker 2: to do something I've never done before, which is have
- 30:02Speaker 2: my name on a peer reviewed academic article, not the
- 30:05Speaker 2: lead author, but I can be the tenth author. That's fine.
- 30:08Speaker 2: And number three, I'd really like to win a teaching award.
- 30:11Speaker 2: I just validate and demonstrate that I improved my ability
- 30:14Speaker 2: to teach in class.
- 30:15Speaker 3: So those are the three things I'm saying this on
- 30:19Speaker 3: am I allowed to say the date clus you are
- 30:21Speaker 3: July fourteen, twenty.
- 30:22Speaker 2: Twenty five, so we can time capsule and check in
- 30:24Speaker 2: on this four years from now.
- 30:26Speaker 1: Oh wow, I love that. What are some other habits
- 30:29Speaker 1: or rituals or things that you're you've been playing around
- 30:32Speaker 1: with around how you do work? Like? I love the
- 30:35Speaker 1: five year thing, and I always feel like you're someone
- 30:37Speaker 1: that's experimenting with different ways of working and augmenting your productivity.
- 30:42Speaker 3: I'll call this one Can I watch? And can I watch?
- 30:45Speaker 1: Is?
- 30:46Speaker 2: I started teaching three years ago and the school that
- 30:49Speaker 2: I teach at is blessed with a number of really,
- 30:52Speaker 2: really world class teachers. So I've made a regular habit
- 30:55Speaker 2: whenever I'm in a teaching cycle, which tends to be
- 30:58Speaker 2: about a five week cycle, I try to go and
- 31:01Speaker 2: observe at least one and hopefully two other faculty, usually
- 31:04Speaker 2: ones that my students recommend, you know, just who's really
- 31:07Speaker 2: great at running a class. And in those can I
- 31:10Speaker 2: watch moments. I don't care at all about the content.
- 31:12Speaker 2: I'm not going there to learn, you know, what this
- 31:14Speaker 2: teacher is teaching about this topic.
- 31:17Speaker 3: I'm just absorbing the way that they're running.
- 31:19Speaker 2: The room, what the students are doing, who's locked in,
- 31:22Speaker 2: who's not locked in, how they're using their physicality, blah
- 31:26Speaker 2: blah blah blah blah, and just trying to get a
- 31:27Speaker 2: sense as to what it takes to really really command
- 31:31Speaker 2: a room of sixty plus very smart NBA students who
- 31:35Speaker 2: again are blessed with a lot of really great teachers.
- 31:38Speaker 2: And I'm sure some of the things they're teaching are
- 31:40Speaker 2: getting into my unconscious as well. But that idea of
- 31:43Speaker 2: being very purposeful in getting stimuli that's different from normal stimuli,
- 31:48Speaker 2: that has been something that has.
- 31:49Speaker 3: Been one of the more rewarding.
- 31:51Speaker 2: Routines I've had in the last few years. And I've
- 31:53Speaker 2: made some new friends from doing it too, which is
- 31:55Speaker 2: always nice.
- 31:57Speaker 1: I love that. Tell me, what are a couple of
- 31:58Speaker 1: things that you've larn from you? Can I watch sessions?
- 32:02Speaker 2: Is one Joseph Garaco, who teaches in the accounting unit
- 32:06Speaker 2: at talk. I said in one of his sessions, and
- 32:08Speaker 2: you know, I thought, and Joseph, if you're watching this,
- 32:11Speaker 2: I hope you take it in good spirit. I thought
- 32:13Speaker 2: it was going to be the most boring session ever.
- 32:14Speaker 2: I mean, he'd want a teaching a ward, but I'm like,
- 32:16Speaker 2: it's accounting.
- 32:17Speaker 3: You know. Even though my.
- 32:18Speaker 2: Grandfather was an accounting teacher, he was not known for
- 32:21Speaker 2: being dynamic. But the thing that Joseph really showed me
- 32:24Speaker 2: is you can find real moments of inspiration by letting
- 32:29Speaker 2: students really go and dwell on seemingly small things. And
- 32:33Speaker 2: what he was really great at doing is opening his
- 32:35Speaker 2: session with what seemed like a really simple question, but
- 32:40Speaker 2: one that just expanded into an hour of really good
- 32:43Speaker 2: discussion where he also could teach about how working capital
- 32:46Speaker 2: works and all that. So the thing I learned from
- 32:48Speaker 2: Joseph is the power of a very very well thought
- 32:52Speaker 2: through opening question when you're in a good class discussion.
- 32:57Speaker 2: Then I sat in the class that Paul Argenti, who
- 32:59Speaker 2: tea in communication and a couple other fields, it talk
- 33:03Speaker 2: a couple months ago, and I noticed he just had
- 33:07Speaker 2: this theme where he was talking about corporate activism and
- 33:11Speaker 2: he used pretty evocative language that I won't repeat to
- 33:14Speaker 2: not get him in trouble, but I just really got
- 33:17Speaker 2: the room. It's like the room like all devices went down.
- 33:20Speaker 2: Everyone was on him and like, how rehearse was that?
- 33:22Speaker 2: He said, I've been doing this for thirty years. It's
- 33:24Speaker 2: just like not quite a scriptive performance, but you know,
- 33:28Speaker 2: just really a way to pull people in. So this
- 33:30Speaker 2: idea that you are, to some degree, for better or worse,
- 33:33Speaker 2: when you're teaching a class, you're a performer, and you
- 33:35Speaker 2: want to think about how you're going to use what
- 33:37Speaker 2: great performers do is the thing I picked up from him.
- 33:40Speaker 2: So great questions and think about, of course teaching, but
- 33:44Speaker 2: a little bit of performance mixed in. Those are a
- 33:47Speaker 2: couple of things I've picked up.
- 33:48Speaker 1: I love that well, Scott. It's just like it's always
- 33:50Speaker 1: just such a joy to talk. Whether it's on Mike
- 33:54Speaker 1: or off Mike. I always feel like I learn so
- 33:57Speaker 1: many new things and I just love your way of thinking.
- 34:00Speaker 1: Thank you so much for extending your workday on the
- 34:03Speaker 1: East Coast to have this chat with.
- 34:05Speaker 3: Me, Namantha.
- 34:06Speaker 2: It is always a pleasure, and thank you for starting
- 34:08Speaker 2: your workday early in Melbourne to have this chat with
- 34:11Speaker 2: me very much.
- 34:11Speaker 3: Appreciate it. As always.
- 34:14Speaker 1: I hope you enjoyed this chat with Scott Anthony. For me,
- 34:18Speaker 1: the biggest takeaway is this AI is an incredible partner,
- 34:22Speaker 1: but it should never replace the discomfort of thinking for yourself.
- 34:27Speaker 1: And if this episode gave you a new way to
- 34:29Speaker 1: think about your own work, please share it with a
- 34:31Speaker 1: friend or a colleague and make sure to follow How
- 34:34Speaker 1: I Work so you don't miss future conversations like this.
- 34:37Speaker 1: Thank you so much for listening, and here's to working
- 34:39Speaker 1: smarter with our brains fully switched on. If you like
- 34:44Speaker 1: today's Joe, make sure you g'd follow on your podcast
- 34:47Speaker 1: app to be alerted when new episodes drop. How I
- 34:51Speaker 1: Work was recorded on the traditional land of the Warrangery People,
- 34:54Speaker 1: part of the Cooler Nation.