Latest / Azadeh and Guy on AI / AI Skeptics or Cautious Critics?
Transcript
- 0:01SPEAKER_01: Hi and welcome to Azaveh and Guy on AI.
- 0:06And today we're talking about AI resistance mostly because it's
- 0:09been in the news.
- 0:10We've had students booing people talking about AI in graduation
- 0:15ceremonies.
- 0:16We know for a fact from surveys around the United States that
- 0:21Pew is starting to
- 0:24conduct some surveys and other outfits that are really looking
- 0:28at the resistance to
- 0:29SPEAKER_01: AI across the US population.
- 0:32SPEAKER_01: And it seems like resistance is fairly high,
- 0:34SPEAKER_01: about 70% are resisting AI and more specifically resisting data centers.
- 0:39SPEAKER_01: So it seems like there's a lot of emphasis there.
- 0:43SPEAKER_01: Because data centers, I think, is one of those things you can seek.
- 0:47SPEAKER_01: You can see it come up.
- 0:49SPEAKER_01: You can see it built.
- 0:50SPEAKER_01: You can imagine the water and the energy use and other things.
- 0:54And so that's a very physical manifestation of something that
- 0:59is really hard to see.
- 1:00And I was thinking about that Tom Cruise movie where he's
- 1:03fighting AI,
- 1:03right?
- 1:06SPEAKER_01: The fact that in the movie, you have to give AI a face.
- 1:11SPEAKER_01: You got to make it a thing that has a physical reality.
- 1:16SPEAKER_01: Because it's really hard for us to imagine this.
- 1:18SPEAKER_01: It's just like the conversations for years.
- 1:20SPEAKER_01: It's like,
- 1:21SPEAKER_01: It's in the cloud.
- 1:22SPEAKER_01: Well, where is that cloud?
- 1:24SPEAKER_01: It's a data center.
- 1:25And now we call it data centers,
- 1:27but for a long time we called it the cloud.
- 1:29SPEAKER_01: That was very clever marketing,
- 1:31SPEAKER_01: by the way,
- 1:32SPEAKER_01: because the cloud sounds like,
- 1:33SPEAKER_01: oh,
- 1:33SPEAKER_01: it's somewhere else and it's flying above and it's white and fluffy,
- 1:37not it's taking water and energy and it's really a place with a
- 1:42lot of machines and
- 1:43SPEAKER_01: very few workers.
- 1:44SPEAKER_01: They never said that.
- 1:47SPEAKER_01: They should have called it the Cloud AI.
- 1:49SPEAKER_01: We're building clouds in your neighborhood.
- 1:51SPEAKER_01: It's fine.
- 1:53SPEAKER_00: And we are recording the first episode of Season 3.
- 1:57SPEAKER_01: Yes, welcome to Season 3.
- 1:59SPEAKER_01: It is summer here in Nebraska.
- 2:02SPEAKER_01: Some days are very hot and humid, and some days are kind of cool.
- 2:06SPEAKER_00: Super cool.
- 2:07SPEAKER_01: Oh, and I have a flooded basement, so everything is perfect.
- 2:13SPEAKER_01: All right.
- 2:14SPEAKER_01: So, we collected some studies and let's talk about some of the findings.
- 2:22SPEAKER_00: So,
- 2:23SPEAKER_00: the title of the first study that you're going to talk about,
- 2:26SPEAKER_00: and this study has been published in 2026,
- 2:28SPEAKER_00: so very,
- 2:30SPEAKER_00: very recent.
- 2:31Understanding Higher Education Students' Reluctance to Adopt
- 2:35Gennarii in Learning
- 2:36SPEAKER_00: in Latvia,
- 2:37SPEAKER_00: and it's been published
- 2:42SPEAKER_00: I'm not sure if I'm very good at pronouncing the author's names.
- 2:47SPEAKER_00: So I'm not going to do that.
- 2:48SPEAKER_00: And we can always put a link in our description.
- 2:51SPEAKER_01: Yeah, we'll put a link with the DOI.
- 2:54SPEAKER_01: So that's a live link that connects you to what it actually says.
- 2:57And it's about the title is Understanding Higher Education
- 3:00Students Reluct
- 3:02SPEAKER_01: And we're talking about hundreds of students,
- 3:08SPEAKER_01: so 200 students in Latvia and 685 in the Ukraine,
- 3:14SPEAKER_01: which just says it's a reasonably large sample.
- 3:19SPEAKER_01: It's not a very small sample.
- 3:23SPEAKER_01: And so from all of them,
- 3:28What we've learned is that about 22% of students reported not
- 3:36using GenAI at all.
- 3:38SPEAKER_01: Of course, this is with a caveat.
- 3:40SPEAKER_01: In 2026,
- 3:41SPEAKER_01: we're all using AI because if you're doing a Google search,
- 3:43SPEAKER_01: the AI is in the background.
- 3:44SPEAKER_01: So you're not...
- 3:46SPEAKER_00: It's incorporated into almost everything.
- 3:49SPEAKER_01: Yeah.
- 3:50And that's something that we have to keep in mind,
- 3:53but they're not at least
- 3:55SPEAKER_01: Stavros Stavros Stavros
- 4:00SPEAKER_01: Guy Trainin guytrainin522619 Guy Trainin guytrainin522619
- 4:31What is interesting is that there doesn't seem to be in the
- 4:35study a lot of ethical
- 4:36SPEAKER_01: resistance to AI.
- 4:38SPEAKER_00: Yeah, that's true.
- 4:40SPEAKER_00: One more thing, the majority of the participants are bachelor's students.
- 4:45SPEAKER_01: Yeah,
- 4:45SPEAKER_01: so it's a nice distribution,
- 4:47but what they're saying really is the top three reason for
- 4:50non-adaption was they
- 4:52SPEAKER_01: don't believe it works.
- 4:54SPEAKER_01: And that's almost half of the people that talked about this said,
- 4:59SPEAKER_01: It doesn't give me what I need.
- 5:01SPEAKER_01: It's not doing the quality work.
- 5:05SPEAKER_01: It has hallucinations.
- 5:06SPEAKER_01: All of these things.
- 5:07SPEAKER_00: I can do it better myself.
- 5:09SPEAKER_00: I believe in my own work.
- 5:10SPEAKER_00: I don't trust AI that much.
- 5:12SPEAKER_00: The second reason was insufficient information about tools.
- 5:16SPEAKER_00: And we have seen that a lot in our classes,
- 5:19SPEAKER_00: in interviews that we conducted,
- 5:20SPEAKER_00: in our research projects.
- 5:21Many people do not have enough idea,
- 5:24enough knowledge about how different AI tools work.
- 5:28SPEAKER_01: And the last one is the lack of knowledge.
- 5:30SPEAKER_01: So the idea is,
- 5:31SPEAKER_01: I know I can chat with it,
- 5:33SPEAKER_01: but I'm not sure how to get out of it,
- 5:35SPEAKER_01: what I need to get out of it,
- 5:36SPEAKER_01: which is,
- 5:37SPEAKER_01: again,
- 5:37SPEAKER_01: very reasonable.
- 5:39SPEAKER_01: We've seen this all along.
- 5:40I'm always surprised,
- 5:41for example,
- 5:42when students say they don't know what Notebook LM is.
- 5:46And then I remember that not everybody is living,
- 5:48breathing AI all the time.
- 5:49SPEAKER_01: So it's got to be okay.
- 5:53SPEAKER_01: Of course,
- 5:54SPEAKER_01: A in all of these studies,
- 5:56they also looked at student majors as a way to see if there's a
- 6:00difference between
- 6:02SPEAKER_01: different populations.
- 6:03SPEAKER_01: And what we always see is that
- 6:08SPEAKER_01: Computer science students are much more likely to use AI,
- 6:12partially because AI starts and is most helpful right now in
- 6:18computer science.
- 6:19SPEAKER_01: Also,
- 6:20SPEAKER_01: and we've talked about this before when we talked about computer science,
- 6:23SPEAKER_01: they've been using it a lot longer.
- 6:26SPEAKER_01: So Gen AI has shown up for us fairly recently,
- 6:29SPEAKER_01: but in computer science for 10 to 10,
- 6:33SPEAKER_01: 15 years,
- 6:34SPEAKER_01: they've been using different versions,
- 6:36SPEAKER_01: earlier versions of AI.
- 6:39So the key implication of that study is that resistance is
- 6:43largely driven by
- 6:45SPEAKER_00: knowledge gaps and perceived irrelevance,
- 6:48SPEAKER_00: not by ethical rejection.
- 6:51SPEAKER_00: That was kind of surprising for me to be honest.
- 6:53SPEAKER_01: Yeah,
- 6:53SPEAKER_01: because we're,
- 6:54SPEAKER_01: again,
- 6:55SPEAKER_01: that's why I wanted to make that split,
- 6:56SPEAKER_01: because in the United States,
- 6:58SPEAKER_01: I think that the ethical considerations are considerably higher.
- 7:02SPEAKER_01: In other countries, that doesn't seem to be as burning.
- 7:05SPEAKER_01: But also,
- 7:06SPEAKER_01: we have to be honest,
- 7:07they are not having the same number of data centers emerging
- 7:12next to them.
- 7:13SPEAKER_01: So they are a little less concerned from that perspective.
- 7:18SPEAKER_01: But it's also very much a different conversation.
- 7:22SPEAKER_01: So I can, for example, talk about Estonia when I was there.
- 7:26SPEAKER_01: about a year and a half ago,
- 7:28SPEAKER_01: they seem to be awfully excited about AI,
- 7:31SPEAKER_01: at least at that point in time.
- 7:32SPEAKER_01: I don't know if it has changed.
- 7:34SPEAKER_01: It's a country that's embracing technology, embracing moving forward.
- 7:37SPEAKER_01: I know that I've been to Singapore, and that's very much the same.
- 7:42SPEAKER_01: It seems like a national goal to be fully embedded in AI,
- 7:48SPEAKER_01: thinking about how we can benefit from that.
- 7:50SPEAKER_01: So different countries react differently, and I think that creates a mood
- 7:54In which it creates and the United States is the place where
- 7:58we're seeing also the
- 7:59most a doom around jobs so if you're thinking about college
- 8:03students they're
- 8:03thinking about I'm going to finish university and I'm going to
- 8:06go out to the job
- 8:07market and AI is going to steal my job obviously you're going
- 8:10to have a negative
- 8:10SPEAKER_01: reaction to that
- 8:14SPEAKER_01: All right, so what's the second study?
- 8:15Second paper,
- 8:16the title of the paper is AI Advocates and Cautious Critics.
- 8:20SPEAKER_00: How AI Attitudes,
- 8:22SPEAKER_00: AI Interest,
- 8:23Use of AI and AI Literacy Builds University Students' AI as
- 8:28Self-Efficacy.
- 8:29It's been published in Computers and Education and Artificial
- 8:32Intelligence Journal.
- 8:34SPEAKER_01: Which is a journal we love.
- 8:35SPEAKER_00: Yeah, yeah, absolutely.
- 8:37SPEAKER_01: Just saying.
- 8:37SPEAKER_00: Yes.
- 8:39SPEAKER_00: And it's again another survey study.
- 8:43They have about 1500 undergraduate and graduate students from
- 8:48the United States,
- 8:49SPEAKER_00: the United Kingdom and also Germany.
- 8:53SPEAKER_01: And they measured a whole variety of things.
- 8:55So they looked at AI self-efficacy,
- 8:57AI literacy,
- 8:58interest in AI and the attitudes and AI use.
- 9:01SPEAKER_01: So they're kind of trying to get a full picture there.
- 9:05SPEAKER_00: So when it comes to the findings of the study,
- 9:09SPEAKER_00: they have figured out that they can have two major student typologies.
- 9:14SPEAKER_00: One of them is AI advocates,
- 9:16SPEAKER_00: those students who have high AI literacy,
- 9:20SPEAKER_00: self-efficacy,
- 9:21SPEAKER_00: interests,
- 9:22SPEAKER_00: and positive attitudes,
- 9:24SPEAKER_00: and obviously high usage of AI,
- 9:26SPEAKER_00: and also cautious critics.
- 9:29which are 21% of the sample with below average AI literacy and
- 9:35self-efficacy,
- 9:37SPEAKER_00: high negative attitudes and low usage.
- 9:40SPEAKER_01: So they're kind of low on everything or except negative attitude,
- 9:45SPEAKER_01: which is again,
- 9:46SPEAKER_01: low on everything.
- 9:47SPEAKER_01: And what's interesting about the cautious critics,
- 9:53SPEAKER_01: just like in the last study,
- 9:56SPEAKER_01: they are not distributed equally across the population.
- 9:59SPEAKER_01: So they tend to be much more from the humanities and social sciences.
- 10:03SPEAKER_01: And they tend to be
- 10:06SPEAKER_01: Guy’s Substack Guy Trainin
- 10:30Another interesting study that adds a different perspective
- 10:33from a different place,
- 10:34SPEAKER_01: although showing the same kind of concern.
- 10:40SPEAKER_00: So let me see.
- 10:42The other study that we went through is to adopt or to ban the
- 10:47student perceptions
- 10:48SPEAKER_00: and use of generative AI in higher education.
- 10:51SPEAKER_00: It's been published in Humanities and Social Sciences Communications.
- 10:57SPEAKER_00: They again, they have done an online survey.
- 11:01SPEAKER_00: Obviously the survey had a bunch of closed and also open-ended questions.
- 11:07SPEAKER_01: And this is in Italy, which is, again, a little bit different.
- 11:12The key findings were that about 82% of students really had
- 11:16reservation about the
- 11:17SPEAKER_01: accuracy of AI outputs.
- 11:19SPEAKER_01: So that really reflects the same study from Latvia and Ukraine,
- 11:25SPEAKER_01: although the numbers are much,
- 11:26SPEAKER_01: much higher.
- 11:27SPEAKER_01: And it may be connected to the language we're working in.
- 11:30So I am guessing that the Ukrainian and Latvian students are
- 11:33mostly interacting in
- 11:34SPEAKER_01: English and that Italian students may be trying to interact in Italian.
- 11:38And we know that the best outputs are still in English because
- 11:42just the learning
- 11:43SPEAKER_01: corpus was much larger.
- 11:45SPEAKER_00: 63.3% read that chat GPT output could be mistaken for human written text.
- 11:57SPEAKER_00: Yeah,
- 12:00SPEAKER_01: so that's really interesting because on one hand,
- 12:04SPEAKER_01: 82% saying that they're worried about accuracy,
- 12:10SPEAKER_01: but they're also saying it's indistinguishable.
- 12:13SPEAKER_01: Maybe it's because people make mistakes too.
- 12:16SPEAKER_01: That's probably it.
- 12:18And we can see a similar result with the other study that we
- 12:22just went through.
- 12:23SPEAKER_00: So there is a gender disparity.
- 12:26Male students were significantly more likely to engage with
- 12:30GenAI tools than female
- 12:31SPEAKER_00: students,
- 12:32SPEAKER_00: just like the other study that we just talked about.
- 12:35SPEAKER_01: So,
- 12:36and the difference here is that ethical concerns were
- 12:40considerably higher than in
- 12:42SPEAKER_01: the other studies.
- 12:43So here we're starting to see some ethical concerns about
- 12:47generative AI,
- 12:48and this is
- 12:50SPEAKER_01: And this is really interesting because this was published in November 25,
- 12:54SPEAKER_01: which means that the data is either from early 25 or even from 2024.
- 12:57SPEAKER_01: And that leads to a different judgment.
- 13:02It seems like the public opinion moves quite fast on this
- 13:05because this is so new.
- 13:06SPEAKER_01: So it could be that this has changed.
- 13:08SPEAKER_01: The second thing is,
- 13:09SPEAKER_01: and I think that's important,
- 13:10SPEAKER_01: that the accuracy,
- 13:11SPEAKER_01: if you think about where we were in 2024 versus where we are now,
- 13:16SPEAKER_01: accuracy has also changed.
- 13:18So it could be that their worries about the accuracy would be
- 13:21somewhat diminished right now.
- 13:24SPEAKER_01: And so do we want to talk about another study?
- 13:30SPEAKER_00: Let me see.
- 13:34SPEAKER_01: Okay, let's talk about another study.
- 13:37So the title of this study is Artificial Intelligence in Higher
- 13:40Education,
- 13:41SPEAKER_00: Student Perspectives on Practices,
- 13:43SPEAKER_00: Challenges,
- 13:44SPEAKER_00: and Policies in a Transitional Context.
- 13:48SPEAKER_00: It's been published in Frontiers in Education.
- 13:51SPEAKER_01: And if you,
- 13:52SPEAKER_01: just as a word,
- 13:54SPEAKER_01: if you'll notice,
- 13:55SPEAKER_01: a lot of these publications are publications that are open source,
- 14:01SPEAKER_01: so you can find those and there's no paywall.
- 14:04SPEAKER_01: But it's also because many of these open source
- 14:08SPEAKER_01: publications tend to do very fast reviews, which is helpful.
- 14:13So it makes you a little bit question how fast can you get the
- 14:16data out there.
- 14:17SPEAKER_01: But in the age of AI,
- 14:18SPEAKER_01: and we've talked about this,
- 14:19SPEAKER_01: we need to get research out there in a quick way.
- 14:23And you don't want to talk about what happened in 2021 right
- 14:28now because it seems
- 14:29SPEAKER_01: highly irrelevant.
- 14:30SPEAKER_01: So the ability to publish fast is important.
- 14:32SPEAKER_01: And that's why we went for these studies specifically.
- 14:36SPEAKER_01: So what did they find?
- 14:37SPEAKER_00: So students who have taken a course,
- 14:40SPEAKER_00: AI course,
- 14:42SPEAKER_00: they report a significantly higher frequency of AI use,
- 14:45SPEAKER_00: which is not obviously surprising.
- 14:48It seems that there is a positive correlation between AI
- 14:52literacy and also AI usage.
- 14:55And the students who lack AI training reported a very strong
- 14:58correlation with
- 14:59SPEAKER_00: difficulties using AI.
- 15:02SPEAKER_01: And that's interesting.
- 15:04SPEAKER_01: This is something we've seen in my class,
- 15:06SPEAKER_01: for example,
- 15:07SPEAKER_01: when we tried AI,
- 15:08and that is initially AI seems very simple because the window
- 15:12in the wisdom that
- 15:13SPEAKER_01: started with OpenAI,
- 15:15SPEAKER_01: it's a box just like a search.
- 15:17SPEAKER_01: So it invites just write something in and ask for something.
- 15:22Where the difficulty arises is not when you're doing that
- 15:25initial contact,
- 15:25SPEAKER_01: but when you have something very specific you're asking it to do.
- 15:29SPEAKER_01: And then
- 15:31Sometimes you get nothing like what you wanted and finding the
- 15:34right words and the
- 15:35right ways to iterate and get a good product is a little bit of
- 15:40a challenge.
- 15:42And that's what I seem to be kind of getting the vibe from
- 15:47based on these results.
- 15:49SPEAKER_00: And it's not only about prompting.
- 15:51SPEAKER_00: Sometimes it even goes back to your knowledge gaps.
- 15:55I don't understand the concept for this,
- 15:57so I cannot formulate a good prompt.
- 15:59SPEAKER_01: Yeah, and that's the thing about AI, right?
- 16:02It can give you whatever you ask,
- 16:04but you got to know what you're asking for.
- 16:06SPEAKER_01: And so the content knowledge and in our case,
- 16:09SPEAKER_01: the pedagogical knowledge or the technology knowledge,
- 16:13SPEAKER_01: they have to be,
- 16:15SPEAKER_01: there's got to be enough there.
- 16:18SPEAKER_01: Otherwise, it just doesn't know what you want.
- 16:19SPEAKER_01: You don't even know what to ask.
- 16:22SPEAKER_01: And obviously you can't evaluate it.
- 16:24SPEAKER_01: So there's skepticism out there and I think that that's really important.
- 16:31That idea that there is resistance and some of that resistance
- 16:34is because we don't
- 16:35know or we're not sure of the policy or we have concerns really
- 16:41call for different
- 16:42SPEAKER_01: reactions.
- 16:44SPEAKER_01: And that's what we've tried to enact,
- 16:46SPEAKER_01: for example,
- 16:46this semester is let's ask you to use it so you can evaluate it
- 16:50and see where it
- 16:51SPEAKER_01: works and it doesn't work.
- 16:53SPEAKER_01: But also providing for enough space for resistance.
- 16:58SPEAKER_01: So if somebody is saying, I do not want to use it, this is not for me.
- 17:03SPEAKER_01: At least in my classes right now, I'm providing them the space.
- 17:06SPEAKER_01: So if you're in class and that's part of the assignment, you will use it.
- 17:10SPEAKER_01: But if you don't want to use it anywhere else, that's perfectly fine.
- 17:13SPEAKER_01: And when we talked to Rachel, it was the same thing.
- 17:18SPEAKER_01: She talked about, it's perfectly fine to say to students, you can resist.
- 17:24SPEAKER_01: I respect your resistance and we'll find a different way to do the work,
- 17:30SPEAKER_01: but we still have to do the work.
- 17:33The intellectual work and I'm not I'm not sure even who's right
- 17:36and who's wrong.
- 17:37SPEAKER_01: I mean, I don't know that we know these things.
- 17:41SPEAKER_00: So I think that's it.
- 17:43SPEAKER_01: Yeah, that's it.
- 17:44SPEAKER_01: So what are we saying?
- 17:45SPEAKER_01: We're saying resistance is real.
- 17:48We're saying we have to pay attention because these shift
- 17:51between who you're teaching,
- 17:53right?
- 17:54SPEAKER_01: So women are
- 17:56You are more resistant than men or they're more cautious
- 17:59critics is that category.
- 18:01SPEAKER_01: I love that.
- 18:02SPEAKER_01: They're not necessarily wrong.
- 18:05SPEAKER_01: We don't have to fix them as students or as individuals.
- 18:08SPEAKER_01: It's just this is their disposition.
- 18:10SPEAKER_01: They're not right.
- 18:11SPEAKER_01: You are not trusting technology as much.
- 18:12SPEAKER_01: They are not trusting this technology as much.
- 18:15SPEAKER_01: This is perfectly fine.
- 18:16SPEAKER_01: They may actually be right about it.
- 18:19SPEAKER_01: So we know women resist more.
- 18:21SPEAKER_01: We know people in the humanities and the social sciences resist more.
- 18:25SPEAKER_01: Computer science are all in.
- 18:27SPEAKER_01: Just let us do our thing.
- 18:29SPEAKER_01: Which I totally sympathize with.
- 18:31SPEAKER_01: But I also know that they might be wrong.
- 18:34And we know that there's a difference between Western Europe
- 18:37and the United States
- 18:38SPEAKER_01: and Canada versus other places.
- 18:41SPEAKER_01: And that doesn't go in the direction these things usually go.
- 18:46So there's actually more resistance in the classic West than
- 18:49there are in other places.
- 18:51And I'm sorry,
- 18:52Latvia and Ukraine,
- 18:52that I'm not calling you the classic West.
- 18:57SPEAKER_01: And, you know.
- 18:59SPEAKER_00: Yeah.
- 19:01SPEAKER_01: Classic in the Soviet era.
- 19:03And we're not in the Soviet era,
- 19:04but I think some tendencies still remain.
- 19:06And in this case,
- 19:08it just means you're more enthusiastic about AI,
- 19:10so yay for you.
- 19:14SPEAKER_01: But direct angry comments at my Substack.
- 19:17SPEAKER_01: Bring it on, people.
- 19:19SPEAKER_01: Any interaction is good interaction.
- 19:21SPEAKER_01: That's what I'm saying.
- 19:23SPEAKER_01: So thank you.
- 19:24SPEAKER_01: This is our first episode in the new season, season three.
- 19:29We're very excited for season three because we have some people
- 19:32lined up to talk to
- 19:35SPEAKER_01: us in the next few weeks.
- 19:36We've got Nikki Schafer coming on the 17th and talking to us
- 19:43about her work.
- 19:45She just finished a dissertation and she looked at AI and
- 19:47there's some interesting
- 19:48SPEAKER_01: things about how to communicate about AI.
- 19:51SPEAKER_01: And then Jeremy Reel will maybe come in June
- 19:56SPEAKER_01: Maybe June 24th.
- 19:58SPEAKER_01: He has not answered my email.
- 19:59SPEAKER_01: Jeremy, if you're listening, just answer my email, please.
- 20:02SPEAKER_01: And he will hopefully be here and talk about the work he's doing.
- 20:06And he also has got a podcast to talk about AI so he can talk
- 20:09about this podcast
- 20:10SPEAKER_01: and get all of our millions of listeners.
- 20:15SPEAKER_01: So we'll see you next time.