Latest / The Teaching Table / AI in the Classroom: Navigating Academic Integrity
Transcript
- 0:00Maggie Grady: Welcome to the CATT Teaching Table podcast, where we explore innovative teaching methods and dynamic educational strategies, hosted by the University at Buffalo's Office of Curriculum, Assessment and Teaching Transformation, otherwise known as CATT, and supp orted by the Genteels' Excellence in Teaching Fund, this podcast is dedicated to highlighting the journeys toward educational excellence.
- 0:21Maggie Grady: I'm your host, Maggie Grady, a learning designer for CATT, and today we're exploring a critical and timely topic artificial intelligence, academic integrity and where we go from here.
- 0:36Maggie Grady: So I'm thrilled to be joined by Dr Kelly Ahuna, who is the Director of Academic Integrity at the University of Buffalo.
- 0:39Maggie Grady: Kelly, thank you for joining us today.
- 0:41Dr Kelly Ahuna: Thank you very much for inviting me to participate.
- 0:43Dr Kelly Ahuna: I always appreciate an opportunity to talk about academic integrity, especially in this new world of AI.
- 0:49Maggie Grady: Yeah, and we'd like hearing it from you because you're the specialist, so let's dive right in.
- 0:54Maggie Grady: So AI tools are changing how students approach their work and how we assess it as faculty, as educators.
- 0:59Maggie Grady: So, to start, can you explain what cognitive offloading is and why it's particularly relevant in today's academic landscape?
- 1:08Dr Kelly Ahuna: So cognitive offloading is when you take cognitive demands and you reduce them to allow greater efficiency.
- 1:13Dr Kelly Ahuna: So a good classic example of this would be the calculator that you know if you have to do long division to get to ultimately to the end of a big problem, you might cognitively offload the long division to the calculator.
- 1:25Dr Kelly Ahuna: Things like translation tools.
- 1:27Dr Kelly Ahuna: I think EndNote is another good example.
- 1:30Dr Kelly Ahuna: You're writing a long paper.
- 1:31Dr Kelly Ahuna: You have to put all your references together.
- 1:33Dr Kelly Ahuna: You use EndNote to do the references.
- 1:35Dr Kelly Ahuna: So these are tools that do what previously would have been cognitive labor, and I think the concept is particularly relevant today because some students are using generative AI tools to cognitively offload work that in some cases they shouldn't or they're not allowed to.
- 1:53Maggie Grady: Okay, so the issue isn't necessarily the tools themselves, but how they're being used and within that context of learning objectives.
- 2:02Maggie Grady: So how can we dive into that?
- 2:07Dr Kelly Ahuna: Yeah, I mean, I think the learning objectives are really where the conversation should be, because the desired learning outcomes of the course should dictate when cognitive offloading is allowable.
- 2:15Dr Kelly Ahuna: So, for example, if you're taking a Spanish 101 class, students are not going to be allowed to use translation tools, because the learning objective is for students to memorize vocabulary.
- 2:24Dr Kelly Ahuna: But if it's a high level Spanish course and students are reading Don Quixote in Spanish, a translation tool is probably fine, because if they run into unknown words, the learning objective is not about memorizing vocabulary, it's much broader than that.
- 2:41Dr Kelly Ahuna: So the translation tool is probably allowable.
- 2:44Dr Kelly Ahuna: And this is where the instructor's rules become really important, because, as the expert in the subject and the designer of the learning outcomes, they're the people who know when an AI tool hinders or advances a learning objective.
- 2:56Dr Kelly Ahuna: And students.
- 2:58Dr Kelly Ahuna: You know they're enticed by these tools, but they're novices and they might not be able to identify this issue of how the AI tools hurt or help learning objectives.
- 3:09Dr Kelly Ahuna: So the more explicit instructors can be about what tools are allowed, when and why, the better for students.
- 3:17Maggie Grady: Understandable
- 3:18Maggie Grady: So how does AI impact assessment, especially considering today's tech-savvy students who might view AI tools like Chat GPT, Microsoft Copilot, something along those natures, is just another resource.
- 3:31Dr Kelly Ahuna: Yeah, so this is really important because faculty, when they collect an assessment from a student and they score it, it's really imperative that they are scoring what the student knows, or what the student can do, and if students are using AI tools in unallowable ways, it really harms the authenticity of that assessment.
- 3:47Dr Kelly Ahuna: So they're not scoring what the student can do, they're scoring what the AI has done, and so it's just imperative to the you know the genuine nature of assessments that students aren't using the tools in ways they're not allowed.
- 4:00Maggie Grady: That makes sense because, right, just what you said, they're judging or they're grading the AI tool versus the student, so isn't that the idea is that we want the students to learn and build that knowledge.
- 4:11Dr Kelly Ahuna: Yeah, and I would just say that AI is just the newest threat to academic integrity.
- 4:15Dr Kelly Ahuna: This has always been the case.
- 4:16Dr Kelly Ahuna: You could be grading what the student's roommate did for them, or the student's mother, or what they purchased online, or there have been all kinds of other threats.
- 4:29Dr Kelly Ahuna: It's just that artificial intelligence now is so accessible in so many areas.
- 4:32Maggie Grady: So communicating to the students can be tricky.
- 4:34Maggie Grady: And how can we ensure that understanding when AI is used and if it's crossing the line?
- 4:37Dr Kelly Ahuna: Yeah, this is where communication between instructors and students really has to be very clear.
- 4:41Dr Kelly Ahuna: So there are a lot of things faculty can do, I think.
- 4:44Dr Kelly Ahuna: First of all putting something in their syllabus.
- 4:46Dr Kelly Ahuna: So this could be a blanket statement if they're never going to allow AI or they're always going to allow AI, but it's probably more typical that it's going to be assignment dependent so their syllabus statement can say there will be specific rules about AI as we get to assignments, and then they need to say it out loud when they get to the assignment.
- 5:06Dr Kelly Ahuna: You know, in this case you're allowed to use these things and I learned from Ethan Blanton, who's a computer science professor here, that I think it is easier to tell students what tools they can use than to try to make a list of what they can't, Because the list of possible tools is proliferating rapidly and you're never going to be able to cover all your bases.
- 5:26Dr Kelly Ahuna: So if on this assignment you think Microsoft Copilot would be okay for students to use, to tell them overtly you can use this tool or that tool or these three tools and sort of put the parameters around it for the students.
- 5:38Dr Kelly Ahuna: And then, importantly, I always tell students they should never make assumptions If the professor hasn't said they should not assume it's allowed.
- 5:46Dr Kelly Ahuna: They should always go back and ask.
- 5:47Maggie Grady: Yeah, so clear lines of communication, always talk to the professor of uncertainty and communicate out towards the students, so keeping things clear for everybody.
- 5:56Maggie Grady: So, I have heard from faculty a few strategies that they use requiring students to submit drafts as a way to get to combat cheating, or having students include an oral component, and this is also another way that they can detect if they're using AI.
- 6:15Maggie Grady: So why are those two things effective and can you think of other strategies?
- 6:20Dr Kelly Ahuna: Yeah, I mean, if the goal is to make sure students aren't using AI, there are some methods that might be more reliable than others.
- 6:28Dr Kelly Ahuna: So I think a lot of people are going back to the classic in-class proctored assessment, where students aren't taking the exam somewhere else or writing doing the writing somewhere else.
- 6:40Dr Kelly Ahuna: They're writing or taking the exam in class where they can be observed by the instructor.
- 6:44Dr Kelly Ahuna: So, along those lines, sometimes people are flipping their classrooms and if you're not familiar with that, that's the idea that students do the learning outside of class and the assessment in class.
- 6:57Dr Kelly Ahuna: Typically we think of, you know students coming to class to hear the instruction and then they might go home and do the assessment as an out of class something.
- 7:04Dr Kelly Ahuna: Some faculty are flipping that around, especially since COVID.
- 7:07Dr Kelly Ahuna: We have so much better, you know, fluency in the technologies for students to watch lectures at home and then do assessment in class.
- 7:15Dr Kelly Ahuna: Also, you know the Gen AI tools are getting better all the time, but still, if you can be very specific to course content in the assessment questions, then it's going to be harder for students to get the help from the tools.
- 7:30Dr Kelly Ahuna: So making the assessments as course specific as possible you mentioned drafts.
- 7:34Dr Kelly Ahuna: You know drafts is a good idea.
- 7:35Dr Kelly Ahuna: You could follow a student's progression as they go from beginning to end and along those lines you could ask for the metadata you know Google Docs keeps you know track.
- 7:45Dr Kelly Ahuna: You can ask a student to turn that in.
- 7:47Dr Kelly Ahuna: Or you could ask a student to take notes on their progress.
- 7:50Dr Kelly Ahuna: You know sort of a metacognitive approach to like when I did this first part I was stuck here and now I'm feeling better and you know, just sort of talking it through.
- 7:59Dr Kelly Ahuna: And then, like you mentioned oral components.
- 8:03Dr Kelly Ahuna: I mean, if you want to know if somebody knows something, a really good way is to ask them questions and see if they could respond in real time.
- 8:09Dr Kelly Ahuna: That's often not possible in classes of any substance of size, but it is a good, effective technique to get knowledge.
- 8:19Maggie Grady: Yeah, so putting a personal component into whatever assessment method, I think would be one way that they could get around and making sure, just like what you said, that they know the material, they're ready to move on and they understand.
- 8:32Maggie Grady: So now let's talk about detecting AI use.
- 8:36Maggie Grady: So I know that UB uses Turnitin, which is an integrated AI detection feature, and how reliable is it and what should educators be mindful of?
- 8:51Dr Kelly Ahuna: Yeah, this is really such an important topic.
- 8:57Dr Kelly Ahuna: I mean I don't want any student out there worrying that they're going to get in trouble for academic dishonesty when they really did their own work.
- 9:02Dr Kelly Ahuna: We have a lot of stop get measures in place to prevent that from happening.
- 9:04Dr Kelly Ahuna: And I think there's been a lot of press about these tools.
- 9:07Dr Kelly Ahuna: You know, after ChatGPT came out, these detection tools proliferated.
- 9:12Dr Kelly Ahuna: I spent a lot of time trying to keep up with them all and some of them are much better than others and I think the bad ones have really brought bad press to all the tools.
- 9:21Dr Kelly Ahuna: We use Turnitin, it's built into our Brightspace platform.
- 9:24Dr Kelly Ahuna: It's easy for faculty to turn it on.
- 9:26Dr Kelly Ahuna: Turnitin does two things it will give you a plagiarism score and a score of what is the likelihood that text was generated by artificial intelligence.
- 9:36Dr Kelly Ahuna: So it's a predictor likelihood score.
- 9:38Dr Kelly Ahuna: Turnitin is less likely to catch AI than it is to falsely accuse a student of AI.
- 9:45Dr Kelly Ahuna: So their sort of business model is that they'd rather miss some than falsely accuse some people.
- 9:53Dr Kelly Ahuna: But I just want to say that our academic integrity process we rely on a standard of evidence that we call preponderance, which is what is more likely.
- 10:01Dr Kelly Ahuna: We're just looking to see what more likely happened and if Turnitin comes back with a high likelihood score that this was generated by AI, our procedures require that the instructor have a conversation with the student and when they have that conversation and the professor says, tell me about your paper, why did you write this, where did you get this information, and the student can talk in an educated way about their paper, that really usually just erases the concern of what the Turnitin report has been.
- 10:33Dr Kelly Ahuna: So if a student has really truly done their own work, I don't want them to have any worries about a false positive.
- 10:41Maggie Grady: Okay, so let's move on to well, or let's continue to talk about what is the best approach for faculty to take.
- 10:48Dr Kelly Ahuna: Yeah, so faculty should just follow the process we have in place.
- 10:51Dr Kelly Ahuna: We have a, I've worked really hard to develop a faculty web page on the Academic Integrity website where they can just walk through the steps of the academic integrity process if they have a concern.
- 11:02Dr Kelly Ahuna: But they can always call our office.
- 11:03Dr Kelly Ahuna: They can talk to us.
- 11:05Dr Kelly Ahuna: We're happy to walk them through anything.
- 11:08Dr Kelly Ahuna: But when they have this conversation with a student you know I was faculty for 20 years before I took this job and so I know that if you have a student who you think cheated somehow on your work, you might take that personally and I would just say to faculty try to leave that at the door.
- 11:24Dr Kelly Ahuna: You know students have lots of reasons and motivations for why they do things and usually it's really not personal to you and the goal of this is just to have a conversation to come to an understanding of what happened.
- 11:43Dr Kelly Ahuna: So I'm finding that instructors can pretty easily identify when students are using artificial intelligence in a couple of ways.
- 11:46Dr Kelly Ahuna: Sometimes they include information that you did not teach in class and sometimes they include information that's very much at a higher level than what you taught in class.
- 11:53Dr Kelly Ahuna: Sometimes a lower level, but usually a higher level.
- 11:56Dr Kelly Ahuna: Sometimes there are these idiosyncratic misinformation items, sometimes there are false references and sometimes it's just markedly different from every other assessment the student has turned in.
- 12:10Dr Kelly Ahuna: The whole voice of it is very different.
- 12:13Dr Kelly Ahuna: So I always just say that, you know, I think instructors should trust their expertise and their experience.
- 12:18Dr Kelly Ahuna: They read a lot of these assignments and sometimes it's pretty clear.
- 12:22Maggie Grady: Okay, so, as AI continues to evolve, what are some of the larger challenges that you foresee for academic integrity and higher education?
- 12:31Dr Kelly Ahuna: Yes, I mean I can't stress enough the need to protect the value of a UB degree.
- 12:35Dr Kelly Ahuna: I mean we are not a diploma mill, right?
- 12:37Dr Kelly Ahuna: We are not just giving out degrees for money.
- 12:40Dr Kelly Ahuna: We are trying to make our community and our world a better place by educating our students to go out and do good work.
- 12:46Dr Kelly Ahuna: So if our students you know, I always try to tell them that our futures are inextricably linked together.
- 12:52Dr Kelly Ahuna: Because if our graduates go out for a job unprepared because they cheated their way through UB, that employer is going to wonder why this person doesn't know what they're supposed to know and they're likely going to think you know what is UB doing?
- 13:06Dr Kelly Ahuna: UB is not preparing the student in the way that they should, and so the next time a UB graduate applies for a job with that company, they're so much less likely to be looked upon favorably because the employer no longer trusts UB.
- 13:17Dr Kelly Ahuna: So really, UB's reputation is critical to everyone involved with the university.
- 13:25Maggie Grady: I like that viewpoint because some people forget that.
- 13:29Maggie Grady: So it's nice to put that it's reputation, it's value, it's all of those things and we're just building upon that.
- 13:36Maggie Grady: I like how that thinking is.
- 13:38Dr Kelly Ahuna: Yeah, sometimes students will say well, if I cheat, I'm only cheating myself.
- 13:40Dr Kelly Ahuna: That's the kind of line that people say, and that's really not true.
- 13:44Dr Kelly Ahuna: When students cheat, they really they hurt the whole community.
- 13:48Maggie Grady: Yeah, I agree on that.
- 13:49Maggie Grady: It sounds like there's a delicate balance of integrating these tools without undermining the core values of education.
- 13:55Maggie Grady: What advice would you give our listeners?
- 13:59Dr Kelly Ahuna: Well, I guess I'll talk to two audiences.
- 14:00Dr Kelly Ahuna: I'm not sure who exactly will be listening, but I would remind our students that they're here and they're paying good money to learn.
- 14:08Dr Kelly Ahuna: There's no shortcut to learning.
- 14:10Dr Kelly Ahuna: Back to our cognitive offloading discussion.
- 14:12Dr Kelly Ahuna: All learning has to take place in a student's head.
- 14:15Dr Kelly Ahuna: They have to do the cognitive work to take in new information and make it meaningful and keep it.
- 14:18Dr Kelly Ahuna: So, t hey need to trust their professors when it comes to how they're going to learn in a class and follow those guidelines.
- 14:26Dr Kelly Ahuna: But for our faculty, I would quote a woman named Sarah Eaton who does academic integrity work in Canada and she likes to say that our students aren't our enemies, they're our future, and I think this is really important to keep in mind.
- 14:40Dr Kelly Ahuna: We don't want to make this into an arms race and that instructors really I know it might seem a lot to some people, but I think they need to educate themselves about the available AI tools and how they're relevant to their content area and, whenever possible, allow students to get some responsible practice with the tools.
- 15:00Dr Kelly Ahuna: You know, we know from a survey that we did last year that our students are very worried about the job market expectations around AI use, that this is going to be an expectation of them.
- 15:14Dr Kelly Ahuna: So when faculty can allow AI in their classes and in their assessments to, you know, sort of allow for that model, that for students and get them to be comfortable with the tools.
- 15:22Maggie Grady: So it's been a super enlightening conversation and before we wrap up, do you have any advice for instructors navigating the use of AI in their teaching and their assessments?
- 15:33Dr Kelly Ahuna: You know, I would just say use the Office of Academic Integrity.
- 15:36Dr Kelly Ahuna: If you need support reading a Turnitin report, if you have questions about how to approach a meeting with a student, or worry about if you have preponderance of evidence or any questions like that, reach out.
- 15:46Dr Kelly Ahuna: UB is very lucky to have an Office of Academic Integrity.
- 15:49Dr Kelly Ahuna: Not a lot of universities are resourced that way, so that's why we're here.
- 15:53Dr Kelly Ahuna: We're here to help, and so I would just say please use us.
- 15:56Maggie Grady: So, for those that want to learn more, you can visit the University of Buffalo's Academic Integrity page, just like Kelly mentioned, and that's buffalo.
- 16:04Maggie Grady: edu/ academic- integrity.
- 16:08Maggie Grady: And Kelly, thank you so much for joining me today.
- 16:11Dr Kelly Ahuna: Yeah, thanks very much for having me.
- 16:12Dr Kelly Ahuna: I mean, these tools aren't going anywhere, so we're going to need to keep the conversation going.
- 16:16Maggie Grady: Thank you to our listeners for tuning into this episode of the Teaching Table podcast.
- 16:21Maggie Grady: If you enjoyed today's discussion, be sure to subscribe and leave us a review.
- 16:25Maggie Grady: We'll be back soon with more conversations on exploring the latest in teaching innovations and strategies, and until then, keep exploring new ways to reach and inspire your students.
- 16:35Maggie Grady: As always, be sure to connect with us online at buffalo.
- 16:38Maggie Grady: edu/ catt that's C-A-T-T or email us at ubcatt@buffalo.
- 16:43Maggie Grady: edu