Latest / AI for Oklahoma Classrooms / When AI Lies: Teaching Students to Fact-Check Hallucinations
Transcript
- 0:24The AI for Oklahoma Classrooms podcast, a production of the Oklahoma State Department
- 0:30of Education's Office of AI and Digital Learning.
- 0:34I'm your host, Dr. Karen Leonard. We're so glad you're here.
- 0:38We're starting this journey because we believe in the power of Oklahoma educators.
- 0:44We know the passion you bring to your students, but we also know that Sunday
- 0:48night feeling, the mountain of greeting, and the three different lesson plans
- 0:53you need for tomorrow morning.
- 0:55AI isn't here to replace the magic that you bring to your classroom.
- 1:00It's here to be your ultimate teaching partner, helping you clear the busy work
- 1:05so you can get your weekends back and focus on what you love most, teaching.
- 1:11In our last podcast, we touched on a word that sounds like it belongs in a medical
- 1:16textbook or a science fiction movie.
- 1:19Hallucinations. You know, we've all seen the headlines.
- 1:23AI tells a lawyer to cite a case that doesn't exist.
- 1:28AI gives a recipe for chlorine gas pasta.
- 1:32As a teacher, that's terrifying. How do we use a tool that doesn't always provide factual truth?
- 1:40Today, we're going deep into the why.
- 1:43We're going to pull back the curtain on why AI gets things wrong,
- 1:48why it's actually a predictable feature, not just a bug, and how we can turn
- 1:54these lies or untruths into the ultimate AI literacy lesson for your students.
- 2:02Here's one of the biggest hurdles for educators. We train to treat computers like calculators.
- 2:08So if you type 5 plus 5 into a calculator, you always get 10 every single time
- 2:15because the calculator is following a logical rule.
- 2:20But generative AI, like ChatGPT or Claude, is not a calculator.
- 2:27It's a next token predictor.
- 2:31Think of it like the autocomplete on your phone, but on steroids.
- 2:36When you ask AI a question, it isn't looking up the answer in a database.
- 2:41It's calculating the probability of which word comes next based on patterns in its training data.
- 2:49If I were to ask you to finish the sentence, the cat sat on the,
- 2:54your brain likely predicts mat.
- 2:57Why? Because you've seen that pattern thousands of times.
- 3:02AI does the same thing, but sometimes the math leads it down a weird path.
- 3:08Because it's designed to be helpful and creative, Its priority is to give you
- 3:14a plausible-sounding answer, not necessarily a factually correct one.
- 3:20To visualize this, let's go deeper than autocomplete.
- 3:26Imagine a student who has read a thousand history books.
- 3:30They know the style, the names, and the dates, but they haven't learned to check their references.
- 3:37They can talk fluently and confidently about any topic,
- 3:42but if they hit a gap in their memory, they'll make up the missing piece with
- 3:47the most plausible-sounding detail, simply because their brain is prioritizing fluency over accuracy.
- 3:56That's what generative AI does. It's a subject matter imitator,
- 4:02not a subject matter expert.
- 4:05It generates its responses word by word with tremendous self-assurance.
- 4:11But it never stops to ask itself, is this true?
- 4:16It can't. Its entire existence is based on pattern-matching probability,
- 4:22not on cross-referencing a factual database.
- 4:27If you want a fact, you use a search engine. If you want a first draft,
- 4:32a brainstorm, or a tool that helps you think differently, that's what generative
- 4:37AI is for. So here's a key takeaway.
- 4:41AI doesn't really know what a fact is. It only knows what sounds right.
- 4:47When it hallucinates, AI is just being a very overconfident achiever.
- 4:53It would rather make up a convincing lie than admit it doesn't know the answer.
- 4:59In the world of AI, this is actually a trade-off for creativity.
- 5:04If we turn the hallucination dial to zero, the AI would become incredibly boring and rigid.
- 5:12So, if AI does not always provide factual, reliable information,
- 5:19why on earth would we ever bring it into the.
- 5:23Well, because, friends, we have just been handed the world's best critical thinking laboratory.
- 5:31For years, we've struggled to teach students about fake news and source verification.
- 5:37It always felt abstract.
- 5:40But when students see an AI tool confidently claim that George Washington invented
- 5:45the Internet, that is a lightbulb moment.
- 5:50We see this even in our own state.
- 5:53In one of my professional development sessions, we ran into a case study where
- 5:59AI was asked for the biography of Oklahoma's own Bill Pickett, the famous cowboy.
- 6:06The AI tool correctly described his rodeo techniques, but then fabricated the
- 6:12detail that he served as a state senator in 1925.
- 6:17Why? Because I found a plausible pattern, a successful Oklahoman, historical figure.
- 6:25Politics, and then prioritized completing the sentence convincingly over fact-checking.
- 6:33This is a powerful lesson. When a student sees that misinformation,
- 6:39the conversation shifts immediately.
- 6:42It's no longer about banning an AI tool. It's about accepting that a tool is
- 6:48an imperfect assistant that always needs human verification.
- 6:53We need to stop treating AI hallucinations as a reason to ban AI and then start
- 7:01treating them as a pedagogical tool.
- 7:04Our goal is to move our students from the computer said it so it's true to AI
- 7:11suggested it, but let me verify it first.
- 7:15When we teach students that AI is a stochastic parrot, basically,
- 7:20that just essentially repeats patterns without always understanding,
- 7:25we empower our students.
- 7:28They realize that they are the ones with the brains. They are the editors.
- 7:34The AI is just a tool.
- 7:38So every week we're going to end with a tomorrow morning test.
- 7:43One very specific, actionable AI win you can use in your classroom tomorrow.
- 7:50So, you've got a class tomorrow morning. How can you turn this high-level concept into a 15-minute win?
- 7:58Here's your tomorrow test, and I'm going to call this one the fact-check face-off.
- 8:04First, in front of your students, you're going to open up your preferred AI
- 8:08tool, again, whether that's Gemini or Claude.
- 8:11Then you're going to ask it to write a three-paragraph summary of a very specific
- 8:18historical event or scientific concept that you're currently teaching.
- 8:24Here's a pro tip. If you ask it about a local historical figure or a very specific
- 8:30local landmark, AI is more likely to hallucinate when the topic is less famous. Yes.
- 8:39After your AI tool provides the output, give your students 5 or 10 minutes.
- 8:44Their job is to use their textbook or another trusted database to find one hidden
- 8:51lie or untruth in the AI's response.
- 8:55Then ask the student who found that misinformation, how did AI make it sound believable?
- 9:04The result, you're not just teaching history or science anymore.
- 9:09You're teaching verification as a skill.
- 9:13You're showing your students that the human in the loop is the most important
- 9:19part of the equation when using AI.
- 9:23Well, that's it for our second episode. You now know that AI isn't a fact machine.
- 9:29It's a probability engine.
- 9:31And when AI gets things wrong, it's giving you a golden opportunity to teach
- 9:38your students how to think for themselves.
- 9:42Next time, we're going to lower the stakes even further.
- 9:46We'll be talking about the secret AI already in your pocket.
- 9:50We'll look at the tools you're already using that are secretly powered by AI
- 9:55so you can realize you're much further ahead than you think.
- 10:00Thank you again for joining me for AI in Oklahoma Classrooms brought to you
- 10:06by the OSDE's Office of AI and Digital Learning.
- 10:10If you found today's episode helpful, please share it with a colleague who could
- 10:15use a little more time back in their day.
- 10:18Always remember this, AI lightens the load.
- 10:22You bring the heart, the expertise, and make the impact in your classroom. See you next time.
- 10:35Thank you.