Latest / aiEDU Studios / Greg Toppo: The promise and perils of AI in schools

Transcript

Greg Toppo: The promise and perils of AI in schools · aiEDU Studios

• 0:01
  Alex Kotran (aiEDU): Hey everybody, I'm Alex Katran, I'm the CEO of AIEDU and we're here at AIEDU Studios DC Edition.
• 0:12
  Alex Kotran (aiEDU): I'm very excited to have Greg Toppo, a reporter for the 74, one of the leading publications covering the education space, someone that I've talked to formally and informally over the past year, two years, and Greg has been both a confidant and sort of a co-learner as we try to make sense of this space and sort of how technology, and specifically artificial intelligence, is changing education or not, and so I'm very excited to flip the script and put the mic in front of you and give you a chance to talk about you know, from the vantage point of a journalist who's talked to a really wide range of folks in our space, what you're learning, questions you're asking.
• 1:00
  Alex Kotran (aiEDU): But before we go into sort of the day-to-day you know this sort of this AI moment, this AI zeitgeist I'd love to zoom out a little bit and hear why don't you start with just sort of you know what you're doing at the 74 and then you know how did you come to cover education?
• 1:17
  Greg Toppo (The 74): Sure, sure Thanks for having me and, just as a quick aside, most journalists hate being interviewed, by the way, so you know I'm good with it.
• 1:25
  Greg Toppo (The 74): I think we're going to have a good time here.
• 1:28
  Greg Toppo (The 74): I cover a couple of things at the 74.
• 1:33
  Greg Toppo (The 74): It feels like it keeps changing, but I cover basically the intersection of AI and education, and I also have sort of a I don't know if you'd call it like a side hustle at 74, but one of the things we are very interested in is the future of high school, and so one of the topics that I spent a lot of time on is writing about visiting and thinking about and writing about innovative high schools, and the two haven't quite merged yet.
• 2:07
  Greg Toppo (The 74): I expect we're going to be seeing more and more in the near future.
• 2:12
  Alex Kotran (aiEDU): I mean there's a lot of reporters covering AI A lot of good ones.
• 2:16
  Alex Kotran (aiEDU): There's a lot of good ones, and a lot more today than there were three or four years ago Not that many covering AI plus education intersection.
• 2:26
  Alex Kotran (aiEDU): How did you get to be doing specifically sort of this like sort of view of the future of school and innovation?
• 2:33
  Greg Toppo (The 74): Yeah, well, I mean, I was interested in it for a number of years.
• 2:36
  Greg Toppo (The 74): I co -wrote a book in 2021 that actually looked at AI and education specifically, interestingly enough, actually looked at AI and education specifically, interestingly enough, what it was going to do to high school.
• 2:49
  Greg Toppo (The 74): We were very interested in just sort of projecting forward what all these technological marvels, if you will, were going to the effect they were going to have on education.
• 2:59
  Greg Toppo (The 74): I had a co -author, my co-author and I.
• 3:02
  Greg Toppo (The 74): He was an educator, he still is an educator.
• 3:04
  Greg Toppo (The 74): He and I wrote kind of.
• 3:07
  Greg Toppo (The 74): I thought it was a fun, really interesting book.
• 3:13
  Greg Toppo (The 74): We basically did a what if a high school principal fell asleep in 2020 and woke up in 2040 and then went and visited his old school?
• 3:23
  Greg Toppo (The 74): What would it look like?
• 3:24
  Greg Toppo (The 74): You know, after all these technological changes, we've been seeing so sort of a Rip Van Winkle story, interspersed with some reporting on what's happening actually now and different models of high school so big picture.
• 3:39
  Greg Toppo (The 74): I've been thinking about this for a number of years.
• 3:41
  Greg Toppo (The 74): I've been covering AI you know AI daily for two years and change at the 74.
• 3:48
  Greg Toppo (The 74): And it really began where I think most of us started covering it, which is November 2022, when chat GPTs were burst on the scene and people started messing with it and freaking out about it and wondering what was going to happen.
• 4:07
  Greg Toppo (The 74): Um, and you know, decrying the death of the five paragraph essay, et cetera, et cetera.
• 4:13
  Greg Toppo (The 74): Um, that was when we as an institution started really paying attention to it and when I basically started saying you know, okay, this is something we need to cover full time.
• 4:23
  Alex Kotran (aiEDU): Yeah To me cause we were chatting earlier.
• 4:24
  Alex Kotran (aiEDU): You, you know, okay, this is something we need to cover full time.
• 4:25
  Alex Kotran (aiEDU): Yeah to me because we were chatting earlier.
• 4:26
  Alex Kotran (aiEDU): You mentioned that you'd even did you do a story on GPT-2 or had you just sort of.
• 4:30
  Greg Toppo (The 74): In the book.
• 4:30
  Greg Toppo (The 74): Actually, one of the things that we looked at was and it was actually not specifically related to education, it was just in 2019, I want to say they were playing with OpenAI, was playing with the ways you could essentially make GPT-2 into kind of an approximation of a journalist, and actually the chapter in the book where we talk about it is where we talk about, um, what's this going to do to journalism and the?
• 5:05
  Greg Toppo (The 74): The example we gave, which, of course, you could imagine even more clearly now, was that it basically just they gave it a couple of words from a, you know, a real existing I can't remember it was guardian story or something like that and it just basically just went to town and wrote the whole story I remember yeah, and you was lots of crazy stuff and it was even, I think, one of the one of the things they said at Luzon was imagine a reanimated JFK.
• 5:34
  Greg Toppo (The 74): you know, just patently crazy stuff.
• 5:38
  Alex Kotran (aiEDU): Yeah, I think GPT-2 was a time when there was, I think, only a couple hundred people in the world who had really had the chance to look under the hood of these language models.
• 5:46
  Alex Kotran (aiEDU): But for me, the zeitgeist moment that ChatGPT ushered in, because I've been in the AI space since 2014.
• 5:58
  Alex Kotran (aiEDU): Ai has been around I mean, you can actually go quite far back and some people argue the Turing computer.
• 6:02
  Alex Kotran (aiEDU): But machine learning reached technological maturity in industry in the 2010s, so AI was not a new conversation.
• 6:11
  Alex Kotran (aiEDU): There were plenty of people portending a lot of the stuff that is now reality today.
• 6:18
  Alex Kotran (aiEDU): It was sort of lived in the realm of futurism.
• 6:20
  Alex Kotran (aiEDU): I think the challenge for artificial intelligence in part was it was a concurrent technology with this suite of emerging tech.
• 6:28
  Alex Kotran (aiEDU): You know crypto, you know blockchain, virtual reality, much of which you know 3D printing the metaverse, all this NFTs, nfts.
• 6:45
  Alex Kotran (aiEDU): And while there's actually arguments that a lot of those technologies are still nascent and will bloom in later years and will transform society in ways that people have predicted, they were clearly a bit ahead of their time.
• 6:53
  Alex Kotran (aiEDU): If we're being gratuitous and some of them are probably just like patently you know we're overhyped and over embellished, and so I think there was this fatigue from OK, the futurists are at it again talking about some crazy future.
• 7:06
  Alex Kotran (aiEDU): I think people were understandably cynical and incredulous at some of the claims that were being made.
• 7:13
  Alex Kotran (aiEDU): Chatgpt put everything into their hands.
• 7:16
  Alex Kotran (aiEDU): It made it tangible in a way that it wasn't before.
• 7:18
  Alex Kotran (aiEDU): I think in the abstract, people understood that there was an algorithm curating the content that they view.
• 7:23
  Alex Kotran (aiEDU): It's very hard to really wrap your head around.
• 7:27
  Alex Kotran (aiEDU): You know what that means.
• 7:28
  Alex Kotran (aiEDU): You're not really using it.
• 7:29
  Alex Kotran (aiEDU): You don't really understand you know what the weights are or even what that means when you have a tool that's just as and the user interface was really powerful, right.
• 7:38
  Alex Kotran (aiEDU): You just ask a question, you press enter and you get this output and these turn, you get this output, and these outputs were, you know, astounding, I think.
• 7:51
  Alex Kotran (aiEDU): Today we're sort of we are the bar continues to to increase, um, but I think most people will be able to tell you like exactly the first thing that they put into, whether it was chat, gbt or gemini or something else.
• 7:56
  Greg Toppo (The 74): Where were you and what were you doing at the time?
• 7:58
  Alex Kotran (aiEDU): yeah, yeah did you have?
• 8:00
  Alex Kotran (aiEDU): You been in education your whole, your whole life um, I actually sure um we were all in education, you know, the first part of everybody's lives generally.
• 8:07
  Greg Toppo (The 74): Exactly, I spent a long time in education.
• 8:11
  Greg Toppo (The 74): When I graduated from college.
• 8:15
  Greg Toppo (The 74): I actually got right into teaching, actually was in a teacher prep program the Monday morning after I graduated from college, um, and stayed in education.
• 8:29
  Greg Toppo (The 74): Stayed in, uh, elementary and secondary secondary education for about the next eight or nine years, um, mostly, I have to say, if I'm being honest, wanting to get the hell out of it.
• 8:39
  Greg Toppo (The 74): As soon as I got in, not quite sure how, I knew I wanted to write, knew I wanted to do something different and about you know, like I said, eight or nine years in I finally just said, okay, I need to change what I'm doing.
• 8:54
  Greg Toppo (The 74): And so started freelancing, doing lots of magazine pieces, and finally got my first staff job at a newspaper in New Mexico at the great great paper still exists, the Santa Fe New Mexican, and really just loved it and had the time of my life there.
• 9:15
  Greg Toppo (The 74): Spent three years there and then went to Baltimore to work at the AP.
• 9:19
  Greg Toppo (The 74): Spent two years at the AP in Baltimore, two more years at the AP in Washington.
• 9:23
  Greg Toppo (The 74): Was there just in time for things like the Clinton impeachment and ended up covering some of the Monica Lewinsky stuff.
• 9:32
  Greg Toppo (The 74): We actually, as luck would have it, I was the only person in the Baltimore Bureau who lived a couple of blocks from the courthouse where the Linda Tripp wiretap case was taking place, so I ended up covering that I don't know.
• 9:48
  Greg Toppo (The 74): After the AP in Washington, spent 15 years at USA Today and was the national education writer there.
• 9:58
  Greg Toppo (The 74): During that time, wrote a book in 2015 that looked at the possibilities in learning games and really got kind of like a graduate level education all my own, you know just self almost entirely like self-taught, if you will.
• 10:22
  Greg Toppo (The 74): Um, the kind of how that works, how that sector works gamified learning yeah, yeah, um, and really had the time of my life, um.
• 10:32
  Greg Toppo (The 74): by then, um, I was really wanting to do something different, was kind of sick of the you know nclb race to the top standards, testing on and on and on um, and just wanted to just explore something new and different and weird, and that was really.
• 10:49
  Greg Toppo (The 74): That was probably the most fun I've had in my career.
• 10:51
  Greg Toppo (The 74): Um, and I'd love to actually maybe at some point talk about the parallels between what I saw then so now going on a decade ago and what I'm seeing now with AI.
• 11:02
  Alex Kotran (aiEDU): Yeah, so you, you found your way out.
• 11:04
  Alex Kotran (aiEDU): You're covering national politics.
• 11:06
  Alex Kotran (aiEDU): We were just talking to a reporter yesterday from one of the big publications, people in education.
• 11:15
  Alex Kotran (aiEDU): I think sometimes there's a lot of stories of folks becoming cynical.
• 11:18
  Alex Kotran (aiEDU): Education is a tough place for people who are well-intentioned, trying to do work and have an impact, and there's just a lot of systemic challenges, um, but national politics is its own uh cynicism factory.
• 11:32
  Alex Kotran (aiEDU): Um, so you went from one very you know uh place where a lot of jaded people to back to education.
• 11:39
  Alex Kotran (aiEDU): Um, but at the 74, you, I mean your reporting is interesting because it's a lot more, it's longer form.
• 11:45
  Alex Kotran (aiEDU): You're doing much more of a deep dive.
• 11:47
  Alex Kotran (aiEDU): You're not like, I haven't seen too many process stories from you, and is that because of your remit at the 74?
• 11:55
  Alex Kotran (aiEDU): Is that something that you're trying to be more intentional about in terms of?
• 11:58
  Alex Kotran (aiEDU): I mean, especially right now, there's so much to cover, you know, and AI is not a narrow space anymore.
• 12:07
  Alex Kotran (aiEDU): I mean, how do you think about sort of your beat, as it were, like what is the frame or sort of the aperture that you're using?
• 12:15
  Greg Toppo (The 74): Yeah, that's a great question and I think, in a way, the DNA of the $74 million is that you know, on the one hand, we're a national publication, so we don't have to be writing about the Cleveland School Board or the, or you know what's happening at the, you know the State Board of Education in New Hampshire, so we're we're not worrying about those little processes unless they're interesting to us.
• 12:39
  Greg Toppo (The 74): So so if there's something happening on a local level that we want to dip into, we can dip into it.
• 12:45
  Greg Toppo (The 74): The perfect example to me is the story I wrote a couple weeks ago about this case in Massachusetts with the student who was accused of cheating on a history project using AI In a way, a local story.
• 13:03
  Greg Toppo (The 74): It was in a federal court in Boston, but we found it interesting enough where we just said you know what we need to write about this.
• 13:13
  Alex Kotran (aiEDU): Yeah, I remember you reaching out to me for my thoughts on that story and shortly thereafter and it was around the time that your piece had come out, I mean, it started to really gain national traction.
• 13:22
  Alex Kotran (aiEDU): I don't know if it's actually the first, but it certainly appears to be the first, at least the first example of this that has been talked about and covered nationally.
• 13:32
  Alex Kotran (aiEDU): Do you know, was this actually the first time someone has gone to court challenging an accusation of cheating because they used Chad GBT?
• 13:43
  Greg Toppo (The 74): Yeah, here's the thing you need to know, because they use chat gpt.
• 13:48
  Greg Toppo (The 74): Yeah, um, here's a, here's the thing you need to know.
• 13:50
  Greg Toppo (The 74): Um, we will never say first, ever, or, or, or never before, or, uh, anything like any, any superlative like that, unless we can absolutely prove it.
• 13:57
  Greg Toppo (The 74): Because somebody always comes along and says no, no, no, you know, I was the first ever and I filed a lawsuit in 1988.
• 14:04
  Greg Toppo (The 74): And so we're basically among the first, or the known first, so we will always hedge our bets.
• 14:21
  Greg Toppo (The 74): That said, as far as we can tell it's a and it's an interesting case too.
• 14:24
  Alex Kotran (aiEDU): It's an interesting case We'll link to your reporting on this.
• 14:28
  Alex Kotran (aiEDU): I also wrote a substack that sort of was a follow-up, you know, very much inspired by our conversations um the last, and I and I and I'll admit I haven't actually checked in on whether there have been any updates the last thing that I have seen was a preliminary injunction that was denied by the judge, and I remember when we had talked about this case, you know, one of the things that you and I both sort of agreed on was we just don't know enough, like we don't like there's we have one side of the story, which is the student is, you know, claiming that they were unfairly penalized, um, and you know, uh, for, for cheating, when in reality, uh, from the student's perspective, um, this was purely just a misunderstanding.
• 15:12
  Alex Kotran (aiEDU): And you know a lot, you know miscommunication or lack of sufficient communication from the school about, you know what constituted cheating, and I think there was a lot of, um, uh, reactionary outcry that was like, ah, this is completely unfair.
• 15:25
  Alex Kotran (aiEDU): The student, you know, shouldn't be penalized for the school just not being up to date or up to speed.
• 15:30
  Greg Toppo (The 74): Not having a good policy.
• 15:31
  Alex Kotran (aiEDU): Not having a good policy.
• 15:32
  Alex Kotran (aiEDU): But when I read the preliminary injunction the judge actually quoted specific excerpts from the school academic integrity policy where they say you know you're not supposed to use, you know technology and they ensure they don't necessarily specifically name artificial intelligence.
• 15:51
  Alex Kotran (aiEDU): But so there was even even the the out of date academic integrity policy, I think arguably did cover it.
• 15:58
  Alex Kotran (aiEDU): But then the other other sort of like you know detail that I think was lost in some of the national coverage is the school had actually had a whole class where they talked about appropriate and inappropriate uses of chat GPT.
• 16:13
  Alex Kotran (aiEDU): Right.
• 16:14
  Greg Toppo (The 74): It was an English class I think it was an English class.
• 16:15
  Greg Toppo (The 74): And just for the record, the kid had been punished in a history class.
• 16:22
  Alex Kotran (aiEDU): Yeah, and so so what we, what?
• 16:24
  Alex Kotran (aiEDU): Basically, what the case kind of evolved into was to me very clearly the student cheated, and this was basically a semantic argument about whether you know a policy in an English class is transferable to a social studies class and you know I'm not a student of the law and I don't know exactly.
• 16:44
  Alex Kotran (aiEDU): You know I'm not a student of the law and I don't know exactly.
• 16:47
  Alex Kotran (aiEDU): You know I don't believe that there's been a ruling yet.
• 16:49
  Alex Kotran (aiEDU): In the case, the judge seems pretty aligned with the school based on his commentary in the denial of the injunction.
• 16:58
  Alex Kotran (aiEDU): But you know, I think I actually think that school in Massachusetts is an exemplar of what most schools should be doing.
• 17:09
  Alex Kotran (aiEDU): And sure, maybe there, you know, I think there policies school wide and be really intentional about letting kids know.
• 17:28
  Alex Kotran (aiEDU): But I also think that, as a student, you know there is a there's, there's these gray areas, even before Chad GPT.
• 17:37
  Alex Kotran (aiEDU): And one of the one of the points that I make when people ask well, you know, chad GPT shouldn't be cheating because a student is just, you know, using a tool.
• 17:40
  Alex Kotran (aiEDU): You know chat GPT shouldn't be cheating because the student is just, you know, using a tool.
• 17:44
  Alex Kotran (aiEDU): You know, one of the questions I'll ask I'll be curious for your take on this um is imagine a student's writing an essay and, um, it's an essay on cold war history and their parent is a professor of cold war history.
• 17:57
  Greg Toppo (The 74): Um, no, you're going with this, but while they're writing the essay, and while they're writing the essay, their parents are sitting right next to them.
• 18:02
  Alex Kotran (aiEDU): Right, and you know, maybe not literally writing it, but helping them write every single thing like sort of like you know, provide them with all this feedback, you know, not just reviewing it and providing like red lines, like actually co-writing it with a student Right.
• 18:17
  Greg Toppo (The 74): You know there's a sculpture project in there.
• 18:20
  Greg Toppo (The 74): Dad's a sculptor, yeah, yeah, I mean is that cheating I mean.
• 18:26
  Alex Kotran (aiEDU): I like if you were the teacher in that situation no, I think it's a great it's.
• 18:30
  Greg Toppo (The 74): It's great, it's a great question and I think the the to me the kind of the short answer to that.
• 18:35
  Greg Toppo (The 74): The short response is you know, transparency says you should indicate that you know I got help from my mom, who's a Cold War historian, or you know, here are the contributions that that she, you know that she was able to offer and I.
• 18:57
  Greg Toppo (The 74): You know.
• 18:57
  Greg Toppo (The 74): It's interesting, cause I think a good teacher maybe this goes back to you know, like basic principles, principles like a good teacher would probably know.
• 19:05
  Greg Toppo (The 74): Like you know, alex's mom is a cold war historian, so he's gonna write a killer paper on, you know, the q and missile crisis.
• 19:13
  Greg Toppo (The 74): Um, and I think in in a way, maybe that's beyond the pale for most teachers.
• 19:19
  Greg Toppo (The 74): Maybe they don't need to know that much about their students, but it's probably a good, smart teacher would know that.
• 19:24
  Greg Toppo (The 74): It's kind of the same thing.
• 19:27
  Greg Toppo (The 74): I think you should be able to expect from your students a kind of transparency about their work and their sources and the advantages they've got.
• 19:41
  Alex Kotran (aiEDU): Because the student didn't appropriately cite their use of ChatGPT and that was one of the things that they'd covered in English class was first of all, if you're going to use ChatGPT, you have to.
• 19:52
  Alex Kotran (aiEDU): I forget exactly how they framed it, but it was like the spirit was you can't just type in one sentence and press enter.
• 19:59
  Alex Kotran (aiEDU): The goal is that you're and if you're going to use it like you have to cite it in the same way that you'd cite an encyclopedia or some other sort of like online technology based information product.
• 20:11
  Alex Kotran (aiEDU): And so I think that there is, but there's generally not.
• 20:14
  Alex Kotran (aiEDU): I think the point with the parent is there's not a right answer, but there is sort of the goal of education, the goal of an assignment is ultimately a student, you know sort of this, this like sort of productive struggle, yeah, um, and I think and I think this is where I'm very I'm very biased towards teachers in the debate about whether chat GPT is cheating, because the answer is it's complicated.
• 20:38
  Alex Kotran (aiEDU): But ultimately I think teachers actually have an instinct and, to your point, you know, teachers know their students and like they generally have a sense for whether something is, like you know, kind of wildly out of scope of what is what that student was able to do.
• 20:51
  Alex Kotran (aiEDU): Um, and I think the challenge is the parents, students are looking for sort of a blanket answer to a question that I think society and industry has not even really quite answered, because we have not figured out.
• 21:05
  Alex Kotran (aiEDU): I've not seen any company that has like really honed in on what does it look like for humans and language models to sort of co-create together?
• 21:17
  Alex Kotran (aiEDU): And so in this moment where we're actually figuring this out together, I think there needs to be some latitude.
• 21:25
  Greg Toppo (The 74): I think you're right, and, and and you know I mean another way of thinking about productive struggle is, you know, effortful thinking, right?
• 21:33
  Greg Toppo (The 74): You know this is what school is about, right?
• 21:37
  Greg Toppo (The 74): This is you.
• 21:37
  Greg Toppo (The 74): This is basically practice for your brain.
• 21:40
  Greg Toppo (The 74): You know solving these problems, and I think if if we're relying on a technology just to get the student to the end of the assignment, then we've lost the narrative, and to assume that kids aren't going to do that is naive.
• 22:02
  Alex Kotran (aiEDU): Another reaction is well, if students are cheating, it's simply because the assignment isn't, it's out of date, um, and I think there was an assumption that this was just sort of a standard book report, but again in the, in the judge's uh denial of the preliminary injunction, so more was revealed about sort of the nature of the assignment.
• 22:24
  Alex Kotran (aiEDU): Um, my understanding is, uh, the student had to choose the topic, right, they were working in groups, so a lot of components that we would actually generally advise teachers, like how do you design uh assignments and work that is more meaningful to students?
• 22:39
  Alex Kotran (aiEDU): I mean, there was a lot of agency provided to students and it was also multifaceted and, interestingly, the teacher, the reason the student got such a bad score on that assignment was because, um, the it wasn't even the final assignment that was turned in, it was the, the research and the outline.
• 22:56
  Alex Kotran (aiEDU): Um, because I think the teacher's mindset was uh, there were a few different ways that they could present what they learned, and so, rather than grading everybody on just sort of like whether their PowerPoint was good or whether their report or their write-up was good, they were focusing on the process of gathering the knowledge, and so that's again something that we've, that's advice that we often give teachers is you have to focus less on the work product and more on the process.
• 23:24
  Alex Kotran (aiEDU): So could the assignment have been honed?
• 23:28
  Alex Kotran (aiEDU): Perhaps, but again, I find this an example of even when teachers and schools are doing everything right.
• 23:34
  Alex Kotran (aiEDU): Kids are crafty.
• 23:36
  Alex Kotran (aiEDU): I guess you should get maybe some points for trying, I think this was a little bit.
• 23:43
  Greg Toppo (The 74): Ham-handed.
• 23:43
  Greg Toppo (The 74): Yeah, I guess it was ham-handed, I think this was a little bit, um, ham handed.
• 23:45
  Alex Kotran (aiEDU): Yeah, I guess it was ham handed, I guess I guess there's also a concern that teachers that that and I think this is actually reality.
• 23:52
  Alex Kotran (aiEDU): I think some teachers are incredulous at the idea that students would cheat and so, rather than interrogate, this is actually Victor Lee's research out of Stanford and Victor's research, which I want to talk about.
• 24:03
  Alex Kotran (aiEDU): Victor Lee's research out of Stanford and Victor's research, which I want to talk about, by the way, found that incidents of cheating post-JETGBT have not increased and the hypothesis is that students are always going to use sort of like the latest tools to cheat, like when I was in high school, we had our lunchrooms or these round tables.
• 24:22
  Alex Kotran (aiEDU): And so you know, before our AP uh, european history class with Mrs Janini, um, we kind of had a pact where, like, at least one person would make would have the homework done and everybody would sort of pass the the sheet around and sort of like copy the answers Um, and you know that was sort of an old school, that was like pre uh, social media and, and you know, now students have Tik and other Copy and paste.
• 24:43
  Greg Toppo (The 74): Your early copy and paste.
• 24:53
  Alex Kotran (aiEDU): So I think part of the argument is that you know teachers are always going to.
• 24:55
  Alex Kotran (aiEDU): The worry is that teachers are taking it personally, that it's in front to them that students would cheat when researchers like Victor Lee would say you know teachers need to create learning experiences that students, you know, sort of inherently understand and connect with their own world.
• 25:12
  Alex Kotran (aiEDU): And that are meaningful Right.
• 25:17
  Greg Toppo (The 74): I love the word I've seen a number of instances around this the word artifacts, because I think that's a.
• 25:26
  Greg Toppo (The 74): To me it's a powerful word.
• 25:28
  Greg Toppo (The 74): It's like what are the artifacts you want as a teacher?
• 25:30
  Greg Toppo (The 74): Is it just you know?
• 25:33
  Greg Toppo (The 74): In Alex's history class, you just want you know eight questions answered and if everybody gets the right, you know, if everybody copies and pastes the right answer, then the work is done.
• 25:43
  Greg Toppo (The 74): Is that a satisfactory artifact?
• 25:46
  Greg Toppo (The 74): Or do you want a different kind of artifact?
• 25:49
  Greg Toppo (The 74): Do you want something where individualism is essential?
• 25:53
  Greg Toppo (The 74): So I think we're coming up against that in terms of what do teachers feel is like the satisfactory, um, uh, proof of learning and uh, I mean in a way like I, I hate to say this is a really interesting conversation for teachers to have and for parents to have and for students to have.
• 26:19
  Greg Toppo (The 74): So maybe, like all that, maybe this technology is really like forced, uh, forced that upon us.
• 26:24
  Greg Toppo (The 74): So let's do it, let's have that conversation.
• 26:27
  Greg Toppo (The 74): We certainly weren't having this conversation 10, 15 years ago, that's right.
• 26:32
  Greg Toppo (The 74): So in a way.
• 26:37
  Alex Kotran (aiEDU): Progress is upon us.
• 26:37
  Alex Kotran (aiEDU): Yeah and you covered the future of.
• 26:39
  Alex Kotran (aiEDU): Is it high school, the future of school?
• 26:41
  Greg Toppo (The 74): Future of high school.
• 26:42
  Alex Kotran (aiEDU): Future of high school or the future of school, Future of high school, Future of high school.
• 26:46
  Alex Kotran (aiEDU): I've been a part of a lot of conversations with folks and there's different sort of monikers for this.
• 26:53
  Alex Kotran (aiEDU): There's school transformation, reimagining education, reimagining schools, schools of the future and those conversations have been going on and you can attest to this, for decades, centuries for centuries and you know, as a nonprofit, as the head of a nonprofit, I spend more time than I care to admit, you know focusing on fundraising.
• 27:20
  Alex Kotran (aiEDU): And one of the phenomena in the education space, in K-12 specifically, has been a shrinking of the number of philanthropies and the amount of money that philanthropies are giving education, and in part because they're sort of throwing up their arms, they're just like we've been trying and we're just not seeing the results.
• 27:36
  Alex Kotran (aiEDU): it's just too hard and just there's.
• 27:38
  Alex Kotran (aiEDU): It's very multi-dimensional.
• 27:39
  Alex Kotran (aiEDU): You're trying to, you know, address math scores, but you know the schools that you're working in are dealing with, like you know, literally a hundred different other sort of connected issues, um, and I think philanthropy has been been having trouble sort of like pushing that forward.
• 27:54
  Alex Kotran (aiEDU): I think, you know, at a certain point people are just exasperated, not just the funders, but the stakeholders and the parents and all the folks that you need on board for this.
• 28:03
  Alex Kotran (aiEDU): And I'm curious if you see this.
• 28:06
  Alex Kotran (aiEDU): But from my vantage point, the powerful thing about artificial intelligence perhaps even more so than what it can do in the classroom and we can talk about sort of like what, how AI is going to transform the classroom but to me the bigger, uh, the bigger part of this moment is it has actually reinvigorated interest in this conversation about the future of school and suddenly it feels relevant, tangible and actionable.
• 28:33
  Alex Kotran (aiEDU): And you know, tangible and actionable.
• 28:37
  Alex Kotran (aiEDU): And conferences are selling out, and I think the challenge is how do we make sure that the conversation stays on this question of what is the future of school without moving too quickly to the answer of?
• 28:54
  Alex Kotran (aiEDU): Well, it's just AI, tutors and hyper-personalized learning and just throwing products, because, basically, I think the space has been inundated so quickly with generative AI products that and I'm curious for your take on this is AI products certainly a component, perhaps, of this conversation?
• 29:05
  Alex Kotran (aiEDU): How much of the conversation about the future of school is truly about the AI tools that we're going to use, as opposed to some of this more maybe philosophical or almost like the spirit, the conversation about what is the spirit of what we're actually?
• 29:19
  Greg Toppo (The 74): trying to achieve.
• 29:19
  Greg Toppo (The 74): That's a really good question.
• 29:21
  Greg Toppo (The 74): So I have many thoughts about this and I think, basically I think at the very base of this you're right there is a lot of interest in what this is going to do.
• 29:36
  Greg Toppo (The 74): I think people's imaginations in 2022 were really fired by this to your point, and now they're wondering okay, how is this going to apply to my kid's school?
• 29:47
  Greg Toppo (The 74): What could they possibly do with this?
• 29:49
  Greg Toppo (The 74): That will make a difference.
• 29:51
  Greg Toppo (The 74): I will say that it's probably a safe bet to say it's not going to make much of a difference, just in terms of basic achievement and NAEP scores.
• 30:03
  Greg Toppo (The 74): And we're already seeing just last week we saw the flood of terrible, disappointing, very bad, no good NAEP scores.
• 30:13
  Alex Kotran (aiEDU): Can you for our audience explain, naep?
• 30:16
  Greg Toppo (The 74): Sure National Assessment of Educational Progress.
• 30:18
  Greg Toppo (The 74): It's a test given in various forms every two years or so.
• 30:23
  Greg Toppo (The 74): It basically tracks fourth and eighth graders' reading and math skills and, as we're seeing now, five years out of the beginning of the pandemic, they're just not really recovering in a lot of ways and a couple of places they are Louisiana, I thought, was a really interesting outlier where their skills of those kids and I can't remember which group it was, but really defied sort of the expectations.
• 30:51
  Greg Toppo (The 74): But mostly, you know, we're in sort of a like a very kind of grim holding pattern and it's been like that since actually before the pandemic, since like 2019, I want to say Certainly the pandemic didn't help.
• 31:08
  Greg Toppo (The 74): So I don't think, on the one hand, it's going to really have much of an effect, these new tools, these new ways of thinking on that, because it feels like very little, if anything, has any effect on that.
• 31:23
  Greg Toppo (The 74): I'm not quite sure systemically, why, other than that, you know, I mean there are lots of people who would say you know well, you know we keep, we keep judging the, the standard for what it means to be basic and advanced, and so you know we're always chasing this, the standard that keeps incrementally increasing this standard that keeps incrementally increasing.
• 31:56
  Greg Toppo (The 74): But I think to me the really interesting question is is, like, what do we expect in terms of these tools?
• 32:08
  Greg Toppo (The 74): And like, how much of that are we expecting to be student facing?
• 32:11
  Greg Toppo (The 74): I would have thought at the beginning of all this two years ago that are we expecting to be student facing, right?
• 32:14
  Greg Toppo (The 74): I would have thought at the beginning of all this two years ago, two plus years ago, that it was going to be like all student facing, like we were going to just get, you know, tools that students are going to be using.
• 32:24
  Greg Toppo (The 74): You know, you know 24, seven, and there it's just going to be just this sort of amazing revolution of kids just interacting with the technology and just doing different things and different kinds of learning, and it's just going to be.
• 32:41
  Greg Toppo (The 74): You know, we can't predict it.
• 32:44
  Greg Toppo (The 74): I think to me what I'm seeing, which I didn't predict and that's just my lack of imagination is, to me, the most interesting piece of this is not the student facing stuff, it's the teacher facing stuff and the you know kind of, in some sense, the drudgery, in some sense figuring out what students should be doing at any given time, and that can be as basic as, like you know, predicting who's going to be absent, or you know, I mean, you're familiar with all these things.
• 33:31
  Greg Toppo (The 74): To me, those are the things I think we should really be paying more attention to.
• 33:37
  Greg Toppo (The 74): In a way, it's interesting because I talked to someone who said a couple of weeks ago, who said you know, ai is weird enough right now and it's so unpredictable that I think, until we, like figure out more about it and how it works and really what it does, I don't think we should put it in front of students at all.
• 33:57
  Greg Toppo (The 74): Let the adults mess with it, but students shouldn't have access to this.
• 34:06
  Alex Kotran (aiEDU): Anyway, I don't know how you feel about that.
• 34:07
  Alex Kotran (aiEDU): Well, there's this assumption that we are the AI education project, and so oftentimes I actually will often now start meetings with.
• 34:15
  Alex Kotran (aiEDU): This is what this meeting is not.
• 34:18
  Alex Kotran (aiEDU): We are not here to try to put AI in front of all of your students, or rather, we're not here to accelerate that process.
• 34:25
  Alex Kotran (aiEDU): There's, I think, a lot of questions that need to be answered in terms of how to do that appropriately, safely, but also in a way that complements rather than replacing education.
• 34:38
  Alex Kotran (aiEDU): I want to talk about an anecdote specifically where you're replacing teachers, or replacing, when you say, complements.
• 34:46
  Alex Kotran (aiEDU): That complements teachers.
• 34:46
  Alex Kotran (aiEDU): Okay.
• 34:47
  Alex Kotran (aiEDU): Yeah, but also that complements the learning process.
• 34:50
  Alex Kotran (aiEDU): I think, there is a world where you could imagine students.
• 34:55
  Alex Kotran (aiEDU): In fact, if you go to china, they actually I remember this.
• 34:57
  Alex Kotran (aiEDU): There's a picture that hit me really viscerally uh, it was students preparing for one of the big national exams in china and they had this giant like I don't think it was even a gymnasium, I think it was a warehouse, okay, and it was like 3 000 students in in cubicles with headphones on getting personalized learning.
• 35:14
  Alex Kotran (aiEDU): And it just hit me that, even if the scores are higher, the idea of just a student sitting down in front of a computer all day digesting information, there's something really wrong with that.
• 35:30
  Alex Kotran (aiEDU): And I see sort of flavors of that with this sort of obsession with AI tutoring.
• 35:37
  Alex Kotran (aiEDU): But it's complicated, right, because actually AI tutoring is still really exciting and interesting as an after school support, as a support for neurodivergent students or, uh, students in special education more broadly.
• 35:56
  Alex Kotran (aiEDU): Um, you're blind If you're an English language learner.
• 35:58
  Alex Kotran (aiEDU): Um, if you're deaf, right, this technology is sort of unequivocally going to add incredible value and, in sort of like, giving you access to learning that was otherwise, um, you know, much harder to access.
• 36:10
  Alex Kotran (aiEDU): So so it's very hard to say blanket, you know, ai bands, I think, ai bands, I think for that reason are um much harder to access.
• 36:13
  Alex Kotran (aiEDU): It's very hard to say blanket AI bans.
• 36:14
  Alex Kotran (aiEDU): I think AI bans for that reason are sometimes looked down upon.
• 36:18
  Alex Kotran (aiEDU): To me, if I was a superintendent, it would be more like we're going to pump the brakes.
• 36:22
  Alex Kotran (aiEDU): You described it really well.
• 36:24
  Alex Kotran (aiEDU): We need to understand this technology.
• 36:28
  Alex Kotran (aiEDU): We can't just rely on what the vendors are telling us.
• 36:32
  Greg Toppo (The 74): Outside of the vendors, I've talked to most of the smart people who are really obsessed with this question and most of the smartest people will admit that we don't have the answers yet and most of the vendors, by the way, in 12 months time, are going to be moving on to something else If they have any capital left.
• 36:50
  Greg Toppo (The 74): Yeah.
• 36:51
  Alex Kotran (aiEDU): Right, right, if they have any capital left, right, and so I think the but on the other, the challenges.
• 36:57
  Alex Kotran (aiEDU): Let's say we're superintendents, we're trying to design this high school of the future.
• 37:04
  Alex Kotran (aiEDU): Maybe we should do that.
• 37:06
  Alex Kotran (aiEDU): Let's put those hats on.
• 37:07
  Alex Kotran (aiEDU): Let's go through some of the decisions we have to make.
• 37:12
  Alex Kotran (aiEDU): So decision one we don't have any new budget.
• 37:17
  Alex Kotran (aiEDU): We have a technology line item.
• 37:20
  Alex Kotran (aiEDU): We've been spending it now on things like smart boards, uh, chromebooks for students.
• 37:24
  Alex Kotran (aiEDU): Um, we're keeping an eye on the.
• 37:27
  Alex Kotran (aiEDU): Uh, is it enet?
• 37:29
  Alex Kotran (aiEDU): E the government?
• 37:33
  Alex Kotran (aiEDU): Uh, there's a government subsidy for technology access.
• 37:36
  Alex Kotran (aiEDU): E-rate.
• 37:36
  Alex Kotran (aiEDU): Oh.
• 37:37
  Greg Toppo (The 74): E-rate.
• 37:37
  Alex Kotran (aiEDU): Yeah, we're keeping an eye on E-rate funding.
• 37:39
  Alex Kotran (aiEDU): We're worried that that might expire, so we don't have too many extra dollars to spend, but maybe some stuff we can move around.
• 37:45
  Alex Kotran (aiEDU): Okay, and the first decision is we need to send some sort of a letter to parents and students explaining whether or not students are allowed to use chat GPT One step short of writing an integrity policy, but what's sort of step one?
• 38:04
  Alex Kotran (aiEDU): Do we blanket ban while we figure it out, or do we encourage students to use it but ask them to be transparent about how they use it?
• 38:15
  Greg Toppo (The 74): I'll let you go first.
• 38:15
  Greg Toppo (The 74): I think you let everybody download DeepSeek onto their Chromebook and call it a day.
• 38:22
  Greg Toppo (The 74): This is a really good question, and for our audience.
• 38:28
  Alex Kotran (aiEDU): Deepseek is the language model that was released by a company in China.
• 38:33
  Alex Kotran (aiEDU): Two weeks ago now.
• 38:34
  Alex Kotran (aiEDU): Technically in December.
• 38:35
  Alex Kotran (aiEDU): There's an earlier version.
• 38:36
  Alex Kotran (aiEDU): Lots of privacy concerns there yeah.
• 38:40
  Greg Toppo (The 74): And it was built for cents on the dollar in comparison to.
• 38:45
  Alex Kotran (aiEDU): Reportedly, although there's actually some new reporting out.
• 38:47
  Alex Kotran (aiEDU): We'll come back to that.
• 38:48
  Greg Toppo (The 74): Yeah, we can come back to that.
• 38:49
  Greg Toppo (The 74): You know, my feeling is I don't think you send out a memo to everybody, to the parents and the kids.
• 38:58
  Greg Toppo (The 74): I think the first, to me, your first step, is you give teachers some time to play around with it and you really give them the opportunity to find a comfort level with it, find what is the most likely way they might employ it.
• 39:19
  Greg Toppo (The 74): Let them figure out what the risks are.
• 39:21
  Greg Toppo (The 74): I'm not saying it's like security, because I don't think most teachers know enough about that.
• 39:26
  Greg Toppo (The 74): You can read the 74 million to find out that, because we cover it really well.
• 39:31
  Greg Toppo (The 74): I, yeah, I think you start with that.
• 39:33
  Greg Toppo (The 74): I think you start with teachers just playing with it, and I really do mean playing.
• 39:42
  Greg Toppo (The 74): And I want to talk at some point about the parallels that I'm seeing with the reporting that I did 10, 12, 15 years ago on games and learning, um, because I see a lot of similarities, um with that and with with AI, um.
• 40:01
  Greg Toppo (The 74): But I think, I think you do, I think you let teachers mess around with it and see what pops out and maybe, as part of that, you require them or strongly suggest that they like get together, you know, once a week, once a month, and just let each other know.
• 40:18
  Greg Toppo (The 74): You know what the.
• 40:19
  Greg Toppo (The 74): You know what the coolest aspect of this is.
• 40:25
  Alex Kotran (aiEDU): OK, I'm in line with that.
• 40:26
  Alex Kotran (aiEDU): So we don't ban.
• 40:27
  Alex Kotran (aiEDU): In fact we just avoid that whole all the controversy around that by just not addressing it, because anyways the kids are going to access it out of school, they're going to access it on their phones.
• 40:37
  Alex Kotran (aiEDU): A ban only really makes sense if we feel confident that we can enforce it.
• 40:41
  Alex Kotran (aiEDU): And then the other thing that a ban does is it orients teachers to this defensive mode where, rather than focusing on learning the tool, they spend more time focusing on enforcement.
• 40:55
  Alex Kotran (aiEDU): I think my modification to what you're describing is and this is a plug this is the work that the IEDU does.
• 41:02
  Alex Kotran (aiEDU): We have cohorts of teachers and we facilitate those professional learning communities so that there's some structure.
• 41:11
  Alex Kotran (aiEDU): I don't think you need to work with nonprofits like us to to create those sandboxes, but I think it does help to have, you know, some subject matter experts who can sort of like sort of helpfully guide teachers towards, you know, some of the best, sort of like some proven ways to actually sort of like like some some scaffolds for their exploration.
• 41:33
  Alex Kotran (aiEDU): But the other reason I think that's important is you know, ultimately, what is likely happening in our district is teachers, and maybe even with the way we discovered.
• 41:44
  Alex Kotran (aiEDU): You know ChatGPT.
• 41:45
  Alex Kotran (aiEDU): I don't know that we were covering.
• 41:47
  Alex Kotran (aiEDU): You know, I guess as a superintendent we're not reading Wired, or you know MIT Tech Review, right, maybe we saw a headline about ChatGPT, but we probably before we actually got the chance to use it.
• 41:59
  Alex Kotran (aiEDU): My guess is, a teacher went to the lunchroom and was just like, look at Sally's paper.
• 42:05
  Alex Kotran (aiEDU): It looks like it was literally written by a college professor.
• 42:08
  Alex Kotran (aiEDU): And I asked her.
• 42:11
  Alex Kotran (aiEDU): You know, I confronted her about it and she showed me this crazy tool called chat GBT.
• 42:16
  Alex Kotran (aiEDU): Like check this out, and but it's with that frame of like students are using this to cheat and but I, but I think this idea of, I think as as a superintendent or a co-superintendent, my answer to those teachers who are like, well, how do we deal with this?
• 42:32
  Alex Kotran (aiEDU): It's like my answer to those teachers who are like, well, how do we deal with this?
• 42:34
  Alex Kotran (aiEDU): It's like you're trying to design a bank that is impervious to being robbed.
• 42:40
  Alex Kotran (aiEDU): It really helps to consult with a bank robber who is really thinking about how to do this.
• 42:48
  Alex Kotran (aiEDU): You have to get into the mind of somebody who is trying to cheat and the way to do that is, uh, you need to use it yourself.
• 43:00
  Alex Kotran (aiEDU): There is no sort of cheat code, unintended um, uh, or shortcut or rule that we can put in.
• 43:03
  Alex Kotran (aiEDU): Um, you're probably going to have to if not definitely going to have to adapt some of your assignments and you're not going to know how to adapt those assignments to be more resistant to cheating if you don't have a sense for how the tool could be used.
• 43:14
  Greg Toppo (The 74): Okay, I like that yeah.
• 43:15
  Greg Toppo (The 74): I'll go for that, Find the kids who are doing the most mischief with it and maybe even, you know, have a, have a some sort of like a regular round table or something we're actually doing that at one of the a couple of the upcoming conferences that we're doing, sessions that we're we're having teachers, I think we're literally calling them like cheat-a-thons.
• 43:38
  Alex Kotran (aiEDU): We're going to have some like oh you know, sort of like traditional assignments and we're like we're going to spend the next hour literally cheating on these assignments and we're going to show you how, uh, how, you could do it sort of get into the mind of a of a student.
• 43:48
  Alex Kotran (aiEDU): Have some students get involved in that?
• 43:50
  Alex Kotran (aiEDU): Um, how are there, you know, as this wise superintendent who is, who was around for the time of?
• 43:56
  Alex Kotran (aiEDU): Um, you know, gamified learning.
• 43:59
  Alex Kotran (aiEDU): What are those you mentioned?
• 44:01
  Alex Kotran (aiEDU): You saw some parallels there, like, how, like, can you just talk about that?
• 44:05
  Greg Toppo (The 74): yeah, I mean, you know, just like you're sort of suggesting here, I mean the, the, the place where 10, 15 years ago, um games and learning were the most interesting and where things were getting done that I found really exciting were places where an individual teacher, um had discovered something on their own, or had discovered something with a group of friends, or went to a conference and was like, oh my God, you've got to play this game or met some developer or became, you know, a couple of them actually became, like you know, game developers themselves, just literally teaching themselves how to build this stuff themselves, just literally teaching themselves, um, how to build this stuff.
• 44:58
  Greg Toppo (The 74): Um, and I, I, I loved the excitement around that, I, I and I also loved, um, what kinds of conversations were happening because of it?
• 45:08
  Greg Toppo (The 74): Because a lot of instances, um, instances when teachers discovered really good learning games, especially something like math, which is really easily adapted to a game, teachers were asking totally, totally different kinds of questions than they had been before then, totally, totally different kinds of questions than they had been before then.
• 45:34
  Greg Toppo (The 74): They were really, in a way, kind of like turning their curriculum inside out, because this one game or this couple of group of games had just basically asked them to say to themselves, like what is algebra Like?
• 45:51
  Greg Toppo (The 74): Why do we have algebra and what the heck is it?
• 45:54
  Greg Toppo (The 74): And there's one game in particular that I wrote about in my book.
• 45:59
  Greg Toppo (The 74): It was Dragon Box.
• 46:02
  Greg Toppo (The 74): I don't know if you're familiar with that, so this is by a French developer and it basically asked students to kind of like almost like invent algebra from the ground up and almost like discover, like, what X is and what X plus one equals Y is.
• 46:24
  Greg Toppo (The 74): So really just kind of like I said, just turned everything inside out.
• 46:30
  Greg Toppo (The 74): When you have students doing that, when you have teachers getting excited about that, it's a totally different kind of conversation than why can't my kids do algebra, why aren't they interested in algebra.
• 46:40
  Greg Toppo (The 74): And I see the possibilities for that kind of thing with something like AI.
• 46:50
  Greg Toppo (The 74): If students can come at a math problem from a totally different point of view or do different kinds of problem solving, then I think we're really in a different place.
• 47:09
  Greg Toppo (The 74): And you've probably experienced some of these things.
• 47:14
  Greg Toppo (The 74): I mean you've probably seen teachers, you know, looking at some of these tools and getting, you know, pretty excited.
• 47:21
  Greg Toppo (The 74): I mean the easy way to do it is just to ask chat GPT to, or the easy and stupid way to do it is just to ask chat GPT to.
• 47:30
  Greg Toppo (The 74): You know, give me 10 algebra problems, right, but there are other ways to, to, to recruit these tools, to do, I think, much more fascinating, much more fascinating things.
• 47:44
  Alex Kotran (aiEDU): Yeah, the, the.
• 47:45
  Alex Kotran (aiEDU): So I'm going to sort of draw out from what you're saying that stands in contrast to you know, presumably there were lots of companies approaching districts and saying here is a you know gamified learning product.
• 48:00
  Alex Kotran (aiEDU): Can I improve your math scores?
• 48:03
  Alex Kotran (aiEDU): You should put it in front of every single teacher.
• 48:05
  Alex Kotran (aiEDU): And my guess is that those districts, as is often the case with new curriculum, they encountered a lot of pushback from teachers.
• 48:13
  Alex Kotran (aiEDU): It worked in some classes didn't work in others and so, as we.
• 48:21
  Alex Kotran (aiEDU): The challenge is this is like it'd be really nice if the answer to this question of like, how does AI going to transform learning?
• 48:27
  Alex Kotran (aiEDU): If it's just like, well, you just give teacher, you know, just have teachers use AI to do X Y Z.
• 48:32
  Alex Kotran (aiEDU): They're going to have more time, they're going to use it to personalize learning in X Y Z ways, and then your goal is just get that in front of every single teacher, train them on how to use it exactly in that way and something that's repeatable, prescriptive.
• 48:47
  Alex Kotran (aiEDU): And for districts like Prince George's County, where we're just up the street from here, where we're doing work, they have 10,000 teachers.
• 48:56
  Alex Kotran (aiEDU): I suspect that the answer to the best outcomes in terms of how AI will transform education is similar to what you're describing, where you create the conditions for teachers to hyper-c, hyper, customize and explore and use it as a, as a force multiplier with their own spin.
• 49:19
  Alex Kotran (aiEDU): And I guess the challenge for for superintendent for schools, for school leaders, is you know, for PGCPS, they have 10,000 teachers.
• 49:27
  Alex Kotran (aiEDU): You know you start with the sandbox, that learning community of 50 teachers, but you really want this to get to every classroom and, in fact, if you have a mind for, you know, reaching the kids who are at risk, or most at risk, of falling behind.
• 49:44
  Alex Kotran (aiEDU): They're very often in some of the lowest performing schools that really struggle to retain the brightest teachers.
• 49:50
  Alex Kotran (aiEDU): Is there anything whether it's from your time in sort of like gamified learning, but is like how can this sort of get into the bloodstream?
• 50:00
  Alex Kotran (aiEDU): Like what are the conditions, for I guess the way to describe this would be it's almost like what is your understanding of some of the best ways to build and enhance, like the teacher workforce, and upskill them in the ways that they need to explore and understand and iterate on the technology in their own way.
• 50:26
  Greg Toppo (The 74): I have a couple of thoughts, by the way, and I'll just preface this by saying I think a lot of people in the games and learning space would take exception to your use of the word gamified.
• 50:37
  Greg Toppo (The 74): They would say that gamification is kind of a lesser form of what they're doing.
• 50:43
  Greg Toppo (The 74): They're actually using games at a higher level than just getting people to behave a certain, to sort of behavior, behave a certain way.
• 50:54
  Greg Toppo (The 74): They.
• 50:55
  Greg Toppo (The 74): They would say that gamification is a little too low level.
• 50:58
  Greg Toppo (The 74): I don't want to spend much of our time talking about that, but I know it's interesting.
• 51:04
  Greg Toppo (The 74): You, you use a phrase a second ago get into the bloodstream, and I guess I would, maybe without with your permission, maybe explore that a little bit.
• 51:15
  Greg Toppo (The 74): So you're talking about, like a virus getting into the bloodstream, something being viral.
• 51:25
  Greg Toppo (The 74): I mean, why are things viral?
• 51:28
  Greg Toppo (The 74): In the sort of social sense?
• 51:30
  Greg Toppo (The 74): They're viral because somebody's really excited about it, or it's new or different or weird, or just, you know, getting something done in a way that, um, we've never seen before, um, and so people get excited about it.
• 51:46
  Greg Toppo (The 74): I'm not sure where you go from there, um, but I do see almost like the necessity of getting people excited, and maybe it's just one big natural experiment where the people who are excited about something test it out and try it out and have a certain amount of success and the vast majority don't have access to it and either their results aren't as good or they're.
• 52:19
  Greg Toppo (The 74): Maybe their teacher satisfaction isn't as high, or um, you know, I, I, I I'm not familiar enough with sort of the ways systems like these work to be able to say, yeah, this is all you need to do is just you, you know.
• 52:34
  Alex Kotran (aiEDU): Well, I think even the deepest experts in teacher professional learning would struggle to answer this question right.
• 52:40
  Alex Kotran (aiEDU): There is no quick fix.
• 52:42
  Alex Kotran (aiEDU): It's the challenge, this idea of like the components of virality.
• 52:48
  Alex Kotran (aiEDU): It has to catch people's attention.
• 52:52
  Alex Kotran (aiEDU): In education.
• 52:53
  Alex Kotran (aiEDU): You know there's.
• 52:54
  Alex Kotran (aiEDU): If something works, presumably you know that is the type of thing that teachers are going to be talking about.
• 53:00
  Alex Kotran (aiEDU): If something doesn't work, or for whatever reason they're perceiving that it doesn't work, then they're going to.
• 53:07
  Alex Kotran (aiEDU): They're going to resist and also they're just in many ways, especially if a teacher of like 10 plus years they're on cruise control, they've been teaching this class it really is going to take something profound for them to change course.
• 53:17
  Alex Kotran (aiEDU): It's a lot of work.
• 53:19
  Alex Kotran (aiEDU): You have your script, your lectures down pat, you have the homework assignments.
• 53:27
  Alex Kotran (aiEDU): It's not trivial, even if something is pretty good.
• 53:33
  Alex Kotran (aiEDU): I do see.
• 53:40
  Alex Kotran (aiEDU): The lever is this idea of if you find the right teachers, they actually can be catalysts.
• 53:42
  Alex Kotran (aiEDU): I think I bought into that.
• 53:43
  Alex Kotran (aiEDU): I'd be curious.
• 53:44
  Alex Kotran (aiEDU): You know we don't have to answer this now, but I think one of our wonderings if you come across anything like this in terms of you know analogs that we can find where really successful whether it's curricula or teaching practices, project-based learning we're big proponents of that.
• 54:05
  Alex Kotran (aiEDU): Most of our curriculum is PBL or inquiry-based learning.
• 54:10
  Alex Kotran (aiEDU): A lot of the schools that we work with have struggled mightily to get project-based learning into the classroom.
• 54:14
  Alex Kotran (aiEDU): And.
• 54:14
  Alex Kotran (aiEDU): I think the answer in part is because they just have project-based learning is sometimes perceived to be at odds with, like, the standards and all the content knowledge and the rigor that teachers are expected, and so their teachers are getting these conflicting messages where they're being told you need to have more project-based learning.
• 54:31
  Alex Kotran (aiEDU): And then they're also.
• 54:31
  Alex Kotran (aiEDU): Their salaries, in some cases, are literally determined by how their students are scoring on these sort of like very rigid standards.
• 54:37
  Alex Kotran (aiEDU): Okay, being a superintendent is really hard, so I think this is our chance to take off those hats.
• 54:45
  Alex Kotran (aiEDU): Thank, God.
• 54:46
  Alex Kotran (aiEDU): Okay.
• 54:48
  Greg Toppo (The 74): So I don't have to be a superintendent anymore.
• 54:49
  Greg Toppo (The 74): Okay, good, no, not anymore.
• 54:52
  Alex Kotran (aiEDU): Put your journalist hat back on.
• 54:53
  Alex Kotran (aiEDU): There's so much happening right now in ai.
• 54:59
  Alex Kotran (aiEDU): What are the stories that you're just keeping an eye on?
• 55:01
  Alex Kotran (aiEDU): I'm especially interested if you're willing, anything that you maybe haven't covered yet but that you're, you know, just trying to learn more about, that we could sort of like dive into sure, I'm actually going to be um and this is not a self-promotional plug, but what the heck um at by Southwest.
• 55:15
  Greg Toppo (The 74): I'm going to be doing a panel with folks from Curriculum Associates and Khan Academy about AI and assessment, and that's one of the things that I think is really interesting about AI's potential to mess with assessment and improve it and make it I mean, the word I would use would be more invisible.
• 55:47
  Greg Toppo (The 74): I wrote a story a couple of months ago about curriculum associates buying this Irish startup that has developed speech recognition for kids, and it seems like a minor thing, but I think it's kind of huge in a way, because you know, it's one thing for you know an eight-year-old or nine-year-old to be able to ask Alexa, you know to.
• 56:15
  Greg Toppo (The 74): You know play a song or turn on the lights or whatever, but imagine a three or four year old being able to do that.
• 56:23
  Greg Toppo (The 74): You know, I actually have a personal experience with that.
• 56:27
  Greg Toppo (The 74): I've got a three and a half year old grandson who has figured out how to very clearly ask Alexa to do stuff, but I think that's rare, and so they have developed essentially a way to help with AI, help computers understand the utterances of very small children, and this is.
• 56:49
  Greg Toppo (The 74): You know, it doesn't take much imagination to think like, okay, if I'm a preschool teacher or kindergarten teacher, you know, this really revolutionizes, um, what I can do with instruction, because I can sit a an entire class down and just have them read into a, you know, a tablet or a microphone or what have you.
• 57:11
  Greg Toppo (The 74): And, um, you know on their own by the way, and that, you know, not even in the presence of a teacher, just have them, you know, open up a passage and read it and have the AI, you know, assess how well this kid is reading.
• 57:26
  Greg Toppo (The 74): In a way, that's one of the examples of to me I was going back to something we were talking about earlier like that's not really student-facing AI.
• 57:38
  Greg Toppo (The 74): In a sense, it's AI for the teacher's sake, and I think that's a really exciting aspect of this, and I think, you know, if you want to talk about force multipliers, I think that could be really cool and I'm excited about, like, the ways in which technology can play with assessments in other ways, you know, maybe make them absolutely invisible.
• 58:13
  Greg Toppo (The 74): Maybe, you know, take, let's say, work a student is doing already in class and has already swallowed up all the responses you've just offered over the course of a week or a month or a unit, or what have you?
• 58:45
  Greg Toppo (The 74): Getting back to the games piece, this is what games do, right?
• 58:49
  Greg Toppo (The 74): Games assess you constantly, all the time, from the you know minute one to the end of the game, right?
• 58:59
  Greg Toppo (The 74): That's one of the things people love about games.
• 59:02
  Greg Toppo (The 74): Right, they're constantly being assessed, but in a way that is invisible and I think.
• 59:09
  Greg Toppo (The 74): I think with AI we have the potential to do that in a way we'd never have before.
• 59:15
  Greg Toppo (The 74): Again it's not student-facing, it's totally teacher-facing right, but it does something we couldn't do before.
• 59:24
  Greg Toppo (The 74): You're skeptical.
• 59:28
  Alex Kotran (aiEDU): Well, I'm not skeptical.
• 59:29
  Alex Kotran (aiEDU): I just imagine the perfect iteration of this, where you'd probably get the best outcomes from the perspective of like, accurately assessing students, would be to embed AI and obviously the students Chromebooks, every single homework assignment.
• 59:47
  Alex Kotran (aiEDU): You know, if they have access to some kind of a chat bot or a tutor, that data is all digested.
• 59:52
  Alex Kotran (aiEDU): There's probably like the classrooms, maybe with video as well.
• 59:56
  Alex Kotran (aiEDU): And let's just assume, let's take for granted, that we've absolutely solved the privacy aspect.
• 1:00:02
  Alex Kotran (aiEDU): Right, the data is anonymized.
• 1:00:03
  Alex Kotran (aiEDU): So my skepticism doesn't come from a space of like oh, data privacy.
• 1:00:07
  Alex Kotran (aiEDU): But in this world, presumably we wouldn't just use it for an individual class, the students.
• 1:00:19
  Alex Kotran (aiEDU): You could use the same approach to evaluate the student over the course of their entire year and then over the course of their entire academic career, and perhaps we don't need college exams or perhaps we don't need SATs or college applications colleges.
• 1:00:35
  Alex Kotran (aiEDU): But in that world it's kind of like the sorting hat You're told.
• 1:00:43
  Alex Kotran (aiEDU): Here are the three colleges that you can choose from.
• 1:00:50
  Greg Toppo (The 74): I understand what you're saying.
• 1:00:52
  Greg Toppo (The 74): It feels like you're getting ahead of yourself.
• 1:00:53
  Alex Kotran (aiEDU): So I'm absolutely getting ahead of myself.
• 1:00:56
  Alex Kotran (aiEDU): I don't know if that's 10 years away, 20 years away.
• 1:00:58
  Alex Kotran (aiEDU): I do think that it's, it's, it's it feels inevitable and it's it's sort of like we just have to make a choice as society, that that's the direction we're comfortable going down.
• 1:01:10
  Alex Kotran (aiEDU): And if not, I suppose and the question is simply, how do we build in a sufficient amount of student agency?
• 1:01:18
  Alex Kotran (aiEDU): And I think we've done similar things in the space of using AI to screen resumes, I think, at least in many places, even though you, theoretically we don't use any AI to screen our resumes, even though we clearly could, because we just made this decision, so sort of like a normative decision about um not wanting to surrender that process to to the ai um, I just, I just wonder if, like, are we sleepwalking into sort of this world where you know students are sort of just?
• 1:01:52
  Alex Kotran (aiEDU): I mean, there's the, uh, the ayn rand book, um, where everybody's sort of just told what their job is, and I just know your take that's just so far out, it's yeah, you went very dark very fast with what I was saying.
• 1:02:05
  Alex Kotran (aiEDU): I guess I was just envisioning and I think a lot of people are envisioning just a just a more seamless transition from work and thinking to um assessment product um, so I guess is there because maybe, then maybe the answer is um, there's some amount of this, like because I assessments are clearly need to be changed, right, so, like the alternative, the flip side of this is the current assessment regime does not work it works in a certain way, and that's how it works.
• 1:02:40
  Greg Toppo (The 74): Some of it's great and some of it's terrible.
• 1:02:43
  Alex Kotran (aiEDU): Maybe assessments.
• 1:02:44
  Alex Kotran (aiEDU): It's not that they do not work, but there's a lot of room for improvement in assessments.
• 1:02:47
  Alex Kotran (aiEDU): There seems to be a middle ground where we use technology to improve and enhance and address some of the gaps that exist in the education system and maybe we just need to be sort of forward thinking about where do we need to sort of draw the line.
• 1:03:07
  Greg Toppo (The 74): Yeah, no, I would say that I guess maybe the thing I'm proposing is a little different.
• 1:03:12
  Greg Toppo (The 74): Maybe I'm not describing it very well.
• 1:03:14
  Greg Toppo (The 74): My feeling is that the best assessment is one that you don't even know just happened that, um, you are assessed on something because you've been working on it, let's say all day or all week, and, uh, at a certain point the system has enough information about what you know and how well you know it that we're done.
• 1:03:40
  Greg Toppo (The 74): We're done here.
• 1:03:40
  Greg Toppo (The 74): Very much again like a game.
• 1:03:43
  Greg Toppo (The 74): Right, there's that great quote by Jim G, who's a sort of game scholar.
• 1:03:48
  Greg Toppo (The 74): He says if I get through every level of Halo, this is going back 10, 15 years if I get through every level of Halo.
• 1:03:56
  Greg Toppo (The 74): This is going back, you know, 10, 15 years If I get through every level of Halo.
• 1:03:58
  Greg Toppo (The 74): You don't need to give me, like, a Halo final exam.
• 1:04:00
  Greg Toppo (The 74): Like I got through every level, I'm done, I mastered the game right.
• 1:04:06
  Greg Toppo (The 74): There's no like final test and I think that's I think, what a lot of people are envisioning Now, whether that's got you know necessarily, you know Ayn Rand implications to it, because you know the student isn't choosing to sit for an exam.
• 1:04:26
  Greg Toppo (The 74): That's another really interesting question.
• 1:04:29
  Greg Toppo (The 74): But I guess I'm not quite there yet.
• 1:04:32
  Greg Toppo (The 74): I'm just thinking of, like, what is the process we were able to just knock out and what can we replace it with?
• 1:04:43
  Alex Kotran (aiEDU): Yeah, I think you've convinced me that I am.
• 1:04:45
  Alex Kotran (aiEDU): This sort of catastrophizing is maybe valuable for futurists Totally, but actually I think I can also imagine the flip side, where 10, 15 years from now, people are like there was a time when you spent all the time in school and you did all this work and none of that mattered.
• 1:05:05
  Alex Kotran (aiEDU): All that mattered was just the score you got on this one test on one day, and if you happen to be sick or if you happen to be having a bad day didn't matter.
• 1:05:13
  Greg Toppo (The 74): Or if it was a bad test and oh, by the way, some of these tests are not very good yeah, um, and so, yeah, I, I think, I think there's a lot of, there's a lot of power.
• 1:05:24
  Alex Kotran (aiEDU): Then there's all the other piece about, um, sort of uh, recognition, like sort of natural language processing, um, one of the things that people have been saying about.
• 1:05:35
  Alex Kotran (aiEDU): Well, assessment, assessments need to change.
• 1:05:38
  Alex Kotran (aiEDU): Homework needs to change.
• 1:05:39
  Alex Kotran (aiEDU): You know, we need to do more oral assessments.
• 1:05:41
  Alex Kotran (aiEDU): Right, and teachers will often kind of be a little bit they'll scoff at that because they're like I just don't have the time.
• 1:05:46
  Alex Kotran (aiEDU): Yeah, it's, I just like, like homework is efficient because people are doing it simultaneously as opposed to like once at a time.
• 1:05:53
  Alex Kotran (aiEDU): Um, so this is perhaps an example of a problem that AI can actually, a problem that AI perhaps created, but that it can also help to solve.
• 1:06:03
  Alex Kotran (aiEDU): I don't generally think that about every single problem AI creates, but I think this is this might be one of them.
• 1:06:06
  Alex Kotran (aiEDU): It is a bit challenging.
• 1:06:09
  Alex Kotran (aiEDU): When have you seen that this has been?
• 1:06:11
  Alex Kotran (aiEDU): I think it's one specific person, but there's probably, I think probably more than one on social media applying for management consulting interviews.
• 1:06:20
  Alex Kotran (aiEDU): And he has his setup where he has chat GBT live transcription of all the questions that he's getting and then it's answering the question and he's reading it aloud and literally doing the interview, acing these interviews with the help of his chat GBT module.
• 1:06:33
  Alex Kotran (aiEDU): That's great doing the interview, like acing these interviews um with the help of his sort of like chat GPT module.
• 1:06:35
  Alex Kotran (aiEDU): That's great.
• 1:06:37
  Greg Toppo (The 74): That's great, but yeah, that's amazing.
• 1:06:39
  Greg Toppo (The 74): Um, yeah, I, you know, um, I guess I am of the opinion that um and I and I I'm sure there's research on this, maybe you can even cite it now but there's a lot of wasted time in school.
• 1:06:53
  Greg Toppo (The 74): It now, but there's a lot of wasted time in school and I think the product of that is disengagement on the part of kids and dissatisfaction on the part of teachers.
• 1:07:02
  Greg Toppo (The 74): So, if there's a way to to close that gap or not gap, but there's a way to, to, to, to get rid of some of that wasted time and you know, and use it for something much more interesting I'm not going to say productive but, then I think that's a really interesting possibility.
• 1:07:25
  Alex Kotran (aiEDU): Yeah, teacher retention is increasingly.
• 1:07:27
  Alex Kotran (aiEDU): I don't know if it's getting worse, but it's certainly really bad right now.
• 1:07:31
  Alex Kotran (aiEDU): Yeah, right now, Um, you wrote a story a couple of weeks ago about um, uh, a survey that had come out.
• 1:07:43
  Alex Kotran (aiEDU): It was serving, uh, uh, teacher schools of education.
• 1:07:46
  Alex Kotran (aiEDU): Um, and I forget these specific numbers, but it was startlingly few colleges of education have any kind of a formal curriculum or approach to talking to teachers about language models or generative AI, let alone actually teaching them anything, and I was curious if any follow-ups on that have you.
• 1:08:09
  Greg Toppo (The 74): No, I haven't but.
• 1:08:09
  Greg Toppo (The 74): But.
• 1:08:09
  Greg Toppo (The 74): But to me that you know, on the one hand I would say it's not a surprise Because I think a lot of teachers' colleges, a lot of teacher education programs are just, you know, they're kind of trapped in the past.
• 1:08:30
  Greg Toppo (The 74): They're kind of trapped in the past.
• 1:08:42
  Greg Toppo (The 74): I don't think they've got much incentive to do something new and different and innovative, and some of them probably with good reason, because they're being asked to turn out a certain kind of product.
• 1:08:49
  Greg Toppo (The 74): Stepping back a little bit from that, I would say I'm not sure if it's the job of a teacher's college to teach a, you know, a 23 year old about artificial intelligence.
• 1:09:04
  Greg Toppo (The 74): I mean, we're all learning about it on our in our spare time and you know, and you know over breakfast, and you know like it's to me it's it's kind of a in a way it's sort of like a responsibility that we all have, um, just to you know, just to like.
• 1:09:23
  Greg Toppo (The 74): We follow politics and the weather and you know climate and culture and music and all the rest.
• 1:09:29
  Greg Toppo (The 74): Um feels like this is just another thing we should all be kind of learning about at a very basic level.
• 1:09:36
  Greg Toppo (The 74): My kids are interested in it.
• 1:09:38
  Greg Toppo (The 74): They're by no means like technically savvy, they just think it's an important thing to learn about.
• 1:09:44
  Greg Toppo (The 74): So I don't know, I don't want to say I give teachers, colleges a pass, I just think it's just something it's in the air.
• 1:09:57
  Greg Toppo (The 74): So it seems reasonable to expect that young people just figure this stuff out at a certain basic level, not, you know, saying they don't need to learn all the ins and outs, but they certainly need to know how it's used and what it is and the difference between the models, et cetera, et cetera, et cetera.
• 1:10:17
  Alex Kotran (aiEDU): And this is we recently, over the past like two years, we started shifting from talking about AI literacy to AI readiness, and that insight, I think, is sort of part of the reason behind that, sort of part of the the reason behind that, and is this idea that, you know, when I close my eyes and try to look into the future, um, yeah, I see a world where ai is just, it's so ubiquitous and seamless and invisible.
• 1:10:45
  Alex Kotran (aiEDU): Um, it just seems it'll feel very like quaint that we would have to teach people how to use it.
• 1:10:51
  Alex Kotran (aiEDU): In the same way that my guess is that teacher colleges, um, you know, 20 years ago, didn't have a class called like the internet, right?
• 1:10:59
  Greg Toppo (The 74): Um, how do you use your?
• 1:11:00
  Greg Toppo (The 74): How do you use your iPhone?
• 1:11:02
  Greg Toppo (The 74): How do you use your?
• 1:11:02
  Greg Toppo (The 74): I know, I think that's exactly right.
• 1:11:04
  Alex Kotran (aiEDU): Mobile is even a better example, because that was, you know, the early internet was actually kind of how to use your phone.
• 1:11:13
  Alex Kotran (aiEDU): Um, and and teachers, colleges actually have a lot of important work to do, which is how do you build those durable skills, which is when we talk about AI readiness.
• 1:11:24
  Alex Kotran (aiEDU): Sure, ai literacy is a part of it.
• 1:11:25
  Alex Kotran (aiEDU): We're assuming that that's actually going to be.
• 1:11:27
  Alex Kotran (aiEDU): Maybe one of the easiest parts is like teaching people about what AI is, and how to use it.
• 1:11:31
  Alex Kotran (aiEDU): Um, the more important pieces of like building agency, critical thinking and those sort of soft and hard skills that you know.
• 1:11:38
  Alex Kotran (aiEDU): I think most teachers, whether they realize it or not, they are.
• 1:11:42
  Alex Kotran (aiEDU): They like they have the knowledge and skills to get kids ready for the future.
• 1:11:46
  Alex Kotran (aiEDU): I just don't know that you know, 21st century skills has kind of been it's been talked, was it's been.
• 1:11:53
  Alex Kotran (aiEDU): It's been talked about so much that I think it sort of lost its its punch.
• 1:11:56
  Alex Kotran (aiEDU): I, I my my big sort of like scheme is this is our chance to sort of reinvigorate 21st century skills and sort of almost like reframe it, as, as you know, ai is really just another way of talking about a 21st century skills.
• 1:12:08
  Alex Kotran (aiEDU): Yeah.
• 1:12:09
  Greg Toppo (The 74): I mean, I think in a way to me I don't know what, as I think about it, like how I use AI in like my daily life.
• 1:12:14
  Greg Toppo (The 74): You know I'm by no means like a technophile.
• 1:12:18
  Greg Toppo (The 74): You know I'm interested in it and I like to kind of think about it and explore it.
• 1:12:22
  Greg Toppo (The 74): But you know, in terms of like being a journalist like to me the most I mean, once you dig in and start looking at these different models, you know what's caught.
• 1:12:34
  Greg Toppo (The 74): Or or chat, GPT, or any of the other ones.
• 1:12:36
  Greg Toppo (The 74): Google, the Google one, fascinating, you know that came out a couple of months ago.
• 1:12:40
  Greg Toppo (The 74): You know that allows you to create these crazy little 10 minute podcasts notebook.
• 1:12:46
  Greg Toppo (The 74): LM.
• 1:12:46
  Greg Toppo (The 74): We had a lot of fun with that, not only in my house but at work.
• 1:12:52
  Greg Toppo (The 74): We were just we were playing with feeding our news stories into it and just seeing what it created.
• 1:12:59
  Greg Toppo (The 74): So once you get past that, the sort of basic literacy with that, and knowing what these things do and what they don't do and how one is different than the other, then to me the big challenge and I'd be interested in hearing your take on this is keeping them at arm's length.
• 1:13:25
  Greg Toppo (The 74): I think that's really maybe the most important skill of all, and what I mean by that is like I would never use one of these models, certainly to write a story, okay, that's like verboten, okay, and I would never feel comfortable doing that, right, um, I wouldn't even feel comfortable like taking like a report.
• 1:13:51
  Greg Toppo (The 74): Let's say you know some government agency you know sends out a PDF of a report.
• 1:13:55
  Greg Toppo (The 74): Um, like a report.
• 1:13:55
  Greg Toppo (The 74): Let's say you know some government agency you know sends out a PDF of a report.
• 1:13:59
  Greg Toppo (The 74): I wouldn't even feel comfortable asking Claude to like summarize this report because, like I, you know, I, who the hell knows what Claude's process is in doing this in a way, like you want to, you almost want to do, you know, like a kind of like a test of it.
• 1:14:19
  Greg Toppo (The 74): You know, you want to take something that you know really well inside and out and ask these models to summarize it and then just see, you know what it's, what it's going to tell you.
• 1:14:33
  Greg Toppo (The 74): So I, I really feel like, um, there's, there's almost no way in which, like, relying on these models for something with any stakes um, is a good idea for me.
• 1:14:49
  Greg Toppo (The 74): Yeah, no, I others may others may differ.
• 1:14:52
  Greg Toppo (The 74): Um, I would, but I feel like, at this point, february 2025, this may change in March or April but I feel like the place of something like AI is very low-stakes territory.
• 1:15:11
  Greg Toppo (The 74): I'm curious about something.
• 1:15:14
  Greg Toppo (The 74): I want to see something.
• 1:15:15
  Greg Toppo (The 74): Territory, right, I just want to.
• 1:15:17
  Greg Toppo (The 74): I'm curious about something, I want to see something.
• 1:15:19
  Greg Toppo (The 74): I want to get the, you know, the AI's take on something, but I'm not going to rely on it in any way, shape or form, and I don't know if that where that comports with your conception of this stuff, but I, you know it's just, it's almost like a as a journalist, I think stuff, but I, you know, it's just, it's almost like a.
• 1:15:39
  Greg Toppo (The 74): As a journalist, I think, um, I have a kind of an like an allergy to relying on this stuff for for something that really matters well it does.
• 1:15:47
  Alex Kotran (aiEDU): The challenge is that it's uh, um, it's really good in some, in some cases, Um, and you are a journalist with integrity who has respect for the craft, but I think I don't know the study that it was.
• 1:16:03
  Alex Kotran (aiEDU): I think this is very hard to actually put a put a number on Um, but there's a large portion of the content now on the internet as AI generated and if you go and read any sort of like the, just like sort of clickbaity, SEO optimized blog posts like a lot of that is AI generated.
• 1:16:23
  Alex Kotran (aiEDU): I know ad agencies are using AI to write things like ad copy.
• 1:16:26
  Alex Kotran (aiEDU): Like if you're doing programmatic ads, you now can not just do an ABC test, you can do ABCD, efg, all the way, like 300, 10,000 hyper personalized um.
• 1:16:38
  Alex Kotran (aiEDU): But then there's like certain very specific uh uh applications where you know quality is not necessarily the measure, there isn't necessarily like sort of an integrity aspect and you're not necessarily even as concerned about accuracy, yeah, um.
• 1:16:51
  Alex Kotran (aiEDU): So setting those aside, um, I worry more about what you just described.
• 1:16:58
  Alex Kotran (aiEDU): So, if you're reading a report and you're going to write about it, the way to really be able to write intelligently about something and add value beyond just all the noise because we're in a world now where they're just like everybody has something to say about everything and it's mostly service, service level to actually add value, you have to really like deeply understand the thing that you're writing or talking about, and I just do not think there is any substitute.
• 1:17:21
  Alex Kotran (aiEDU): I was talking to one of my board members.
• 1:17:23
  Alex Kotran (aiEDU): She's she's a corporate lawyer.
• 1:17:25
  Alex Kotran (aiEDU): Um, she has her own, uh, consultancy now, um, and so she advises.
• 1:17:30
  Alex Kotran (aiEDU): You know really big, you know blue chip clients and she gets tapped to speak at these.
• 1:17:33
  Alex Kotran (aiEDU): They're like, they're esoteric, um, you know legal conferences.
• 1:17:38
  Alex Kotran (aiEDU): So she was like, I think, doing a conference on, um, you know financial services, uh, you know policy in in brussels and like, oh, I've got this like keynote tomorrow.
• 1:17:50
  Alex Kotran (aiEDU): It's presentation.
• 1:17:51
  Alex Kotran (aiEDU): I have to make all these slides.
• 1:17:52
  Alex Kotran (aiEDU): I have to like down, digest this like 70 page um regulation or something I was like well, perfect use case for ai.
• 1:18:00
  Alex Kotran (aiEDU): Why don't you use ai to summarize it?
• 1:18:01
  Alex Kotran (aiEDU): I hadn't even gone to the place where I was still sort of taking for granted that people that ai was good at summarization.
• 1:18:06
  Alex Kotran (aiEDU): I have since found that it actually hallucinates maybe 20 of the time whenever I ask it to summarize.
• 1:18:11
  Alex Kotran (aiEDU): And so, setting that aside the fact that that just incorrect, you should never use it to summarize if you're trying to like accurately reflect what's in a report.
• 1:18:19
  Alex Kotran (aiEDU): But let's just assume that, even if it was a hundred percent accurate, her point was my like process for preparing to go and speak and the reason I'm tapped to speak is not because I have I'm reading off of a like a series of bullet points or talking points that I've memorized.
• 1:18:34
  Alex Kotran (aiEDU): I actually am going up and like speaking as an authority figure and the only way that I'm going to be able to like speak authoritatively and intelligently about this topic, like the process of actually reading those 70 pages and like writing out everything that I want to say, like that's how I get to a place where I'm ready to go and speak off the cuff, and my experience with writing has been absolutely like that's how I get to a place where I'm ready to go and speak off the cuff, and my experience with writing has been absolutely.
• 1:19:00
  Alex Kotran (aiEDU): I just wrote something on deep seek on sub stack and I used it.
• 1:19:03
  Alex Kotran (aiEDU): Actually, I will admit I use chat duty quite a lot and the way I used it was I downloaded, I watched a lot of.
• 1:19:09
  Alex Kotran (aiEDU): There's a lot of good YouTubers who had sort of like done like much deeper, longer, like a lot of the coverage was like you know, a thousand words.
• 1:19:17
  Alex Kotran (aiEDU): It's like hard to get into the, into the weed, so I wouldn't watch like hour long YouTube videos, got the transcripts, plug that all in the chat GBT had to sort of synthesize it and then created my outline and then sort of like had chat GBT sort of expand out in particular like sort of like the technical explanations of how DeepSeq was potentially how DeepSeq was trained.
• 1:19:40
  Alex Kotran (aiEDU): But CJ and I worked on this together and I think what we found is that it would get you something that's maybe like a C+, maybe a B-, but to get something that's actually worth publishing we basically rewrote almost every word.
• 1:19:56
  Alex Kotran (aiEDU): Now it was helpful to have a little bit of a scaffold, but at the end of the day, I'm still unclear about whether the juice is worth the squeeze, because I couldn't have written that without watching all those videos myself, and I think that when you talk to folks, especially people who are really deep in the AI space, this is something that's really common.
• 1:20:17
  Alex Kotran (aiEDU): Most people are not using these language models.
• 1:20:21
  Alex Kotran (aiEDU): The exception, I think, is coding or data science.
• 1:20:27
  Alex Kotran (aiEDU): I think there's some applications where it's just actually legitimately game-changing, but I think for the humanities, I don't know about law.
• 1:20:37
  Alex Kotran (aiEDU): I've only I only know the story from the lawyer that got disbarred or penalized for submitting a I don't know if it was an injunction, some document that was like wildly hallucinated and um right Making, making up cases or what have you yeah?
• 1:21:00
  Alex Kotran (aiEDU): Um, so my guess is, most big law firms are not allowing their lawyers to.
• 1:21:06
  Greg Toppo (The 74): I'm hoping that they're not what else are you covering?
• 1:21:08
  Greg Toppo (The 74): Uh, and if not covering what else?
• 1:21:10
  Alex Kotran (aiEDU): are you just like tracking?
• 1:21:11
  Greg Toppo (The 74): Yeah, we're just like tracking.
• 1:21:12
  Greg Toppo (The 74): Yeah, we're, I mean, you know, as you'd expect we're.
• 1:21:14
  Greg Toppo (The 74): You know we're covering the administration and you know seeing what's happening there with you know their work, um, uh, with, uh, executive orders and and whatnot, the fate of the department of education.
• 1:21:26
  Greg Toppo (The 74): Um, we're, uh, really still interested in the future of high school.
• 1:21:34
  Greg Toppo (The 74): I'm always on the hunt for suggestions for the next school to visit.
• 1:21:42
  Greg Toppo (The 74): Just a couple weeks ago was up in Albany, visited a really, really fascinating school called Tech Valley High School.
• 1:21:50
  Greg Toppo (The 74): One of my favorite aspects of it is that when you walk through Tech Valley High School you see almost no tech at all.
• 1:21:57
  Greg Toppo (The 74): It turns out that this school was built, was originated, at a time when people were very, very bullish on the idea of like incorporating schools into sort of like tech hubs.
• 1:22:14
  Greg Toppo (The 74): And so there's this area in Albany called Tech Valley and the school sort of got got his name from that.
• 1:22:23
  Greg Toppo (The 74): But it's very it's, it's almost, you know, a humanities centered high school that just is settled with the name Tech Valley.
• 1:22:34
  Greg Toppo (The 74): A really cool high school, really interesting, you know, individualization, lots of lots of project-based learning, lots and lots of um real focus on um students ability to get up and just like speak about topics.
• 1:22:51
  Greg Toppo (The 74): Uh, really interesting place, and I think it's it's a model that I that I'm really seeing more and more, which is schools that are focusing on giving their students the ability to be experts, if you will.
• 1:23:07
  Alex Kotran (aiEDU): If there's someone listening, that is the head of a school and they want to reach out to you.
• 1:23:13
  Greg Toppo (The 74): We'll share your contact information or your email or whatever, I get the 74 million on ORG.
• 1:23:20
  Alex Kotran (aiEDU): What?
• 1:23:20
  Alex Kotran (aiEDU): What advice would you give to a building principal who is trying to pitch their school Like what are the types of things you're looking for?
• 1:23:27
  Alex Kotran (aiEDU): I'm sure you get a lot.
• 1:23:29
  Alex Kotran (aiEDU): I mean there's we actually don't get a lot of pitches.
• 1:23:33
  Greg Toppo (The 74): Interestingly enough, we've been writing these stories for a while now and I do not get emails from people saying come visit people to know if they're really doing something innovative.
• 1:24:01
  Alex Kotran (aiEDU): Yeah, I suppose more powerful for you to hear about a school not directly from someone who's sort of like promoting it.
• 1:24:08
  Greg Toppo (The 74): No, I think that's right.
• 1:24:10
  Alex Kotran (aiEDU): Maybe just some parting advice for folks.
• 1:24:12
  Alex Kotran (aiEDU): I mean, I think one of the common threads of this conversation is, you know, you clearly have this curiosity.
• 1:24:24
  Alex Kotran (aiEDU): It's been part of your entire career and it's it hasn't always been ai.
• 1:24:25
  Alex Kotran (aiEDU): It was really sort of much more broad about sort of like the future of education, um, but you are now really, I think, one of like a very small group of of journalists who are, true, I don't know if you call yourself an expert, but but as close as you can get to someone who just deeply understands the intersection of these spaces, what advice would you give to our audience in terms of folks who are early on in the learning journey?
• 1:24:47
  Alex Kotran (aiEDU): They get it.
• 1:24:48
  Alex Kotran (aiEDU): Yeah, we need to learn more.
• 1:24:49
  Alex Kotran (aiEDU): Maybe they want to use ChatGPT and experiment, but are there any specific outlets that you're following?
• 1:24:55
  Alex Kotran (aiEDU): Maybe they want to use chat, gpt and experiment, but are there any like specific like place the outlets that you're following?
• 1:24:57
  Alex Kotran (aiEDU): You know, I don't know, is it like Reddit, like, like, how can they sort of just like stay, keep their finger on the pulse?
• 1:25:02
  Greg Toppo (The 74): Hmm, I mean, my problem is, I read everything?
• 1:25:06
  Greg Toppo (The 74): So what are your?
• 1:25:09
  Alex Kotran (aiEDU): like what's the best, what's the what's?
• 1:25:11
  Greg Toppo (The 74): the I mean what actually?
• 1:25:12
  Greg Toppo (The 74): Um.
• 1:25:13
  Greg Toppo (The 74): Interestingly enough, um you know, one of the podcasts that I like is the times podcast about um tech the hard fork.
• 1:25:20
  Greg Toppo (The 74): Okay.
• 1:25:20
  Alex Kotran (aiEDU): Um love those guys.
• 1:25:22
  Greg Toppo (The 74): Kevin Bruce Um, I I think his coverage specifically is really um, really really well done.
• 1:25:28
  Greg Toppo (The 74): Um, and he's covered a lot of the education slash, safety aspects of it.
• 1:25:38
  Greg Toppo (The 74): Um, you know I uh, I cover, or excuse me, I, I, I, I read and follow.
• 1:25:41
  Greg Toppo (The 74): You know the the skeptics, if you will Um, you know the Ben Riley.
• 1:25:47
  Greg Toppo (The 74): He's got a um uh, cognitive resonance.
• 1:25:51
  Greg Toppo (The 74): Who you?
• 1:25:52
  Greg Toppo (The 74): Um I'll I will actually um if you don't mind you um I'll I will actually um if you don't mind, my um flogging you guys as incredible podcasts that you did with the disagreement, which I'm hoping, by the time this runs, it will be public.
• 1:26:06
  Greg Toppo (The 74): Um, you guys uh and I even said it at the time, I think, on Twitter, x or wherever the heck it is Um that the conversation you guys had back in the fall was like the best conversation I've heard a very high level, with lots and lots of respect for one another, but also were able to very carefully pry the threads from where you disagreed and not scream at each other.
• 1:26:59
  Greg Toppo (The 74): I really enjoyed that, so I would recommend that highly.
• 1:27:02
  Greg Toppo (The 74): Um, I follow um Dan Myers blog.
• 1:27:06
  Greg Toppo (The 74): Um, he's got a very specific focus on math Um, and I think that's a really important um thing to think about when we're talking about this world.
• 1:27:17
  Greg Toppo (The 74): You know I've always been a big fan of Audrey Waters, who never met a piece of technology she liked, and it's interesting because, like somebody like Audrey, for people who may not know very much about her, but you know she's been thinking and writing about this stuff for years and years and I think one of the the sort of the big themes she has really been focused on for as long as I've known her, is this idea that Silicon Valley is not your friend, that there's a lot of dark thinking coming out of this place and I uh, just speaking from, uh you know some of the stuff we're seeing with our new administration.
• 1:28:21
  Greg Toppo (The 74): I mean I, without getting like political about it, I mean I think you can see the self-serving aspect of a lot of what these guys are doing, and I don't think that's something we saw very clearly until now.
• 1:28:40
  Alex Kotran (aiEDU): I think it's surprising they got to pass for as long as they did, because I don't think people would look at car companies, oil companies, electricity companies, all these megalith capitalist institutions.
• 1:28:54
  Alex Kotran (aiEDU): Their incentive structures are highly oriented towards one, only one thing.
• 1:29:01
  Alex Kotran (aiEDU): Yeah.
• 1:29:02
  Alex Kotran (aiEDU): And they will push in whatever direction that they can right.
• 1:29:05
  Alex Kotran (aiEDU): So I think, but I guess you're, I guess I think it's interesting that you're naming some skeptics, because I actually think that is.
• 1:29:14
  Alex Kotran (aiEDU): We have a lot to learn from the skeptics, because there's plenty of optimists and there's a lot of legitimate optimists who are super smart, but then there's also a lot of optimists who are shilling right, Like they are self-interested, whether it's they're either at companies or invested in those companies invested in the future of AI being successful and I think the kind of sift through all because I think the origin of my question, what I want to leave
• 1:29:39
  Alex Kotran (aiEDU): with the audience is like yes, there's a lot of noise, you don't have to read every single thing.
• 1:29:44
  Alex Kotran (aiEDU): Not everybody is a journalist covering AI in education but I think it is important to find some smart people that you trust.
• 1:29:51
  Alex Kotran (aiEDU): And when you're trying to figure out, is this like, legit?
• 1:29:55
  Alex Kotran (aiEDU): Like, is this legit, is there a there there?
• 1:29:57
  Alex Kotran (aiEDU): You don't want to be relying on the.
• 1:30:03
  Alex Kotran (aiEDU): You don't necessarily be on the bandwagon while you're evaluating that.
• 1:30:10
  Alex Kotran (aiEDU): And especially for decision makers who are education systems.
• 1:30:12
  Alex Kotran (aiEDU): I think they're dealing with this a lot right now.
• 1:30:14
  Alex Kotran (aiEDU): A lot of AI conferences are 95% of the people who are there and the sponsors are all aggressively pro-AI and AI products.
• 1:30:25
  Alex Kotran (aiEDU): In reality, I think it's much more of.
• 1:30:28
  Alex Kotran (aiEDU): I don't know if it's 50-50 exactly, but it's definitely not 95% good and 5%.
• 1:30:33
  Alex Kotran (aiEDU): We just have to figure it out.
• 1:30:36
  Alex Kotran (aiEDU): It's much more complex um and so the information ecosystem is not.
• 1:30:40
  Alex Kotran (aiEDU): I don't.
• 1:30:40
  Alex Kotran (aiEDU): I don't think it's very balanced, I think it's oriented very heavily and then you have, like the, and a lot of the skeptics or a lot of the pessimists are not useful because they're like the existential risk folks who are worried about, you know the singularity.
• 1:30:53
  Alex Kotran (aiEDU): I find that a very interesting philosophical discussion.
• 1:30:56
  Alex Kotran (aiEDU): I just don't think there's anything actionable that certainly an education leader can do.
• 1:31:00
  Alex Kotran (aiEDU): Besides, pay attention and keep your eye out for AGI.
• 1:31:05
  Greg Toppo (The 74): I mean to be fair.
• 1:31:07
  Greg Toppo (The 74): I mean a lot of skeptics, I think, have a different view of education than maybe you or I might have.
• 1:31:13
  Greg Toppo (The 74): I mean they see it as a different kind of enterprise and some wouldn't even be willing to.
• 1:31:24
  Greg Toppo (The 74): You know entertain, you know functions of a teacher, you know being, you know, augmented in certain ways by technology.
• 1:31:35
  Greg Toppo (The 74): So you know, I want to be clear on that.
• 1:31:40
  Greg Toppo (The 74): I guess where I come into it is I'm really interested to read the and to talk to the.
• 1:31:53
  Greg Toppo (The 74): You know the makers, the vendors, the, the people who run a lot of these outfits, just to see what they think they're doing, like what, you know where they, what their place is and all this.
• 1:32:04
  Greg Toppo (The 74): And some of them have really interesting ways of thinking about this stuff, um, and really interesting ways of thinking like.
• 1:32:10
  Greg Toppo (The 74): You know, here's our niche or here's all we want to do.
• 1:32:20
  Alex Kotran (aiEDU): But I guess you can't plug yourself but I will.
• 1:32:21
  Alex Kotran (aiEDU): I think, while it's not everybody can necessarily talk to, you know the founders of companies like this.
• 1:32:26
  Alex Kotran (aiEDU): I think you know reporting like yours.
• 1:32:28
  Alex Kotran (aiEDU): You're not blindly excited, but you're intensely curious.
• 1:32:30
  Alex Kotran (aiEDU): But you're intensely curious and I think you're willing to.
• 1:32:38
  Alex Kotran (aiEDU): I think his orientation towards the future of high school is an interesting place to come at this from as a journalist, because your incentive is for schools to transform for the better, and so there's a desire for things to be.
• 1:32:50
  Alex Kotran (aiEDU): I can sense a desire for us realizing the potential that AI has, and yet I think you've been in this long enough that you know that there's generally more to it than some of the first claims, I suppose, that are made.
• 1:33:08
  Greg Toppo (The 74): Yeah, no, I think that's right.
• 1:33:09
  Greg Toppo (The 74): I think that's right.
• 1:33:11
  Alex Kotran (aiEDU): All right, greg.
• 1:33:12
  Alex Kotran (aiEDU): Thank you so much for coming by.
• 1:33:14
  Alex Kotran (aiEDU): It's been fun.