Latest / aiEDU Studios / Chong-Hao Fu on Putting Teachers Back at the Center of AI

Transcript

Chong-Hao Fu on Putting Teachers Back at the Center of AI · aiEDU Studios

• 0:01
  SPEAKER_01: This hundreds of billions of dollars we've been saying spending on AI data centers, most of the chips that are going to these data centers are going to be out of date in like two years, three years.
• 0:10
  SPEAKER_01: And if you instead invested those hundreds of billions of dollars in humans, humans don't have the same shelf life over generations.
• 0:17
  SPEAKER_01: Learning kind of compounds.
• 0:22
  Alex Kotran: So Chang Hai Fu is CEO of Leading Educators.
• 0:27
  Alex Kotran: And if you are a teacher or if you're an administrator, you probably know leading educators.
• 0:32
  Alex Kotran: And if you're not, they're a national nonprofit and they partner with uh education systems, really school leaders, sort of like the maybe the full stack of leadership development and enablement, coaching, in-depth training, um, curriculum, and I think a fair bit of strategic sort of support for schools, right?
• 0:52
  SPEAKER_00: Yes.
• 0:52
  SPEAKER_01: All is accurate.
• 0:53
  SPEAKER_01: Yeah, that's that's great.
• 0:54
  SPEAKER_01: You're very close.
• 0:55
  SPEAKER_01: Yeah.
• 0:56
  SPEAKER_01: So the way that we think about it is that there's two parts to our work.
• 1:00
  SPEAKER_01: One is around scaling great teaching, and that's based like everything you said, around coaching, around district advising, around making sure they're the right conditions for adults to do their best work for kids.
• 1:11
  SPEAKER_01: And then the other part of our organization, uh, which brings us into some of the overlapping work we've been doing, is really around future models and how we create the models for thriving in the future, particularly around AI-enabled instruction, into a changing teaching role.
• 1:25
  SPEAKER_01: And we and we think both are necessary.
• 1:27
  SPEAKER_01: In part, I think about my nieces and nephews.
• 1:29
  SPEAKER_01: They're all nine years old, all in the third grade.
• 1:32
  SPEAKER_01: And if I think about their experience, I want them to have a really amazing third grade experience.
• 1:36
  SPEAKER_01: But the real test of any of this is that they thrive as adults.
• 1:39
  SPEAKER_01: And so we always have to kind of work across multiple timelines in education and probably now more than ever.
• 1:44
  SPEAKER_01: So that's how our team is set up.
• 1:46
  Alex Kotran: Yeah.
• 1:48
  Alex Kotran: So, and you were y'all were doing this work before AI came onto the scene.
• 1:52
  Alex Kotran: What or before ChatGPT came out of the scene?
• 1:55
  Alex Kotran: Before ChatGPT, yeah.
• 1:56
  Alex Kotran: To be stuck, yeah.
• 1:57
  Alex Kotran: Yeah, yeah.
• 1:58
  SPEAKER_01: Um the listeners know.
• 1:59
  SPEAKER_01: I'm not, I'm not, that's not new reframing here.
• 2:02
  Alex Kotran: I think in education, there was for a lot of folks this you know, oh crap moment of this technology that had previously been sort of you know lived in sort of the innuendo in conversations about the future of work or the fourth industrial revolution, and suddenly it was in classrooms complicating teachers' lives in the form of you know students using it as a shortcut or as a cheating tool.
• 2:27
  Alex Kotran: How was your org sort of first starting to kind of get the incoming?
• 2:30
  Alex Kotran: Was it your partners coming to you and saying, like, hey, what do we do with this thing?
• 2:33
  SPEAKER_01: Yeah.
• 2:33
  SPEAKER_01: So it's it's really an interesting situation where we got a McKenzie Scott grant almost four, four and a half years ago.
• 2:41
  SPEAKER_01: And we decided that we were going to use all the funds for innovation because we realized there's a set of things that district partners were asking us to work on together.
• 2:48
  SPEAKER_01: And then there's a set of things that no one is gonna ask us to work on yet because that just wasn't a burning fire, and there were other priorities that were front and center.
• 2:56
  SPEAKER_01: And from that innovation team, we actually got connected to the Google for education team.
• 3:00
  SPEAKER_01: And this was just after COVID.
• 3:02
  SPEAKER_01: And their team was really trying to better understand the value add of technology in general.
• 3:06
  SPEAKER_01: And so we worked with them on a project uh to try to codify what are the value add of technology in terms of efficiency plays, in terms of deepening learning, and then also what are some of the transformational opportunities that might exist, both for ed tech in general, but then AI specifically.
• 3:21
  SPEAKER_01: And that actually kind of formed the basis for us as a team that, oh, we should dig into this because we're not really an ed tech company to begin with.
• 3:28
  SPEAKER_01: We are around, we've been around for 15 years, but we're really, as you said, known for a as a professional learning partner to school systems and a design partner to schools.
• 3:36
  SPEAKER_01: And when we started digging into technology, we realized, oh, there's 9,000 ed tech tools.
• 3:41
  SPEAKER_01: And oh, there's actually not a lot of data that supports what strong implementation at particularly at scale looks like.
• 3:49
  SPEAKER_01: And so that raised a lot of questions for us like what would it actually take for AI and ed tech in general to meaningfully change learning, uh, to deepen learning, to make teaching more efficient, to then open up new transformational opportunities.
• 4:02
  SPEAKER_01: Those are kind of the things that we started grappling with.
• 4:05
  SPEAKER_01: And from that, our first partnerships were actually directly with schools, because we've we we've known over the years that when principals and teacher leaders are working together, that's actually when we see real change for kids.
• 4:17
  SPEAKER_01: So we just launched a school teams collaborative with schools across the country who are really eager to work on this.
• 4:22
  SPEAKER_01: And we started the question like, how do you actually want teaching and learning to be different?
• 4:26
  SPEAKER_01: Not what AI tool adoption looks like, but what is your vision for learning in this new era?
• 4:30
  SPEAKER_01: And then from that, try to work backwards to then think about what tool integration and then teaching would look like.
• 4:36
  Alex Kotran: Yeah, I mean, we're I think we're such kindred spirits in the in the focus on like the human side of the equation.
• 4:42
  Alex Kotran: Well, because you have this really important role.
• 4:45
  Alex Kotran: I mean, the fact that you don't have a tool, because I feel like we're in the same boat.
• 4:48
  Alex Kotran: Although we are starting to build some tools.
• 4:50
  Alex Kotran: Oh, we I I definitely want to dig into that.
• 4:53
  Alex Kotran: Yeah.
• 4:53
  Alex Kotran: Um, because we are as well.
• 4:54
  Alex Kotran: And we're starting to we're having our own kind of like identity crisis of like, wait a second, we we used to talk about ourselves as not a tool developer.
• 5:02
  Alex Kotran: Um our interactions with school districts, as I'm sure yours are, part of the reason that they they trust us to give them the advice is we're they know that we're not going in with this implementation outcome as the goal.
• 5:15
  Alex Kotran: That's right.
• 5:16
  Alex Kotran: And you said something really important to me, which was like, what is the what is the AI in service of?
• 5:23
  Alex Kotran: Um how I mean, how do you feel about I mean is AI are are you more excited, more nervous?
• 5:31
  Alex Kotran: Um now that you've had time to process.
• 5:33
  SPEAKER_01: I think both.
• 5:34
  SPEAKER_01: I think you I think there's a there's a part of me that's incredibly optimistic, and there's a part of me that is terrified, and that is actually what keeps me going.
• 5:41
  SPEAKER_01: There's a famous Hunter S.
• 5:42
  SPEAKER_01: Thompson quote from the Rum Diary, so I'm gonna get wrong, but he talks about there's these two poles, like wonderful optimism and relentless despair, and it's the tension between the two that keeps them going.
• 5:53
  SPEAKER_01: And that's often how I feel right now.
• 5:55
  SPEAKER_01: I feel like we as a society and as an education system, we're at such an inflection point, and depending on the choices that we make, it could go either way.
• 6:04
  SPEAKER_01: Um, I think it's actually really revealing that in the United States, we have the least trust for AI.
• 6:09
  SPEAKER_01: And I actually think that's in part because we don't have a lot of guardrails and a lot of guidance around what responsible ethical use looks like.
• 6:17
  SPEAKER_01: I think the latest stat is there are 28 states that have AI guidance, but only three states where that's actually enforceable.
• 6:24
  SPEAKER_01: The rest is just kind of like it'd be nice to.
• 6:26
  SPEAKER_01: And, you know, as you know, the models that we have are benchmarked around speed, around accuracy.
• 6:33
  SPEAKER_01: They're not benchmarked on learning or human development or relationships.
• 6:36
  SPEAKER_01: So some of the things that we're optimizing for are not necessarily the same things that we care about in the education system.
• 6:42
  SPEAKER_01: At the same time, we also know the job of the teacher is incredibly unsustainable.
• 6:48
  SPEAKER_01: I think the latest stat that we have is only 19% of teachers think their job is doable.
• 6:53
  SPEAKER_01: And we also know that AI can be huge in terms of time saving, in terms of ensuring that kids get the personalization that they need.
• 6:59
  SPEAKER_01: But all this has to be done, I think, really responsibly and carefully.
• 7:03
  SPEAKER_01: And so one of our mantras throughout all this work is how do we learn and not guess?
• 7:07
  SPEAKER_01: How do we test alongside educators?
• 7:09
  SPEAKER_01: How do we actually talk to kids?
• 7:10
  SPEAKER_01: How do we know how it's going?
• 7:12
  SPEAKER_01: And like, let's just not assume pro or con.
• 7:15
  SPEAKER_01: I think Aaron Mote talks about AI as an arrival technology, like electricity.
• 7:20
  SPEAKER_01: Like, I think I'm sure you've think similarly, like electricity is neither good or bad, right?
• 7:25
  SPEAKER_01: A lot of it depends on how we use it and what are the guardrails and guidelines and productive use cases that we all discover together.
• 7:32
  SPEAKER_03: Yeah.
• 7:33
  Alex Kotran: The because it's really complicated.
• 7:36
  Alex Kotran: Yeah.
• 7:38
  Alex Kotran: Also that there's I mean, even if the even even because I agree that most AI models are not tuned for learning.
• 7:46
  Alex Kotran: I think that there's actually some like we're starting to see some tools and use cases that are that are really exciting.
• 7:54
  Alex Kotran: And I think there are organizations, some of them nonprofits, that have like started to dial in what what does it look like to actually ground the right context and have like the right you know pedagogical frameworks, you know, high quality instructional materials as the reference point, you know, for tools.
• 8:12
  Alex Kotran: And that wasn't always necessarily the case, but it's more and more accessible now.
• 8:16
  Alex Kotran: Um but that's still sort of there's this bigger question, which is like, what is the point of the learning?
• 8:24
  Alex Kotran: And it and if and if the tools are really good at increasing, let's say, scores on the existing assessments, I think that's happening in a moment where there's a lot of questions about, well, are we even assessing the right things?
• 8:36
  Alex Kotran: Um how do you approach those conversations?
• 8:39
  Alex Kotran: Because we we we get asked a lot of these questions about well, like, well, what about are we even measuring the right the right stuff?
• 8:44
  Alex Kotran: And I think what's hard if you're a school leader right now is you don't have a ton of agency over that.
• 8:49
  Alex Kotran: I mean, you can you can go and advocate and you can sort of put your voice out, but at the end of the day, superintendents don't get to decide what the assessments are.
• 8:59
  Alex Kotran: They sometimes have limited ability to actually dictate, you know, the degree to which the assessments should influence, let's say, you know, um like teacher incentives, uh, like even compensation.
• 9:10
  Alex Kotran: Why specific like even specific to compensation?
• 9:12
  Alex Kotran: Yeah.
• 9:12
  Alex Kotran: There are states where teachers are literally paid based on how students are performing at these tests.
• 9:16
  Alex Kotran: Um how do we deal with that that aspect of like, yeah, there's like there's a lot of stuff in the system that needs to change that you don't have power over.
• 9:25
  SPEAKER_00: Yeah.
• 9:26
  Alex Kotran: But I think people need to feel agency to really to not be sort of sucked into the feeling like victims, I guess.
• 9:32
  SPEAKER_01: Yeah.
• 9:32
  SPEAKER_01: I I love this question.
• 9:34
  SPEAKER_01: And I love the report that you all put out with with Burning Glass around how student learning outcomes need to change in this era.
• 9:41
  SPEAKER_01: I thought it was really insightful.
• 9:43
  SPEAKER_01: And I really appreciate the point that the report made that it's not just about what content we assess, but actually how students learn.
• 9:50
  SPEAKER_01: And one of the ways that we think about it is that there's a backwards design problem right now.
• 9:55
  SPEAKER_01: That it's like we can't think of it as like a teacher burnout problem and then a technology problem and then as an assessment problem.
• 10:00
  SPEAKER_01: It's actually all one problem.
• 10:02
  SPEAKER_01: And the problem goes like this we need to re-examine what's most important for students to learn and master.
• 10:08
  SPEAKER_01: We then need to go backwards and then re-engineer what are the most important learning experiences that are aligned to those outcomes we want for students.
• 10:14
  SPEAKER_01: And then from a resource layer, we need to think about well, how do we create those learning experiences through a combination of really amazing teaching, but also technology that is reliable, ethical, and tested.
• 10:24
  SPEAKER_01: And so if you actually backwards design from what we want from students, we can maybe tackle multiple problems at the same time.
• 10:30
  SPEAKER_01: The problem, like you're saying, is like there's not a lot of time to do that type of thoughtful backwards design.
• 10:35
  SPEAKER_01: We're seeing a lot of when we think about AI adoption, uh, our VAT framework that we developed talks about how the value add for technology is often about what teachers can do more of, what they can do better, and what they can do new.
• 10:48
  SPEAKER_01: The do better part is around efficiency, and that part tends to be really easy to do.
• 10:52
  SPEAKER_01: People can think about new workflows, they can think about lesson planning differently.
• 10:55
  SPEAKER_01: That happens pretty much on its own.
• 10:57
  SPEAKER_01: The do better to actually deepen learning, we find that has to be really carefully tested because if not, you could actually create a situation where introducing the technology results in cognitive offloading and less, less learning.
• 11:09
  SPEAKER_01: And then finally, the do differently, do new.
• 11:13
  SPEAKER_01: That that is the part that I think people um need the most time and the most support in processing.
• 11:19
  SPEAKER_01: Well, what is the new vision and what's most important in this era?
• 11:21
  SPEAKER_01: And I thought like the report that you all put out with Burning Glass is like really, really helpful.
• 11:25
  SPEAKER_01: We're trying to think of ways in which you can integrate the most important skills for this new era inside existing content disciplines.
• 11:34
  SPEAKER_01: So I'll give you an example.
• 11:35
  SPEAKER_01: We're we're engaged in an effort right now to think about what it would look like to modernize mathematics.
• 11:40
  SPEAKER_01: A lot of that is actually about how we learn math.
• 11:43
  SPEAKER_01: Within the math standards, we have the content standards.
• 11:46
  SPEAKER_01: We also have something called the standards for mathematical practice.
• 11:49
  SPEAKER_01: And that's really how mathematicians think and do math.
• 11:51
  SPEAKER_01: It includes like argumentation, precise thinking, using tools, modeling.
• 11:56
  SPEAKER_01: Those are maybe the more evergreen durable skills that would transcend outside of mathematics and be really valuable in the age of AI.
• 12:03
  SPEAKER_01: It also happened to be the skills that in a math classroom get deprioritized because they're not assessed in the same way.
• 12:09
  SPEAKER_01: So, how could we really think about how we learn math as a vehicle to learn things that will be really durable and really cultivate a lot of agency and a lot of transference in this new era?
• 12:18
  SPEAKER_01: That's like one project we're actively thinking about.
• 12:20
  SPEAKER_01: And I think this is could be this golden age of teaching where we create these moments where students are more agents of their learning, they have a lot more drive and purpose, and that and it requires a stepping back.
• 12:31
  SPEAKER_01: And I forgot who said it, but I love this quote of like, this is the time to marie kondo our learning standards and maybe kind of think through what is no longer serving us and be really just create space for what what future opportunities might emerge.
• 12:45
  Alex Kotran: Yeah, and what you're describing is not necessarily well, we don't need to teach math anymore because the AI can do math, or we don't need to teach you know, writing skills anymore because the AI is good at writing.
• 12:56
  Alex Kotran: It's it's this intuition that the domain knowledge by itself, which I think has been the primary goal of a lot of core subjects, because that's what's tested.
• 13:09
  Alex Kotran: That isn't necessarily the most important endpoint.
• 13:12
  Alex Kotran: It's sort of like uh almost a side effect of really good math instruction or English instruction, but actually it's more like do you have the ability to you know form your thoughts into a coherent and cogent argument and then you know make the case for a position that you've established.
• 13:26
  Alex Kotran: Um and whether you do that with a five-paragraph essay or with you know some different modality, that piece may be less important.
• 13:35
  Alex Kotran: But it's not so much that you don't need to be able to think.
• 13:38
  SPEAKER_01: I think that's exactly right.
• 13:40
  SPEAKER_01: And the disciplines that we've created have a lot of opportunities to think, to have like real knowledge of the world.
• 13:46
  SPEAKER_01: And the deeper and denser that knowledge can be, I would I believe that that allows students to then acquire and learn new knowledge.
• 13:53
  SPEAKER_01: And like being able to go really deeply into dinosaurs gets you excited about learning perhaps about the next thing that you're going to dig into as a student.
• 14:02
  SPEAKER_01: And it isn't necessarily that we're deepening these skills just so that you can only do those skills.
• 14:07
  SPEAKER_01: It's also so you can have discernment and judgment and application.
• 14:10
  Alex Kotran: Yeah, I had this interaction with a student who she was in one of our vibe coding workshops that built this amazing tool.
• 14:18
  Alex Kotran: And she'd never she her school had banned AI.
• 14:21
  Alex Kotran: So it was it was interesting to see somebody absolutely running with it, like outrunning, outpacing adults.
• 14:28
  Alex Kotran: This was at South by Southwest.
• 14:29
  Alex Kotran: It was like a tech conference.
• 14:30
  Alex Kotran: So these are like tech forward educators and ed tech leaders.
• 14:33
  Alex Kotran: And you had this 17-year-old who never used AI before, but she had domain expertise in um uh non-pharmaceutical therapies for ADHD.
• 14:44
  Alex Kotran: Because in she had a class, literally, the class that the class was pick a subject that's interesting or important to you, and then do a full semester, maybe even a full year, of like in-depth research, like rigorous academic research into the topic.
• 14:57
  Alex Kotran: And so she had just finished that class.
• 15:00
  Alex Kotran: Do you remember what school this was at?
• 15:01
  Alex Kotran: This is one of the best schools in the country.
• 15:03
  Alex Kotran: This was like a private school in Connecticut.
• 15:04
  Alex Kotran: Okay.
• 15:05
  Alex Kotran: Um so that specific the the the school itself is is not necessarily something that every every district can necessarily carbon copy.
• 15:16
  Alex Kotran: Yeah.
• 15:16
  Alex Kotran: Um and that modality of like having a dedicated class, just like they're whatever you want.
• 15:20
  Alex Kotran: I I know that for some districts that's probably not within the realm of possibility, but maybe it is.
• 15:27
  Alex Kotran: I mean, yeah.
• 15:28
  SPEAKER_01: I mean, I feel like I've seen versions of that class.
• 15:30
  SPEAKER_01: Sorry, I I don't actually know exactly what the class is, but I've seen versions of like a much more student agent, student purpose-driven high school class in several places across the country now this year.
• 15:41
  SPEAKER_01: And one of the things to your point that I keep hearing is it's much, much more common in high-income schools.
• 15:48
  SPEAKER_01: And I think we, I think what the latest stat is when you're looking not at just AI replacing teaching or a kind of AI towards existing educational outcomes, and you're actually looking at AI fluency.
• 15:59
  SPEAKER_01: I think the current stat is 66% of high-income schools are offering that to students and only 6% of low-income schools.
• 16:05
  SPEAKER_01: So an 11x difference, which obviously is a huge digital inequity.
• 16:11
  SPEAKER_01: One version of what you just described that I saw uh recently.
• 16:14
  SPEAKER_01: Sorry, did I interrupt your story?
• 16:15
  SPEAKER_01: No, no, no.
• 16:16
  SPEAKER_01: Okay, I feel like I Okay, we're okay, uh, I apologize.
• 16:19
  SPEAKER_01: Um at the Austin and Richards School for Young Women, they also do a senior interdictionary project.
• 16:27
  SPEAKER_01: And I was talking to two seniors who whose moms had both suffered for seven years from uterine fibroids and who should have been offered a hysterectomy much earlier in their healthcare regimen, but that's often underdiagnosed in communities of color.
• 16:41
  SPEAKER_01: And so both high school seniors, to your exact point, were passionate about this topic.
• 16:46
  SPEAKER_01: They research the medical treatments, they met they research the lifestyle factors, the demographic factors that influence uh needs for hysterectomies, and they created an app on Play Lab that then can coach you in any language, if you're a woman struggling with uterine fibroids, to then ask the right questions of your doctor.
• 17:03
  SPEAKER_01: And it's like that example of when kids are really proximate to something that they care about, they're given the space to explore it with a lot of agency.
• 17:11
  SPEAKER_01: And then AI actually becomes almost like a magic wand, if you will, to create something really meaningful and authentic that they can offer back to the world.
• 17:18
  SPEAKER_01: And that I've seen so many examples of it this year.
• 17:20
  SPEAKER_01: It gets really, really exciting.
• 17:22
  SPEAKER_01: And then we also, and you juxtapose that against the fact that I think it's only 20% of high schoolers find high school to be really relevant and engaging to their dreams.
• 17:32
  Alex Kotran: And that's that low.
• 17:33
  Alex Kotran: I knew it was low.
• 17:34
  SPEAKER_01: I didn't realize it was 20%.
• 17:35
  SPEAKER_01: It's really low.
• 17:36
  SPEAKER_01: And so then the question is like, how might we create more spaces in the existing curriculum for kids to examine their purpose and passions?
• 17:44
  SPEAKER_01: Because my my sense is just creating a like it doesn't have to be the entire day, but creating those authentic experiences are gonna create the inspiration and the motivation to connect all the rest of the learning back to what they want to do in their future.
• 17:58
  Alex Kotran: But this is actually so this is where I was going with uh you you took us there.
• 18:03
  Alex Kotran: So it's A was really cool to see that, like, yes, almost like duh, if you give kids, if you have kids the space um to take agency agency with their learning, they're gonna do some amazing stuff and it's gonna be connected to what's important to them.
• 18:17
  Alex Kotran: But my head also goes to most of the schools that we work with don't have the luxury of every kid having that dedicated time.
• 18:24
  Alex Kotran: Um, because if your math scores and your reading and writing scores are you know below where you need them to be, feels like all of the time that we have should be focused on, you know, addressing that gap.
• 18:36
  Alex Kotran: And and you mentioned something about how do we bring this into the core subjects.
• 18:40
  Alex Kotran: And so this is like this, it wasn't even a debate, it was more of a a curiosity.
• 18:44
  SPEAKER_01: Yeah, go ahead.
• 18:45
  SPEAKER_01: You have a gap-filling thought.
• 18:46
  SPEAKER_01: I mean, I think there is this sense that we have to only target the gap, right?
• 18:51
  SPEAKER_01: And it does actually become a little, it can feel really painful in that way.
• 18:57
  SPEAKER_01: One of my earlier experiences, I back in 2006, 2007, had the opportunity to open KIPP's first fine arts campus.
• 19:04
  SPEAKER_01: And I taught at the original KIPP school and then realized that I wanted to think about how we might create more authentic expression and more agency for students.
• 19:13
  SPEAKER_01: And this was through the fine arts.
• 19:15
  SPEAKER_01: So taking a taking a left turn from AI for a second.
• 19:18
  SPEAKER_01: But all of our kids took dance, theater, orchestra, choir, visual arts, and so they could choose the fine art form that they wanted to major in over four years with us.
• 19:26
  SPEAKER_01: And one of the things that we would see over and over again is you would see a student maybe struggling in English or math class, but then they would get the solo in orchestra or they'd get the lead role in the musical.
• 19:36
  SPEAKER_01: And suddenly that sense of pride and that sense of confidence flooded everything else.
• 19:42
  SPEAKER_01: And they actually went back and did so much better in, and because there was a new reserve of confidence that they could pull from.
• 19:48
  SPEAKER_01: And I think sometimes we take like a only a weakness-based approach when really in life, we're often measured by our strengths and what we can do the best.
• 19:56
  SPEAKER_01: That's what we we ground our professions and our personal lives around.
• 20:01
  SPEAKER_01: And doing that for kids also can be really, really powerful because then you're not only practicing your worst thing, you're actually building reserves of confidence and energy and relationships that you can then leverage into weaker areas as well.
• 20:14
  SPEAKER_01: I found that over and over again.
• 20:16
  SPEAKER_01: And so it just thinks about like where can we create these spark magic moments?
• 20:21
  SPEAKER_01: And I I do actually think AI fluency, AI creation, vibe coding can create really amazing things uh really quickly.
• 20:30
  Alex Kotran: Maybe the obvious thing that I that comes to mind is okay, so you have like let's say history class, and I studied history, basically political science and history in college.
• 20:40
  Alex Kotran: Um and it I'm just imagining if if if I if history class had had a whole semester where I got to be, you know, pick a pick a pick a time period and just go really deep and become an expert in that time period.
• 20:54
  SPEAKER_00: Yeah.
• 20:55
  Alex Kotran: Um, you know, I don't really use any of the knowledge that I I don't think I use any of the knowledge that I got in history.
• 21:00
  Alex Kotran: So on the one hand, that was sort of a that was a a thought experiment that I put out, and I forget who who I was sort of sharing this with.
• 21:07
  Alex Kotran: And their response was but there's actually something really important about having sort of like a broad knowledge about sort of history and how we got to where we are.
• 21:18
  Alex Kotran: And so is it okay to like miss out on that?
• 21:20
  Alex Kotran: Like, and I and I guess that brings us to if you're gonna start to get into core subjects, how do we determine, you know, what aspects of let's say math or or English or social studies or science are the non-negotiables?
• 21:32
  Alex Kotran: And then where do we start to identify the places where it's like, oh, is this actually critical to being a citizen?
• 21:39
  Alex Kotran: Um, I think AP European history probably is an example of something that I could have swapped out with maybe a slightly more open ended uh course.
• 21:48
  SPEAKER_01: But do you really believe that you don't pull from your historical knowledge in understanding the world today?
• 21:54
  Alex Kotran: I believe I do.
• 21:55
  Alex Kotran: Okay, you do.
• 21:56
  Alex Kotran: Yes.
• 21:56
  Alex Kotran: Okay.
• 21:56
  Alex Kotran: But I think it's if you were to ask me like what asp what like What history class or what semester of history class could you have gotten away with?
• 22:05
  Alex Kotran: Like not having gone through?
• 22:06
  Alex Kotran: And I think it's hard because you'd say European is what I'm hearing.
• 22:09
  Alex Kotran: Yeah, but that was that's because it was like I'd already sort of completed all of my sort of like requirements.
• 22:14
  Alex Kotran: That was like a senior year kind of thing.
• 22:16
  SPEAKER_01: So I I have some theories here, but I think this is a place that we do need to do a lot of further study together as a field and to have some honest conversations around how we might Marie Kondo and how we might preserve the standards that are most important.
• 22:30
  SPEAKER_01: Um well, first thing is we know, particularly from reading, that knowledge of the world predicts your ability to read all kinds of things.
• 22:37
  SPEAKER_01: And it's a density of knowledge, the vocabulary map that exists in your brain that allows you to read a wide range of texts.
• 22:44
  SPEAKER_01: And actually, what makes someone able to read a text like Immanuel Kant in college is less about like reading ability and actually about knowledge of the world and all the interrelated content that's there.
• 22:54
  SPEAKER_01: And so there is this danger where if we cut off knowledge, bodies of knowledge of the world, we do actually make further learning on those related tracks more difficult.
• 23:05
  SPEAKER_01: But we also know obviously we we need to get uh we need to kind of focus a little more.
• 23:10
  SPEAKER_01: So in my mind, the visual that makes sense is one of like a tree where there is like a tree trunk of core knowledge that we might expect all students to really deeply understand and master that goes maybe up to sixth grade.
• 23:24
  SPEAKER_01: And then very soon, then there a branching begins and then different pathways emerge.
• 23:29
  SPEAKER_01: And the smarter that we can be about durable skills and like what are required for different professions, and the more honest we can be with students, we can then say, like, hey, going down these knowledge pathways open up these doors, but then they might close others.
• 23:42
  SPEAKER_01: And the earlier that we can help students be agents of the pathways that they choose, the knowledge that they acquire, the skills that they acquire, you start to maybe imagine a different learning system.
• 23:52
  SPEAKER_01: I think Diane Tavner uh at FutureMe is doing something similar where she's trying to map out all of the different professions and then all of the skills progressions that would lead to different possible learning places.
• 24:03
  SPEAKER_01: Um, I think some of the curriculum companies are also trying to think about how might we take our high-quality instructional material.
• 24:11
  SPEAKER_01: And instead of having all students progress in a linear way, what might a kind of nonlinear progression through our curriculum look like?
• 24:19
  SPEAKER_01: And what are the different pathways?
• 24:20
  SPEAKER_01: We know there's not just one way through the math standards.
• 24:22
  SPEAKER_01: There are probably multiple ways through.
• 24:24
  SPEAKER_01: And those pathways depend.
• 24:26
  SPEAKER_01: Like if you are planning to go on a calculus route, if you're trying to go a data science route, if you're trying to go like a general math route, there might be different pathways through math where all of them set you up with the ability to think critically, to analyze data, to make arguments, to model, but they might also point you towards different career pathways so that we don't have to kind of jam the curriculum full of everything, but students are still having a lot of agency and choice around the paths that they want to progress.
• 24:52
  SPEAKER_01: Potentially lots of equity issues there, potentially lots of guardrails and safeguards that need to be put in place.
• 24:58
  SPEAKER_01: But theoretically, we could be helping students make more informed choices around narrower standards earlier in their high school in their secondary progressions in particular.
• 25:11
  Alex Kotran: It feels like it's gonna be really hard to get this right without being in a place where we can really trust teachers to do this and make some of the calls, especially in this exploratory moment where you know, in 10 years maybe we will have enough data.
• 25:29
  Alex Kotran: I I'm I'm incredulous of that, but let's just go with it.
• 25:31
  Alex Kotran: Let's say in 10 years we do everything right, we have all the research, and we're like, okay, here are the new standards, whatever they are.
• 25:39
  Alex Kotran: But in that, in that journey, there's gonna be a lot of I think experimentation, and we have to be careful, right, that we don't condemn an entire generation of students to potentially bad outcomes, you know, while we wait for the right state.
• 25:53
  Alex Kotran: I think that's where I'm I'm caught between, yes, I knew I think we do need more research.
• 25:57
  Alex Kotran: I just I worry about going to a school and saying, well, you should just sit tight and hold off on innovation until we have all the answers.
• 26:06
  Alex Kotran: Maybe we won't have any, and we won't never have the answers by the time we have all the answers from the research that we're doing now.
• 26:12
  Alex Kotran: I mean, the career pathways might shift again.
• 26:15
  Alex Kotran: Are there any examples that you've seen where schools have done a good job?
• 26:18
  Alex Kotran: And let's focus maybe on underserved communities so that it's you know, schools working within like like resource constraints or constraints of of other kinds that have been successful in changing the way the teachers see themselves.
• 26:34
  Alex Kotran: You mentioned like 19%.
• 26:36
  Alex Kotran: I think it was is that the same stats like how many teachers would recommend the profession?
• 26:41
  Alex Kotran: I think there's something similar to that where it's like a vanishingly small portion of teachers would recommend the profession to somebody.
• 26:46
  Alex Kotran: It's 14%, I believe.
• 26:48
  SPEAKER_01: 14% that would recommend the profession.
• 26:50
  SPEAKER_01: For the friends or family, I think the net promoter score for being a teacher right now is around negative 50.
• 26:54
  SPEAKER_01: Wow.
• 26:55
  SPEAKER_01: So two things here.
• 26:56
  SPEAKER_01: One, we really believe working alongside educators and co-creating is really, really important right now.
• 27:04
  SPEAKER_01: We know that in times of uncertainty where conditions are shifting, you can't just be some expert in an ivory tower and just assume that that's gonna work.
• 27:12
  SPEAKER_01: You actually need to be designing alongside educators, helping them understand how to learn responsibly with students.
• 27:19
  SPEAKER_01: Like that's where our work is.
• 27:21
  SPEAKER_01: And when we have gathered teams of school teams together or district teams together to work on how they're gonna evolve teaching and learning in the age of AI, educators get really, really excited.
• 27:33
  SPEAKER_01: And it's a conversation where you can be real about the risks, but also really, really concrete about the visions that we want for kids.
• 27:40
  SPEAKER_01: Because right now, almost every district has a portrait of a graduate that they're hoping all of their high schoolers graduate with, but it's not always concrete and it's not always tied to changing conditions in terms of tech and society.
• 27:52
  SPEAKER_01: I think educators really want to be a part of that conversation and to shape what that looks like and to kind of reimagine how classrooms and school spaces and um community collaborations would look.
• 28:02
  SPEAKER_01: And folks get really excited.
• 28:03
  SPEAKER_01: You know, our teams ran together this rural AI Schools of Excellence collaborative with districts across the southwest.
• 28:09
  SPEAKER_01: And I was pulled aside by a superintendent and teacher recently, being like, it was the most impactful professional learning they'd ever done.
• 28:15
  SPEAKER_01: And it was really because they were thinking about well, how do we make the vision that we want for all our learners real in our schools?
• 28:21
  SPEAKER_01: And just have the time to collaborate and think that through with expertise, with insights.
• 28:26
  SPEAKER_01: The other thing I would just say, in terms of leaving a generation behind, uh, in terms of what content matters, I think there's a both and here, back to the math example we were talking about earlier.
• 28:37
  SPEAKER_01: You can learn both the math content and how you learn it could incorporate the durable skills so that it is kind of more interactive.
• 28:45
  SPEAKER_01: It is more around the modeling and argumentation.
• 28:48
  SPEAKER_01: And I hear a lot of times it's either one or the other.
• 28:50
  SPEAKER_01: I was recently talking to a superintendent where they were really excited that um students were really collaborating and really discussing.
• 28:59
  SPEAKER_01: And at the same time, one of the concerns we had is the collaboration was happening with a text that was, you know, these were fourth graders using a first grade text.
• 29:07
  SPEAKER_01: And so that's, I think that's a false trade-off.
• 29:09
  SPEAKER_01: We don't want folks to be collaborating, but on something that's wildly inappropriate in terms of what the science of reading says.
• 29:17
  SPEAKER_01: We have to kind of hold both what we know about the content disciplines and evidence base there, and also make sure that we're um thinking about how that lines up with durable skills.
• 29:28
  SPEAKER_01: And I think that's going to be really challenging.
• 29:29
  SPEAKER_01: And so one of the folks we just brought on our team, she actually does came from an MIT lab on play-based assessments.
• 29:37
  SPEAKER_01: And so her whole lab was like specializing in like how do we actually help students reflect on their metacognition to reflect on their agency, on their problem solving while they're in the content disciplines.
• 29:48
  SPEAKER_01: And I think we're experimenting now, like, how can we make that really easy for educators to deploy in their classes or for kids to use?
• 29:54
  SPEAKER_01: Because like we're talking about adding another layer of things on top of the content.
• 29:58
  SPEAKER_01: And that that could be really challenging.
• 30:00
  SPEAKER_01: But that might also be the place where technology or other things open up.
• 30:03
  SPEAKER_01: I think we were both in London with the Google DeepMind team.
• 30:07
  SPEAKER_01: I don't know.
• 30:07
  SPEAKER_01: Did you play if they're new durable skills assessments?
• 30:10
  SPEAKER_01: Yeah.
• 30:10
  SPEAKER_01: So like it's kind of, I mean, they're, you know, they're they're still working on it, but there's like ways to then assess collaboration and I think conflict mediation they had.
• 30:19
  SPEAKER_01: But like, I think we I think there's going to be a whole nother set of things that we pay attention to, but we have to find ways to do it such that we're not overwhelming students and educators.
• 30:28
  SPEAKER_01: There's a lot of ones.
• 30:29
  Alex Kotran: No, I'll take that.
• 30:30
  Alex Kotran: I I think so so the answer might not be you throw out an entire semester of social studies.
• 30:37
  Alex Kotran: It might be that, you know, can you identify research projects that are aligned to the standards that you're supposed to be teaching, um, but that give students a chance to go and you know learn about history in the way that it intersected maybe with their community, right?
• 30:53
  Alex Kotran: And like giving them a project where they're going and interviewing if I was a history teacher, I would have kids go to a um uh senior living homes and interview residents and sort of like collect these sort of like oral histories of different, you know, historical topics.
• 31:05
  Alex Kotran: So so yeah, I I I I I I like this idea that there's not we like literally shouldn't have to choose between the two.
• 31:13
  Alex Kotran: That's sort of the point that I'm hearing.
• 31:15
  SPEAKER_01: And it's often built into our standards.
• 31:18
  SPEAKER_01: We just are not kind of pulling that part up.
• 31:20
  SPEAKER_01: So in the science standards, to your point about like learn about what's happening in your community, we know that phenomenon-based science is a core part of the new science standards, which is literally helping students understand the phenomenon that are happening in their communities.
• 31:34
  SPEAKER_01: The best science curriculum and the best science teachers are already doing that.
• 31:37
  SPEAKER_01: It's almost kind of pulling up how do we lift up that lens of inquiry and curiosity exploration such that more students are getting access to that type of instruction.
• 31:48
  Alex Kotran: That was one of the criticisms that I got after we published the the Burning Glass report was you looked at standards, but the standards actually are not the same as the assessments.
• 31:58
  Alex Kotran: It isn't the case that schools are assessing all of the standards.
• 32:03
  Alex Kotran: And one thing that you you you said is you know, AI could help us with that assessment.
• 32:09
  Alex Kotran: I just want to just you know, for our audience, like if you're not a education policy nerd, like I think part of what you're getting at, if I may just draw it out, is we have all these standards for durable skills.
• 32:20
  Alex Kotran: If you actually go through this through uh core subjects, you'll find critical thinking, for example, across I think all the core subjects, even in computer science increasingly.
• 32:28
  Alex Kotran: Um but in the in the tests that students take, they we aren't necessarily evaluating them on critical thinking to the extent that maybe we should.
• 32:38
  Alex Kotran: And uh part of the reason is because like there was this test in uh uh Jeff Riley, who's the former chancellor of education for um state of Massachusetts, was telling me about when he was at Baltimore Public Schools.
• 32:49
  Alex Kotran: We heard the Ms.
• 32:50
  Alex Kotran: PAP.
• 32:51
  Alex Kotran: I don't know the MISPAP.
• 32:52
  Alex Kotran: Um this was this was uh one of the most famous standardized tests uh because it was pretty much the only standardized test uh that uh in Jeff's recollection that his students were excited to take because it measured uh uh uh collaboration, communication, durable skills, critical thinking.
• 33:10
  Alex Kotran: And you student basically students were on teams and they would go and basically work on problems together in groups.
• 33:18
  Alex Kotran: And the test was basically a casualty of No Child Left Behind because students weren't given an individual score, they were given a score at the building level.
• 33:26
  Alex Kotran: And in sort of this moment where everybody was obsessed with having like really, you know, like specific data to each student, it was sort of seen as like not the right use of time and resources.
• 33:35
  Alex Kotran: But Jeff's point was like we know how to do this, like it just part of the challenge is like logistics, you know, it's sort of actually just really hard to do things like measuring, you know, students, you know, assessments that aren't on a Scantron.
• 33:48
  Alex Kotran: Um, it becomes a lot more qualitative.
• 33:50
  Alex Kotran: And how do we do that in a way that's you know fair across multiple, you know, teachers, let's say.
• 33:55
  Alex Kotran: And I think this is perhaps where AI does offer some opportunities.
• 34:00
  Alex Kotran: And it's like I have to be careful because I'm I'm worried about relying on the AI for assessments.
• 34:04
  Alex Kotran: At the same time, it does feel like it could be key to unlocking, you know, some of these different ways of measuring.
• 34:11
  Alex Kotran: And also like if you talk about you also talked about uh iteratively adjusting the learning path based on what how students are sort of learning and or how they're performing on, let's say, sort of like interim assessments.
• 34:24
  Alex Kotran: And I feel like that level of personalization does require some additional tools.
• 34:30
  Alex Kotran: How do you do you think this is the moment where we should be like leaning into like with respon like with responsible uh caution and oversight?
• 34:39
  Alex Kotran: But um like has your team started to actually work with schools on piloting some of this stuff?
• 34:45
  SPEAKER_00: Yeah, I mean, I think you said so much.
• 34:49
  SPEAKER_00: Um, one, I love the idea of it.
• 34:51
  SPEAKER_01: If you're free to respond to any one of those, and well, I love the idea of a collaborative assessment that gets at at things that become hard to measure be as a as a sign of what we what we care most about.
• 35:01
  SPEAKER_01: And I I wholeheartedly agree that assessment and formative assessment and a whole new type of assessment, ambient assessment, automatic speech speech recognition.
• 35:09
  SPEAKER_01: I think there's a whole world that's opening up in terms of how we can lift up data for students in terms of their own learning and also obviously for educators as well.
• 35:19
  SPEAKER_01: I think there's some really powerful things that are emerging right now.
• 35:22
  SPEAKER_01: And things like obviously like Kidum and Atlas, so it's where it's built even right now, such that formative assessment on today can inform what the lesson looks like tomorrow.
• 35:30
  SPEAKER_01: I think that there are many folks who are building things in that space.
• 35:34
  SPEAKER_01: And I think I would follow for sure to your point about caution, I would definitely follow the evidence base.
• 35:41
  SPEAKER_01: I would look at how those tools are being tested, whether it's an A-B test or something more rigorous to understand does it actually improve learning, does it improve agency?
• 35:51
  SPEAKER_01: I would obviously want to be really cautious about how the tool is designed and how those assessments serve a wide and diverse range of students, and obviously how then the data is used and who owns that data over time.
• 36:03
  SPEAKER_01: But with those caveats, it seems like a very, very powerful feature because I think what AI will be very good at, obviously, is to analyze the data, surface the insights, and then to make personalization happen.
• 36:15
  SPEAKER_01: And that moves the human, the educator in the room towards a more relational, more inspirational, more social type of facilitator of learning.
• 36:24
  SPEAKER_01: And I think that is almost certainly the direction we're gonna go, assuming that we do these things responsibly and we actually earn the trust of educators, of students, of community members, because I think the other risk of all of this, as we're seeing obviously in some states, is that if it's not done with a lot of transparency and a lot of evidence base, we're gonna see all kinds of pushback on technology.
• 36:47
  SPEAKER_01: And I think that that's I think we're gonna have some really uh I think we are kind of at an inflection point.
• 36:53
  Alex Kotran: Yeah.
• 36:54
  Alex Kotran: Are you you are you encountering a lot of pushback?
• 36:56
  Alex Kotran: We definitely are.
• 36:57
  SPEAKER_01: Um not yet.
• 36:59
  SPEAKER_01: But I think our our stance is really around helping districts use the tools responsibly.
• 37:05
  SPEAKER_01: And so I think there's less less pushback on us directly since to your earlier point, we're not necessarily a tool provider.
• 37:12
  Alex Kotran: Yeah, we I right.
• 37:13
  Alex Kotran: We're we're not encountering pushback on AIDU.
• 37:15
  Alex Kotran: We are we are our partners are encountering a lot of pushback.
• 37:18
  Alex Kotran: Oh yeah.
• 37:19
  SPEAKER_01: And so wait till the new Toy Story movie comes out.
• 37:23
  SPEAKER_01: Oh, is it AI?
• 37:25
  SPEAKER_01: Yeah, the the villain is an iPad and AI.
• 37:27
  Alex Kotran: Oh my god.
• 37:29
  Alex Kotran: What is your stance on screens?
• 37:31
  Alex Kotran: And I won't we don't have to talk about screens.
• 37:34
  SPEAKER_01: Um I think it's about discernment.
• 37:36
  SPEAKER_01: I mean it's about discernment, right?
• 37:37
  SPEAKER_01: And making sure that things are age appropriate and high quality and and useful.
• 37:41
  unknown: Yeah.
• 37:42
  SPEAKER_01: We can talk about screens if you want.
• 37:44
  SPEAKER_00: I'm sure that I'm sure you've got a lot of guests.
• 37:46
  SPEAKER_00: I don't know.
• 37:46
  Alex Kotran: I don't I don't know what my position is on screens.
• 37:49
  Alex Kotran: I mean, I I roughly do.
• 37:50
  Alex Kotran: I mean, like I I think it is probably a good thing for kids to spend less time on social media, broadly speaking.
• 37:56
  Alex Kotran: Yep.
• 37:57
  Alex Kotran: And to the extent that that is in interfering with their learning, definitely finding ways to address that.
• 38:03
  Alex Kotran: Um at the same time, it's hard to imagine how you could do a let's say in-depth research project that makes use of all the amazing research tools at your disposal if you're don't have access to a Chromebook and or a computer of some kind.
• 38:18
  Alex Kotran: And so are we robbing kids of are we literally throwing the baby out of the bathwater in an effort to protect kids by actually like removing something really important uh you know learning tools that you know whether they're necessary or but certainly extremely valuable um in certain in certain learning uh uh contexts.
• 38:40
  Alex Kotran: But that resonates?
• 38:42
  Alex Kotran: Yeah, yeah.
• 38:43
  Alex Kotran: But I don't know how to I don't know how I would respond if I was a if I was a superintendent of a school where you know the parents are you know showing up to the school board meeting and if they're like virulently anti screens, is that the hill that you die on?
• 38:55
  Alex Kotran: I'm not sure.
• 38:57
  Alex Kotran: I one thing that you you talk about is what before we before we move too far from this topic, is I want to hear more about your team, like like your experience building some stuff.
• 39:06
  SPEAKER_01: Okay.
• 39:07
  Alex Kotran: Um, but you did uh what was the language that you used that I wrote down?
• 39:12
  Alex Kotran: It was um Have you been writing?
• 39:15
  SPEAKER_01: I'm I'm impressed that you're able to No, no, this is just like my pre-notes.
• 39:18
  Alex Kotran: And I sort of just like I had the AI try to like simplify it a little bit.
• 39:22
  Alex Kotran: It wasn't it's actually now I'm just like reading the AI synthesis of what I had written down.
• 39:26
  Alex Kotran: So um AI has not been helpful in this situation.
• 39:31
  Alex Kotran: Um okay, you you had this concern about cognitive offloading.
• 39:35
  Alex Kotran: Absolutely.
• 39:36
  Alex Kotran: And usually this is a conversation that we have when we talk about kids.
• 39:40
  Alex Kotran: And, you know, is AI going to get in the way of their learning?
• 39:42
  Alex Kotran: And we can have that conversation if you want, but I'm actually really interested in, you know, some of the ways, some of the times that I've heard you talk about this, it's actually in the context of teachers.
• 39:49
  Alex Kotran: Yeah.
• 39:49
  Alex Kotran: When you talk about efficiency, we hear a lot about, oh, teachers could use the, you know, use AI to, you know, shorten or differentiate their lesson plans.
• 39:57
  Alex Kotran: How like if you're a school leader, how do you, how do you advise a school leader who's coming to you and saying, well, you know, I'm thinking five, 10 years down the road.
• 40:07
  Alex Kotran: And if all of our teachers, if their instinct is just to rely on the AI to do the hard stuff of like actually taking a lesson and like actually redesigning it to be more project-based and career connected, like that actually is a muscle I want my teachers to have.
• 40:22
  Alex Kotran: Um yeah, I mean, yeah.
• 40:24
  Alex Kotran: How do you how do you respond to that?
• 40:26
  SPEAKER_01: So we're so we're doing a lot of this right now, and we're working with four different districts to design uh AI-enabled tools linked to illustrative mathematics to help teachers internalize the content, rehearse and practice the content with each other, and then actually scaffold the content based on where their students are.
• 40:46
  SPEAKER_01: And so we've gone through three cycles of data, and it's I think it's kind of fascinating.
• 40:49
  SPEAKER_01: So, and I think there's a lot of lessons for us as leading educators and some humble lessons that we should be taking in.
• 40:55
  SPEAKER_01: So I don't think these are actually lessons necessarily about teachers and learning.
• 41:00
  SPEAKER_01: It's maybe us and kind of us learning how to be better tool designers as well.
• 41:05
  SPEAKER_01: And we started trying to build tools based on what we know about good instructional coaching, which is that you always want the coache doing most of the thinking.
• 41:14
  SPEAKER_01: Right.
• 41:14
  SPEAKER_01: And so as we as we plan for any lesson, like you want to be thinking about, well, what's the most important math in this upcoming lesson?
• 41:21
  SPEAKER_01: What does what does mastery look like by the end?
• 41:23
  SPEAKER_01: And what would I want to see in the exit ticket to indicate that a student really gets this math concept?
• 41:28
  SPEAKER_01: And what might be some of the most common misconceptions or missing prerequisite skills that will surface?
• 41:32
  SPEAKER_01: And how do I then, through questioning and examples, scaffold for those missing pieces?
• 41:36
  SPEAKER_01: And so we basically designed um internalization protocols where teachers, if you had like five minutes, if you had 10 minutes, if you had 20 minutes, EA would actually kind of quiz you on your upcoming lesson.
• 41:47
  SPEAKER_01: And it would be like, hey, okay, what's the most important math?
• 41:50
  SPEAKER_01: You have the student Alex, based on their data from the last unit.
• 41:53
  SPEAKER_01: Well, what might you expect they might struggle with in this next lesson?
• 41:57
  SPEAKER_01: When Alex says that, what question might you ask to respond?
• 42:00
  SPEAKER_01: And because then the AI coach had then been trained on illustrative mathematics and also the knowledge graph of math standards, you would expect that it would give really good responses.
• 42:10
  SPEAKER_01: Well, what's interesting, like, so that's an app that doesn't give you a lot of um answers, it gives you a lot of questions and forces you to do a lot of thinking.
• 42:19
  SPEAKER_01: And so we did actually find that usage was less than we expected, the more that we didn't provide answers.
• 42:24
  SPEAKER_01: And so we're trying to balance like, well, what's the right amount of sweetener that we are like answer giving that we want to give as work is happening?
• 42:32
  SPEAKER_01: And we also saw predictably that depending on how experienced the teacher was of the curriculum, they were then less likely to use it.
• 42:38
  SPEAKER_01: But we actually have also seen, interestingly, teachers who use the questioning app uh pretty consistently are then more likely to actually use illustrative mathematics and teach the hardest parts of the lesson and teach the lessons with a higher degree of skill.
• 42:51
  SPEAKER_01: So that's kind of encouraging.
• 42:53
  SPEAKER_01: But then total implementation rate, still only 10%.
• 42:57
  SPEAKER_01: So that's not great.
• 42:58
  SPEAKER_01: And so then now we're thinking about well, what is the actual social context?
• 43:02
  SPEAKER_01: And when would you want to be using this tool, whether it's in a professional learning community or in a coaching visit?
• 43:08
  SPEAKER_01: Like, what would what would this tool actually replace and make easier for teachers?
• 43:12
  SPEAKER_01: Because we can't just design something that adds more work, even if we think that it's helpful.
• 43:16
  SPEAKER_01: And so we're really trying to think about how do you design it so that it fits into the natural workflow of an educator, so it doesn't feel like an additional thing to do, but also creates a lot of thinking and not just like answer giving.
• 43:27
  SPEAKER_01: Yeah.
• 43:27
  Alex Kotran: So then no, no, it totally makes sense because ultimately they can just go to Chat GPT if they're like, for sure.
• 43:34
  Alex Kotran: Like, no, I just want the lesson to that's right.
• 43:36
  Alex Kotran: I don't want to have a Socratic seminar right now.
• 43:38
  SPEAKER_01: Don't patronize me, right?
• 43:39
  SPEAKER_01: And so I think there's also a way to kind of like, are you in the mood for a Socratic seminar?
• 43:44
  SPEAKER_01: Are you in a mood for just a direct answer?
• 43:46
  SPEAKER_01: And then there's some variation.
• 43:47
  SPEAKER_01: I think we're trying to think about what are the most useful suites of tools for educators.
• 43:52
  SPEAKER_01: And I think for us, that also means like listening to teachers when they're saying, like, yo, this tool is asking me too many questions and like taking that seriously and not just say assuming that we know better.
• 44:03
  SPEAKER_01: And that's obviously really, really important.
• 44:05
  SPEAKER_01: And so that's gets into like user design and testing with teachers.
• 44:08
  SPEAKER_01: And so these are all new lessons for us right now.
• 44:12
  Alex Kotran: I just I wonder, I mean, do you think there's any I don't know if there's any product based solution to this because I don't think there's do you think there's a I need to learn how to phrase these questions.
• 44:22
  Alex Kotran: Do you think there's a product-based solution to the problem of um discernment in the sense of a lot of interacting with AI and AI skills actually comes down to just being self-conscious about, you know what, I could use AI to like to take myself as an example to, you know, write a blog post or you know a Substack post.
• 44:45
  Alex Kotran: And yeah, I could probably get away with it, but at certain point I'm going to lose my voice and this will just sort of become the AI's voice.
• 44:52
  Alex Kotran: And so I'm just intentional about not over relying on the AI.
• 44:58
  Alex Kotran: But I don't know that there's I've tried to create tools that sort of like replicate that, but oh yeah, it either it just doesn't do a good job and I end up reverting back to my previous workflow or or it's it just like it's I find myself just having to like almost like I'm like helping it along.
• 45:14
  Alex Kotran: It's not necessarily um like I haven't gotten the I haven't figured out how to build like an AI writing assistant that like sort of like works with me on the the outline.
• 45:24
  Alex Kotran: It's like it's often just spitting out an outline and I'm just like working backwards off of like what it thinks that I should be writing.
• 45:30
  Alex Kotran: Is that something we just have to come to terms with that like this is just going to be part of being an AI user is getting to a place where we can trust teachers to make those calls.
• 45:39
  Alex Kotran: Such a great question.
• 45:42
  SPEAKER_01: I'm I'm not sure is my is my honest answer.
• 45:45
  SPEAKER_01: I I like the way that you framed it that it is about discernment and you're not feeling like there's anything that actually captures your authentic voice.
• 45:53
  SPEAKER_01: And then I wonder what are the uncapturable moments of teaching we know from Deborah Ball's work that on average a teacher makes about 200 um moments of decision in a class that there's so many that happen all the time in terms of how you validate a student's response, how you correct an answer that might be slightly wrong, how you get students to work together.
• 46:17
  SPEAKER_01: There are so many moments of decision.
• 46:19
  SPEAKER_01: And I think oftentimes when people talk about the the power of AI for learning or AI tutors, I mean it's true that we have powerful tools, but people maybe haven't seen the hundreds of decisions that a classroom teacher is making every day that are about relationships, about identity, about connection.
• 46:37
  SPEAKER_01: And obviously there are ways to kind of make those decisions better.
• 46:41
  SPEAKER_01: And I think there's a way in which AI could analyze the data and the choices and actually lift up patterns that maybe are unintentional or unhelpful that actually might yield to the discernment.
• 46:51
  SPEAKER_01: But at some point there is also that human judgment that kicks in.
• 46:55
  SPEAKER_01: So I I think about how might AI kind of create the heat map or the dashboard, but then what is the actual protocol that allows a person to change and make adjustments.
• 47:03
  SPEAKER_01: And I at this moment I think it's interesting where I think some people really like feedback from AI because it feels less judgmental and feel safer than a human coach.
• 47:13
  SPEAKER_01: But other people obviously still want and value that human relationship to make sure that they are like really seen and really valued and have and the person they're talking to has real expertise to pull from yeah you get to the there's a shortage of instructional coaches.
• 47:30
  Alex Kotran: Yep.
• 47:31
  Alex Kotran: And so on the one hand, could AI help to bridge that gap?
• 47:34
  Alex Kotran: That sounds exciting.
• 47:35
  Alex Kotran: On the other hand, if AI can bridge that gap does that then reduce the urgency for a district leader to backfill the instructional coach position that they've been trying to hire for yeah well one one interesting piece of feedback that we got on some of the tools that we were designing.
• 47:51
  SPEAKER_01: So we're an organization that I think is really good at coaching and professional learning.
• 47:55
  SPEAKER_01: And one user was why are you designing AI tools around the thing that you're best at the coaching and professional learning why not design the AI for the places where there's actually a lot of drudgery and a lot of paperwork and a lot of data analysis and operations.
• 48:12
  SPEAKER_01: Help us save those five to 10 hours a week of the things that we don't want to be doing so that we can use more of the time on things that are uniquely human.
• 48:20
  SPEAKER_01: And that seemed like a really nice place to start.
• 48:23
  SPEAKER_01: And so maybe if we focus on the things that we think are the highest value add, that are our unique superpowers, where we have the greatest depth of expertise and then start on the places that should be automated because nobody wants to do them and they're not adding a lot of value to learning or relationships, that might be a safer place to start anyway.
• 48:41
  SPEAKER_01: It feels tied to this idea of you know teachers I mean I think it's amazing.
• 48:46
  Alex Kotran: I think every teacher if they're still in the role right now, I mean they're like truly a superhero because they have had every reason to leave the profession.
• 48:52
  Alex Kotran: They're one of the most overeducated relative to what they're getting paid.
• 48:57
  Alex Kotran: Like most teachers have more education than I do that I talk to because it's like I don't have a master's degree.
• 49:04
  Alex Kotran: And and they're sort of treated as like pawns in this like the grand strategy of education.
• 49:09
  Alex Kotran: It's like oh how do we how do we leverage teachers to do this or empower them to do that.
• 49:13
  Alex Kotran: But it's um there's something powerful about saying like no you actually have this really important expertise.
• 49:21
  SPEAKER_00: Yeah.
• 49:21
  Alex Kotran: And we want you to like bring that to the table and we yeah like our role is how do we learn from you and yes get other sort of pieces out of the way.
• 49:31
  SPEAKER_01: You probably know have we told you the story that my family is my mom's family is from Singapore.
• 49:36
  SPEAKER_01: And when I head back to see family sometimes have time to meet with the Ministry of Education over there.
• 49:42
  SPEAKER_01: And one of the things that they shared is that they have 125 teacher leaders.
• 49:47
  SPEAKER_01: They're master educators of Singapore.
• 49:49
  SPEAKER_01: They are paid as much or more than any education official in the country and those 125 teachers are the ones that decide what great teaching looks like at in Singapore.
• 50:00
  SPEAKER_01: They actually look at all the research coming out of the United States and they decide hey this is what it looks like in Singapore.
• 50:06
  SPEAKER_01: They write the protocols, they film the videos and then that's what becomes the definition of great teaching.
• 50:11
  SPEAKER_01: And I haven't spoken to them recently but in my mind at this moment in terms of AI, there's no doubt that those are the ones who are then actually testing and figuring out what it looks like in great classrooms and in great learning environments.
• 50:23
  SPEAKER_01: Like we that's the power of actually having that lived experience as an educator.
• 50:28
  SPEAKER_01: Like you can't actually reduce that and there's something really essential and valuable at about at this moment in terms of engaging in terms of policy and what great teaching will look like in the future, which is why we at leading educators are so passionate about co-creating with with amazing educators around the country.
• 50:45
  Alex Kotran: Yeah it feels like the the only way to because the the trouble is we're trying to scale basically change management and like school transformation in service of creating like cultures of innovation and lifelong learning right like it's like it's very it's really hard to scale something like that which is like deeply human.
• 51:07
  Alex Kotran: It's complicated it varies from community to community the challenges change uh the resources change um there really isn't a broad asynchronous like learning credential that we just like every teacher needs to get this credential and then they're going to be good to go.
• 51:24
  Alex Kotran: But yeah Singapore is an interesting uh example of if you if you really center uh teachers as the main characters in the story this is my new my new tagline is like we we need to be talking about the teachers and then the AI is sort of like the supporting player um I feel like we get to the conversation about teachers through AI and like and I feel like we actually need to reverse that.
• 51:45
  Alex Kotran: Is is Singapore similar to Japan and like Korea where it's actually like one of the most sought after like jobs that you can get like you try to get into it is you know become a teacher and if you fail it's like okay am I fallback I'll I guess I'll try to get into medical school.
• 51:59
  SPEAKER_01: Yeah it's really hard.
• 52:00
  SPEAKER_01: In fact, you know I was talking to the ministry in Singapore they only select 700 teacher candidates every year and they all come from the top of the graduating university classes.
• 52:09
  SPEAKER_01: And once you're selected as one of those future educators, all of your um undergrad and grad school are paid for and from day one of training you get the curriculum that you'll be using you start to kind of envision what your classroom will look like.
• 52:23
  SPEAKER_01: All of that happens uh very early in once you're kind of selected as a teacher candidate.
• 52:28
  Alex Kotran: Do you have a sense for I mean I I've my guess is that they get paid a lot more than teachers here.
• 52:33
  Alex Kotran: It is more um but I think is that is is is compensation actually what's driving that I think it's a respect and the social prestige also is very important.
• 52:44
  SPEAKER_01: Not that the compensation isn't important obviously we should pay our teachers more how how turn to we should pay our teachers more we should turn we should pay our teachers more.
• 52:52
  Alex Kotran: We should pay our teachers more but I also think we should celebrate our teachers I mean I think part of this is what are like the baby steps that we can take to reframing what it means to be a teacher in a moment where we're where we clearly need a lot of help solving this.
• 53:07
  SPEAKER_01: And I I I do really think these are related problems.
• 53:10
  SPEAKER_01: And so not to think about changing outcomes like changing durable skills that are important for kids, changing learning models and then like the act with technology and then also the teaching profession.
• 53:22
  SPEAKER_01: The three are connected issues, right?
• 53:24
  SPEAKER_01: And so if we could engage and lift up examples of educators who are really creating new inspiring learning models, whether they're AI enabled or not and how they point towards a set of really inspiring durable skills, I think those examples are happening all around the country and kind of lifting up it's almost like if there was like a new grand challenge of how AI enabled instruction could really prepare future ready students, I think there could be some really powerful stuff that emerges almost instantly.
• 53:51
  Alex Kotran: Yeah.
• 53:52
  Alex Kotran: Yeah and then if you're if you are trying to build a tool that's who do you go to you're going to go to this like set of trailblazing teachers that um are going to be able to give you some really deeply informed feedback about why it may or may not work.
• 54:08
  Alex Kotran: Who it's teacher appreciation week that's what is it?
• 54:11
  Alex Kotran: It is do you have a favorite teacher that that comes to mind?
• 54:17
  SPEAKER_01: There are there are two teachers that um I think are really uh influential one Miss Mixon my seventh grade GT teacher who we had for basically half the day and who just encouraged us to be like uniquely ourselves and GT uh gifted and talented.
• 54:34
  SPEAKER_01: She spoke at my wedding uh uh 30 years later and uh she's just an incredible inspiring human who like lives with so much passion for life.
• 54:44
  SPEAKER_01: Um and then I also had my high school German teacher Frau Sessler very very important.
• 54:50
  SPEAKER_01: And I think if I had not been um an exchange student in German for German uh to going to Germany as a high schooler I don't think I would be here uh because I would say I don't know like we can but really really briefly Alex um I tell the story and and you know I it took me a long time to realize that the reason I'm an educator and an educator of educators is because I came very close to taking my own life when I was 15 and didn't really feel like there was a space for me in this world as a queer Asian kid growing up without seeing anyone who kind of looked like me in in my part of Texas.
• 55:27
  SPEAKER_01: And if not for educators who saw me and who believed in me and then who honest who literally took me around the world to see other possibilities, I I don't think I would I would be here.
• 55:39
  SPEAKER_01: And so it is um I think a real honor of a lifetime to then continue to work with educators to kind of think about what is the type of learning that would allow young people to feel like they have a place in this world and that they can kind of shape uh the future they want to be in that that is like the root of the root and why I work in education.
• 56:01
  Alex Kotran: Yeah it's yeah it's we I I had I I had a really rough time I mean growing up gay it was tough.
• 56:12
  Alex Kotran: I was in Ohio so maybe not probably a different ballgame than rural Texas but wasn't rural I was in Houston so in Houston yeah different ballgame than than Texas um yeah and I was bullied being a redhead is part I mean like I wasn't out but I was just like I was a redhead I was you know my parents were foreign I'd ever been and I was also just like a goofball so like I you know I was I attracted a lot of attention and I I there was there's a lot I mean it's funny if you would ask me the question there's I had my sort of go-to answer which is my history teacher um it's really the teachers that just that loved what they did right and I like I like my chemistry teacher Mr.
• 56:46
  Alex Kotran: Young was just loved chemistry and it made me want to love chemistry even though I was not a STEM kid.
• 56:52
  Alex Kotran: And so there was there's power in that but yeah if I go earlier there's so many teachers where there's just stuff that my parents couldn't have been helped help me with like one teacher literally watched me get picked on and like had me leave the room and then just like reamed the entire class was just like this is I don't even know what she said.
• 57:13
  Alex Kotran: But after afterward like that was literally the end of bullying happened after this teacher had like literally just like what are you kids doing?
• 57:20
  Alex Kotran: I mean I don't know what she said but afterwards people would come up to me and be like I'm so sorry and and I just like that it's not that my parents couldn't didn't want to help but that's just they didn't have the the visibility or the place or the agency to do something like that.
• 57:36
  Alex Kotran: And my mom is a my mom is a she's retiring this year but she was she's an assistant principal who handles discipline disciplinary issues.
• 57:44
  Alex Kotran: And so it's like literally every day she is like simultaneously these teachers are playing this role of like therapist and being in the receiving end of a lot of like the challenges that students are dealing with but then also taking action um and and it just drives me crazy that we're we we we don't even acknowledge like like the conversations are still so often how do we do how do we deal with these teachers who are they're not doing a good job in like the um and I thought post COVID that would change it didn't change I don't think um I think it's gotten worse.
• 58:21
  Alex Kotran: You think it's gotten worse.
• 58:22
  SPEAKER_01: Yeah but none of what we just described could be replaceable by technology or AI at least not for a long time.
• 58:32
  SPEAKER_01: And Rish and all of it obviously illustrates how deeply human learning is and how schools are and how important real authentic relationships with educators are and how life saving that can be.
• 58:45
  Alex Kotran: And that's part of this whole idea of how do you how do we get out of teachers' ways in part teachers want to have I mean nobody gets into teaching because they want to use ed tech.
• 58:57
  Alex Kotran: I'm pretty sure I could be wrong but I mean most people are not inspired by the technology dimension of of teaching you get into teaching because you want to actually like help kids and like steer them.
• 59:08
  SPEAKER_01: I think if as long as the ed tech it I think there's a difference between ed tech that might replace like a learning experience but I I do think that some of the ed tech that where kids are actually creators and using ed tech to kind of shape and design I think and they're actually agents of learning I could I think that could be really quite different.
• 59:27
  SPEAKER_01: Because then it becomes like a an application of learning.
• 59:30
  SPEAKER_01: I I do think to your point part of why there is this deep AI skepticism among educators is because there's been so much ed tech that's been sold to our schools tens of billions of dollars of ed tech that we can't actually point to it resulting in better learning for students and at the same time seeing all this investment in technology and an underinvestment in humans I think that is also kind of lifted up like what are what are we doing?
• 59:57
  SPEAKER_01: And so I do think there's a rebalancing that's pop that's possible um and an equip and like a different type of language a different type of vision for what educators can shape right now.
• 1:00:07
  Alex Kotran: Yeah especially when um there's the uh the this engineer that Meta hired for their superintelligence lab and I think that his compensation package was$250 million.
• 1:00:23
  Alex Kotran: Maybe it was one somebody got offered a billion and declined it um and and you look at the numbers for you know even national numbers I mean yes they're in the billions but they're only in like the billions not the hundreds of billions and I mean you see like AI companies raising hundreds of billions.
• 1:00:44
  Alex Kotran: It's like there there is capital out there and I think one thing you're illustrating though is you're gonna have better outcomes.
• 1:00:55
  Alex Kotran: You're gonna have more demand for the technology if we're able to invest in the people and their ability to absorb it and channel it.
• 1:01:03
  SPEAKER_01: Yeah I'm sure you read Sal Khan's article that came out last week where even for the founder of Khan Academy there's an acknowledgement that it isn't about just the tools and the tech it's actually the human systems that enable all of this to run and be and learning to happen.
• 1:01:19
  SPEAKER_01: I also think about um this hundreds of billions of dollars we've been saying spending on AI data centers, as you know, and the idea that most of the graphical processing units, the chips that are going these data centers are going to be out of date in like two years, three years and we're gonna have to restock all of the chips.
• 1:01:36
  SPEAKER_01: And so we're spending all this capital, but the returns on the capital have such a short shelf life and if you instead imagine that you invested those hundreds of billions of dollars in humans and instead like humans don't have the same shelf life obviously and obviously over generations learning kind of compounds and we know that just kind of having one like um career trajectory education attainment and family can shift generations of outcomes.
• 1:02:02
  SPEAKER_01: And so I think there's just a very twisted view of what what's a good investment right now.
• 1:02:08
  SPEAKER_01: And I know that I know we're supposed to be talking about AI, but there is like a little bit of rebalancing and actually investing in people that feels really needed right now.
• 1:02:17
  Alex Kotran: I just I just wonder if even if you're like the a really big proponent of AI, I still think investing in people is it it it is in service of your goals ultimately because part of the challenge with all this AI investment is like well who's going to use the tools and you have a lot of these AI companies are the forward deployed have you heard of FDEs?
• 1:02:37
  Alex Kotran: No.
• 1:02:37
  Alex Kotran: This is the new term of art in Silicon Valley the forward deployed engineer.
• 1:02:40
  Alex Kotran: So you're anthropic Google OpenAI they have these engineers that will literally go embed into customers organizations and help them figure out how to like you know how do we how do you use pod or or Gemini more effectively?
• 1:02:52
  Alex Kotran: Interesting um that's kind of what we do in schools.
• 1:02:55
  Alex Kotran: It is and I'm and I'm kind of curious about because you meant you mentioned that you're doing some experimentation with the tool and you gave us like one preview um I know they're coming up on time but I mean maybe this is like with a bit of an eye towards towards the future and and putting the spotlight on leading educators.
• 1:03:10
  Alex Kotran: Yeah is there like do you see a role for this kind of like implementation sort of uh strategist that kind of plugs in like deeply understands the context but goes maybe beyond just coaching into actually like getting hands on like what is it like what are the tools that you should use and like how should you use them?
• 1:03:30
  SPEAKER_01: Yeah so this is coming up a lot and I think the way we talk about it is almost a coherence layer around schools or a design layer around schools is what's true right now is if I'm a principal or or teacher leader, there are so many ed tech tools coming out.
• 1:03:47
  SPEAKER_01: There are also new teacher leader or strategic staffing roles, different ways to use classroom educators, community educators.
• 1:03:54
  SPEAKER_01: And then there's new policies, new mandates, new curricula and so there almost needs to be a layer that wraps around a school that helps them think through how do we what's the best of what's out there and how do we apply it to our context and how do we do that in a way that's really consistent and coherent with the outcomes that we want for our kids and the ultimate visions.
• 1:04:13
  SPEAKER_01: And so we're starting to do more work around in our in our future space around model building and partnering with schools to think about well, if you were going to reimagine the literacy block or the math block in this new era, or even kind of think about what a more career connected version of learning might look like in this new era, like that's the type of new design project that we're taking on that's a little bit beyond traditional PD.
• 1:04:36
  SPEAKER_01: It's actually more towards the school model building space, which, you know, obviously we had a school model building movement like 20 years ago, but the technology and the ideas are totally different right now.
• 1:04:47
  SPEAKER_01: And so it seems like a a a necessary uh partnership opportunity again.
• 1:04:53
  Alex Kotran: Yeah it's like why like I get this question a lot which is why do we we've been trying to transform schools for for decades.
• 1:05:02
  Alex Kotran: And there's actually a lot of philanthropy leaving the space because they're throwing their arms up in the air and they're like we're just not seeing the return on investment.
• 1:05:08
  Alex Kotran: So what's different about this moment and I think that is where I'm willing to give AI a little you know sort of a nod.
• 1:05:15
  Alex Kotran: It AI makes possible things that would have previously been really really hard.
• 1:05:21
  Alex Kotran: It's like it takes teachers sometimes years to sort of dial in their curriculum and they're coming to us and saying well are you gonna you really expect me to completely rebuild all my curriculum from the bottom up so that it incorporates PBL and like I don't have the I don't have the time for that.
• 1:05:34
  Alex Kotran: And it's like well actually that it is within the realm of possibility that AI could help not entirely I I think the the can it entirely fast track it no I think that's the other side of it.
• 1:05:44
  Alex Kotran: It's like how long does it actually take it saves some time.
• 1:05:47
  Alex Kotran: Yeah.
• 1:05:48
  Alex Kotran: But you really have to be embedded to understand what that looks like.
• 1:05:52
  SPEAKER_01: W And I would offer like one of the reasons why I think we're able to do this work at leading educators is we have now a track record of moving Moving the needle for kids over 10 years.
• 1:06:01
  SPEAKER_01: I and on just to be a little braggy for a second, we're the first professional learning organization in 10 years to achieve tier one what works clearinghouse data.
• 1:06:11
  SPEAKER_01: So successful randomized control trials, successful causal studies.
• 1:06:14
  SPEAKER_01: We now have, I think, about 25 causal studies on average, where schools we're working with are seeing nine months additional growth each year with students.
• 1:06:22
  SPEAKER_01: And a lot of that is actually before the technology.
• 1:06:25
  SPEAKER_01: It is actually the hard work of adopting better curriculum, aligning conditions, aligning coaching time, providing teachers with a lot of in-depth side-by-side support and continuing to study and learn and then iterate together.
• 1:06:38
  SPEAKER_01: So on and do a lot of continuous improvement work with schools.
• 1:06:41
  SPEAKER_01: I think we're going to continue to do that.
• 1:06:43
  SPEAKER_01: And the idea is then okay, let's not just look at a curriculum and other conditions that folks are using, but let's expand it to the tech infrastructure and the AI that folks are using.
• 1:06:52
  SPEAKER_01: And then let's be really rigorous and like let's learn alongside schools that are piloting this new work and help them see like what's working and what's not.
• 1:07:00
  SPEAKER_01: And like let's be real about the barriers and also really celebrate the opportunities in an honest way.
• 1:07:04
  SPEAKER_01: Um, that's that's what I think we're seeking to do.
• 1:07:07
  Alex Kotran: And I can see that I can see why you're not necessarily running into the pushback that other like tech providers are, because I think at the end of the day, parents they want their kids to learn, right?
• 1:07:17
  Alex Kotran: I mean, I think and I think if you frame it as like, don't you want your schools to be like forward thinking about how to evolve school to meet the needs of the future?
• 1:07:28
  Alex Kotran: I mean, I think that is sort of an unambiguously, no matter how afraid of the technology you are or how excited you are.
• 1:07:33
  Alex Kotran: Um, I think the answer to that is always the same.
• 1:07:35
  Alex Kotran: I think it's it's but it's important for for folks to hear that like we are not here to rip it all out.
• 1:07:41
  Alex Kotran: And at the same time, there's like most of the stuff that's happening, or a lot of the stuff that's happening, you wouldn't necessarily even say is valuable.
• 1:07:47
  Alex Kotran: Because I think parents were also not happy about school before AI.
• 1:07:50
  Alex Kotran: It's not that everything was great and then AI came around and it's ruining it.
• 1:07:53
  Alex Kotran: It's like the status quo actually wasn't working um for many, if not most.
• 1:07:58
  Alex Kotran: So to close, I you're talking directly to a teacher or district leader, they want to start down this journey, they haven't partnered yet with leading educators.
• 1:08:09
  Alex Kotran: Um yeah, what's your piece of advice to just like how to how to just get started?
• 1:08:14
  Alex Kotran: Like where would you, what should they do over the next couple of weeks or over the summer?
• 1:08:18
  SPEAKER_01: Oh my gosh.
• 1:08:19
  SPEAKER_01: Um, well, what we tend to do with schools is to figure out what is a student-facing challenge or opportunity and to start from that actual instructional challenge and to think about like, well, what actually can AI-enabled tools do to help with that particular challenge?
• 1:08:37
  SPEAKER_01: And how might you actually gather evidence about how teaching changes and how student learning changes?
• 1:08:42
  SPEAKER_01: And we call it our AI impact cycle.
• 1:08:44
  SPEAKER_01: So we basically work with school teams over two-week cycles to think about, well, what's the barrier?
• 1:08:50
  SPEAKER_01: How can we deploy some responsible tools to help with that barrier?
• 1:08:53
  SPEAKER_01: And then how do we know if it's actually making teaching and then student learning better?
• 1:08:56
  SPEAKER_01: And then like do that over and over again.
• 1:08:58
  SPEAKER_01: And that's actually where we see the most improvement.
• 1:09:01
  SPEAKER_01: And I'll give you a really simple example of that.
• 1:09:04
  SPEAKER_01: Um, we're working with some schools in New York as part of New York City Reads, and there's pretty consistent challenges there where students are having trouble accessing the grade level text.
• 1:09:13
  SPEAKER_01: It's great that schools have adopted a more rigorous curriculum.
• 1:09:16
  SPEAKER_01: In some cases, students are then missing some of the background knowledge or knowledge that makes the text really accessible.
• 1:09:22
  SPEAKER_01: Well, it turns out in the curriculum that have been adopted, many of the schools, the curriculum company has actually trained a large language model on the exact curriculum.
• 1:09:30
  SPEAKER_01: And so you could now work with the AI to actually then figure out exactly how to scaffold the background knowledge efficiently for students and officially for teachers that gives more students access to that grade level reading.
• 1:09:42
  SPEAKER_01: And so that's a very like specific.
• 1:09:44
  SPEAKER_01: Here's a challenge, here's the like aligned technology.
• 1:09:48
  SPEAKER_01: And then let's let's really test.
• 1:09:49
  SPEAKER_01: Is it actually going to lead to deeper student understanding?
• 1:09:52
  SPEAKER_01: And let's find ways to be honest about what's working and what's not.
• 1:09:55
  SPEAKER_01: And I think that's that type of experimentation and commitment to really learning, uh, both ourselves and for students, that I think is at the heart of the work.
• 1:10:03
  SPEAKER_01: I guess the last thing I would just say is I feel like I talk to folks uh who feel behind on AI all the time.
• 1:10:08
  SPEAKER_01: They're like, oh my God, there's all this stuff coming out.
• 1:10:10
  SPEAKER_01: And then you have to remind people like, hey, that didn't actually exist until January.
• 1:10:14
  SPEAKER_01: So you're at most, you're like four months behind.
• 1:10:16
  SPEAKER_01: This is not, none of this is like too late to start.
• 1:10:19
  SPEAKER_01: And I think setting aside time for dedicated experimentation with folks who might just be a little more expert than you and to like feel safe to kind of play and understand.
• 1:10:28
  SPEAKER_01: I think that turns out to be really, really important right now because we have to keep the technology is going to continue to evolve.
• 1:10:34
  SPEAKER_01: And it's actually the ways in which we continue to learn together responsibly.
• 1:10:38
  SPEAKER_01: That's what's going to be more evergreen.
• 1:10:41
  Alex Kotran: Lifelong learning.
• 1:10:42
  Alex Kotran: I mean, so we we are we are starting to realize that lifelong learning is not just a trope that we bandy about.
• 1:10:49
  Alex Kotran: It is it is like fundamental to this this moment, is like just keep learning, stay curious, feed your cu curiosity.
• 1:10:58
  Alex Kotran: But do in a way that's structured.
• 1:10:59
  Alex Kotran: I like this, I like the call out of like if you're curious about something, like actually rigorously explore that and try to understand it and then share that with your peers.
• 1:11:08
  SPEAKER_01: And yeah, like maybe maybe on this podcast.
• 1:11:12
  Alex Kotran: Maybe on this podcast.
• 1:11:12
  Alex Kotran: Alex, yeah.
• 1:11:13
  Alex Kotran: Um, thank you so much.
• 1:11:16
  Alex Kotran: Yeah, such a pleasure.
• 1:11:16
  Alex Kotran: Thanks for having me, Alex.