Latest / The Learning Agenda / The Learning Agenda | Episode 3: Making PD Matter
Transcript
- 0:03SPEAKER_00: Okay, hi everyone.
- 0:04SPEAKER_00: Welcome back to the learning agenda with me and Michelle.
- 0:08We started out with talking about reading intervention,
- 0:12then we talked about HQIM.
- 0:15And so now a lot of the things that people are thinking about
- 0:18right now in planning
- 0:19SPEAKER_00: is really around professional learning and PD strategy for next year.
- 0:22SPEAKER_00: How do we
- 0:23build the capacity of the people doing the most important work
- 0:26in our classrooms.
- 0:27SPEAKER_00: And so Michele and I thought it would be great to think about,
- 0:30SPEAKER_00: okay,
- 0:30SPEAKER_00: let's think about all the things that professional learning PD,
- 0:35SPEAKER_00: we should be thinking about when planning for them.
- 0:37And so we wanted to anchor on an article by Elena Aguilar that
- 0:41was in ASCD about
- 0:43why most PDs doesn't work and what actually does and just
- 0:47thinking about what is
- 0:48the most effective way to think through planning for
- 0:51professional development
- 0:52SPEAKER_00: within your organization.
- 0:55Elena Aguilar actually just summarizes that really the number
- 0:58one reason that PD
- 1:00doesn't work is that it's often decontextualized or just
- 1:03separate from what is
- 1:04SPEAKER_00: actually going on in the room for people and participants.
- 1:09SPEAKER_00: So it might not take into account
- 1:11SPEAKER_00: where kids are at.
- 1:12SPEAKER_00: It might not take into account where the actual staff is at,
- 1:15SPEAKER_00: but oftentimes we're speaking different languages,
- 1:18SPEAKER_00: particularly in pullout PD.
- 1:20SPEAKER_00: So I'm going to turn it over to Michelle.
- 1:22SPEAKER_00: I would love to hear from you.
- 1:24SPEAKER_00: I mean,
- 1:24SPEAKER_00: a lot of things stuck out to me,
- 1:26SPEAKER_00: but what are the things that really stuck out for you in this article?
- 1:31SPEAKER_01: Yeah, I think it's an interesting piece.
- 1:34SPEAKER_01: Certainly a provocative one, right?
- 1:35SPEAKER_01: She calls it why most PD doesn't work and what actually does.
- 1:40SPEAKER_01: And I think I kind of had like two big reactions to this piece.
- 1:43SPEAKER_01: One, I'm right there with the lovely and talented Miss Aguilar.
- 1:49So much of the PD that teachers receive winds up not
- 1:54fundamentally meeting their needs,
- 1:56right?
- 1:56She starts with this anecdote of a teacher in a session just
- 1:58essentially saying,
- 2:00you know I just need one thing I can actually use tomorrow like
- 2:02why am I in this
- 2:03session and I'm devoting my time my time that could be spent
- 2:07doing a million other
- 2:08things and if I do not see that there's an immediate payoff
- 2:13that this is going to
- 2:14make my practice better it just does not feel like a good use
- 2:17of time right and we
- 2:18know that our educators now who have been at this for a while
- 2:21like they've seen
- 2:22this play out before they've been in every one-off PD session
- 2:26that promises them
- 2:28SPEAKER_01: some way of improving their practice that just does not materialize.
- 2:32SPEAKER_01: And I think that,
- 2:34SPEAKER_01: you know,
- 2:34SPEAKER_01: Elena Aguilar does a great job of like anchoring,
- 2:37SPEAKER_01: anchoring the reader back on like so many of the principles of just like
- 2:42you know adult learning like how do you actually make learning
- 2:44relevant for the
- 2:46SPEAKER_01: learner,
- 2:46how do you honor the expertise that adult learners bring like
- 2:48they're not coming to
- 2:49SPEAKER_01: you as blank slates.
- 2:52If we're actually going to leverage PD to result in some sort
- 2:56of shift in practice,
- 2:58then we need to know where our people are and we need to give
- 3:00them a reason why
- 3:01SPEAKER_01: they're in the room and an opportunity to apply.
- 3:04um so yeah I thought all of that really resonated and I think
- 3:07the you know the
- 3:08other thing that came up you know as you and I have been just
- 3:10really focusing on
- 3:11SPEAKER_01: this issue of
- 3:13you know what is what is the strategy that a system leader or a
- 3:16school leader is
- 3:17advancing to improve academics and I act I think like my like
- 3:20wish list I would
- 3:21want to see like a part two of this article that actually gets
- 3:24at that which is
- 3:25okay so I think her argument is very compelling we're not
- 3:28focusing on the learners
- 3:30in the room and what their actual needs are and I would add
- 3:33right I think like our
- 3:34ongoing conversation is essentially what is our system or
- 3:37school-wide strategy for
- 3:39SPEAKER_01: improving instruction
- 3:41SPEAKER_00: Right.
- 3:41And then what professional learning is needed that will
- 3:44actually help us advance
- 3:46SPEAKER_01: those end goals?
- 3:47Because in the absence of having a really clear strategy we're
- 3:52driving towards,
- 3:52SPEAKER_01: right,
- 3:53it's like we can understand why we wind up defaulting to all of
- 3:55these one-off PDs
- 3:57SPEAKER_01: that don't really amount to much in the end.
- 4:01SPEAKER_00: Right.
- 4:01SPEAKER_00: And I think like the way that I often think about PD,
- 4:04SPEAKER_00: whether the audience is for teachers or for leaders or for both,
- 4:08SPEAKER_00: is
- 4:10whatever exists in our brain as systems leaders about here's my
- 4:14here's what I think
- 4:15SPEAKER_00: is going to improve instruction.
- 4:17Here's what I think is going to drive outcomes this year for
- 4:20our students.
- 4:21It's a way to get what's in your brain out into visible actions
- 4:25in the classroom.
- 4:26SPEAKER_00: And so
- 4:27I think sometimes missing that opportunity to think about PD as
- 4:31one of the few
- 4:31opportunities to be able to actually show people what it is
- 4:35that you are talking
- 4:37about in your head when you say we need to do I don't know we
- 4:40need to develop deep
- 4:42love for math like what does that actually mean in our students
- 4:45I think that's
- 4:47for me PD is the form in which all of that thinking and the and
- 4:51the talk turns into action.
- 4:53And so it does feel I know a lot of people say that like pull
- 4:56out PD is not like an
- 4:57SPEAKER_00: effective lever for change.
- 4:59SPEAKER_00: And it's it's a very small, you know, sliver of how we make changes.
- 5:05But I actually think it's incredibly important one because it's
- 5:09it's one of those
- 5:09few opportunities we have with people to really set and show
- 5:13the bar for what we
- 5:14SPEAKER_00: mean.
- 5:15SPEAKER_01: Okay, so you're not against pull out PD.
- 5:18Yeah.
- 5:21SPEAKER_01: Yes.
- 5:23SPEAKER_01: Okay, so how do you what would your what is your guidance?
- 5:26Like,
- 5:27how do you make it actually result in the kinds of changes you
- 5:30would want to see?
- 5:31SPEAKER_01: Because I think that's a really important point.
- 5:33SPEAKER_00: Yeah,
- 5:33so I think one of the things I think about and this like
- 5:36actually came up in this
- 5:37SPEAKER_00: book,
- 5:38SPEAKER_00: the systems for instructional improvement,
- 5:40and it's about how you create coherence from the classroom to
- 5:43the network office.
- 5:45One of the things that I think resonates with me in that book
- 5:47is to think about PD,
- 5:49like a classroom setting PD where people are taking a PD day or
- 5:52the summer to sit
- 5:53in a classroom to learn with other adults as part of a much
- 5:58larger teacher
- 5:59SPEAKER_00: development system.
- 6:01That includes things like coaching,
- 6:03observations,
- 6:03walkthroughs,
- 6:05data meetings,
- 6:06etc.
- 6:07SPEAKER_00: And so for me,
- 6:08the time that you have everyone together is a time where you
- 6:11actually get to set
- 6:12SPEAKER_00: the bar on saying,
- 6:13SPEAKER_00: this is what we're looking for.
- 6:15And then obviously all the people in the room are going to have
- 6:20various level of,
- 6:23you know,
- 6:24SPEAKER_00: like mastery towards that bar.
- 6:26And then I think that's when coaching and data meetings and all
- 6:30of that is supposed
- 6:31SPEAKER_00: to get everyone to that bar.
- 6:33And so it actually,
- 6:34I think for me,
- 6:35like starts to turn the engine around coaching.
- 6:39SPEAKER_00: So oftentimes I think people think about PD differently from
- 6:43on the ground coaching in schools and actually they're like
- 6:46they're one of the same
- 6:47to me because they're part of this giant cycle of continuous
- 6:51improvement for
- 6:51SPEAKER_00: teachers.
- 6:52SPEAKER_00: And so if you don't think about it as a whole picture,
- 6:54SPEAKER_00: we kind of miss an opportunity to make coaching impactful,
- 6:57SPEAKER_00: we make miss an opportunity to use the PD time effectively.
- 7:00SPEAKER_00: And then and then so you're piecing together like very jigsaw parts of a
- 7:05professional learning system that I think should be at the core
- 7:08working together.
- 7:09I love that well and I love even just this that notion of as a
- 7:13system leader of
- 7:13teaching and learning you are responsible for the overarching
- 7:16professional learning
- 7:17system in service of your goals in service of your broader
- 7:21strategy you're not
- 7:22SPEAKER_01: just.
- 7:24SPEAKER_01: Like we have to move from being like an implementer of inputs, right?
- 7:27SPEAKER_01: Like I made the PD calendar.
- 7:28SPEAKER_01: I sourced coaches.
- 7:31SPEAKER_01: We have a coaching framework, right?
- 7:33Like all of these,
- 7:34I measured how many times we got in front of people and said X,
- 7:37Y,
- 7:37and Z.
- 7:38SPEAKER_01: Like all of these things are the inputs.
- 7:41I really like this idea of a professional learning system where
- 7:43all of those pieces
- 7:44SPEAKER_01: work together.
- 7:44SPEAKER_00: Yeah.
- 7:46And I like what you said too about like the PD is actually this
- 7:51really precious
- 7:52SPEAKER_01: time to actually be able to communicate
- 7:54like communicate the shared vision and then make it tangible to
- 7:58people right like
- 8:00so often if if we knew what to do we knew how to teach math
- 8:06more effectively right
- 8:07or like I like yeah back to students on their writing we're
- 8:10like show more evidence
- 8:11like yes you know like if if kids knew how to show more
- 8:15evidence they would we have
- 8:16to teach them how and I think the same is true for adults like
- 8:20when we actually
- 8:21SPEAKER_01: recognize that we're building capacity to do something
- 8:25that reflects a change in our practice that is actually
- 8:27different from what we're
- 8:28SPEAKER_01: doing now,
- 8:29SPEAKER_01: then we need to like one communicate clearly what is that change,
- 8:33SPEAKER_01: we actually need to have opportunities to
- 8:37learn something new practice a new routine and habit like in a
- 8:41safe setting where
- 8:43it's okay to make mistakes we can try something out before we
- 8:45get in front of our
- 8:46kids and then I think that bridge back to like then once I
- 8:49actually do it in my
- 8:50class that's actually again like that's not like the end okay
- 8:53and now I'm done we
- 8:54move to the next PD topic that's like now ideally because I'm
- 8:58in an ecosystem that
- 8:59SPEAKER_01: has a professional learning system
- 9:02I'm getting feedback on those practices I'm looking at the
- 9:04student work and I'm
- 9:05seeing did the shift in my teaching practice actually have an
- 9:08impact on student
- 9:09SPEAKER_01: learning.
- 9:10I can come back to these topics we're not just bouncing from
- 9:14topic to topic to
- 9:15topic thinking that the issue is just you know teaching people
- 9:19a bunch of tools in
- 9:21SPEAKER_01: isolation without putting those things together.
- 9:23yeah and I think like I mean I think you stress this a ton and
- 9:27I think this is
- 9:27something that Success Academy in particular does super well
- 9:30it's just like how do
- 9:31you anchor it all in the student work right like you could you
- 9:34could be the best
- 9:35teacher in the world and then one year you just have a group of
- 9:38kids where like
- 9:39actually it's not sticking for whatever reason and I think
- 9:42professional development
- 9:43is a time to work together to figure out okay so then what is
- 9:47the strategy that I
- 9:48SPEAKER_00: need this year with
- 9:49the students in front of me to make sure that they are also
- 9:52making the outcomes
- 9:53SPEAKER_00: that I expect from for them.
- 9:56SPEAKER_00: Yeah.
- 9:57SPEAKER_01: And I think what I'm hearing in that,
- 9:58SPEAKER_01: too,
- 9:59is just this notion that it does worry me that like sometimes
- 10:03in school systems,
- 10:04SPEAKER_01: folks get extra coaching supports when they're not doing well.
- 10:08SPEAKER_00: Right.
- 10:09SPEAKER_01: Right.
- 10:10SPEAKER_01: Like it's like,
- 10:10SPEAKER_01: OK,
- 10:11let's get this targeted and you get this targeted support
- 10:13because we believe that
- 10:14SPEAKER_01: there's some sort of problem versus.
- 10:16SPEAKER_01: Right.
- 10:17SPEAKER_01: Create this ecosystem where.
- 10:19Coaching is just part of what we do because we actually believe
- 10:21we all as educators
- 10:23have something to learn and have ways to grow and that we
- 10:26benefit from doing it
- 10:27SPEAKER_01: together.
- 10:27SPEAKER_01: Right.
- 10:28That like there's a shared experience here and that we can all
- 10:30sort of like
- 10:31SPEAKER_01: continually hone our craft.
- 10:33SPEAKER_00: Yeah.
- 10:34And this idea that like the coaching is really,
- 10:37you know,
- 10:37I always think about coaches as
- 10:41SPEAKER_00: I am an extra set of eyes and ears in the classroom.
- 10:45I am helping people see what might be hard to see because they
- 10:49are also trying to teach
- 10:51a very hard lesson or are navigating a lot of things and so
- 10:55it's this idea that
- 10:56like coaching isn't something that an impediation be ramped up
- 10:59for those who need
- 11:00it need it the most but really where our students need it the
- 11:03most and and and I
- 11:04think and that sometimes is sometimes skill dependent but but a
- 11:08lot of times it's
- 11:09just the the cohort the year you know that you have and so I
- 11:14think there's lots of
- 11:15SPEAKER_00: ways to think about PD um
- 11:18but I think you know when you and I were talking we're talking
- 11:21about like okay well
- 11:22what are we noticing in terms of PD that makes it less
- 11:26effective or you know we
- 11:29think that oh this is not the best use of this opportunity that
- 11:32we have because I
- 11:33SPEAKER_00: think both you and I are in agreement of like
- 11:36PD is incredibly helpful and can be an incredibly powerful tool
- 11:41to increase the
- 11:43SPEAKER_00: impact of your organization on kids.
- 11:45SPEAKER_00: And yet it's not always utilized as that time.
- 11:50SPEAKER_00: And so the question I have is really like,
- 11:53SPEAKER_00: what are some of the pitfalls that we ultimately get into that sometimes
- 11:57SPEAKER_00: compromises the effectiveness of that time?
- 12:00SPEAKER_01: Yeah.
- 12:02SPEAKER_01: I mean, I think one...
- 12:04I think one big pitfall of that PD time and you spoke to it
- 12:09earlier is like we just
- 12:10see it as somehow really disconnected from the ongoing work
- 12:14that's happening within
- 12:15our schools right so like maybe your school has like a
- 12:18structure for ongoing
- 12:20teacher collaboration like we plan lessons together we have
- 12:23protocols for looking
- 12:24at student work and for some reason we treat what happens in
- 12:27sort of like a
- 12:28SPEAKER_01: structured PD session is totally separate from that
- 12:31and so again it becomes a sort of like one off topics that may
- 12:35or may not be just
- 12:36maybe may or not be not excuse me may or may not be connected
- 12:39to the daily work
- 12:41that we're doing which is where you get that example from the
- 12:43Aguilar you know
- 12:45article where it's like I just want to know how do I actually
- 12:47apply this to my
- 12:48practice and then I also think like I think the other thing
- 12:53that winds up happening
- 12:55SPEAKER_01: is
- 12:57Just like you know within a teacher planning meeting situation
- 12:59like we it's really
- 13:01easy right we're supposed to be gathering as teachers and we're
- 13:04really investing
- 13:05and understanding you know the mathematics in this lesson and
- 13:08how we're going to
- 13:09teach it but there's a field trip coming up on Friday and we
- 13:13had to change the
- 13:13schedule for an assembly and did we send this parent letter
- 13:17home and what about
- 13:18SPEAKER_01: this assessment in that and like
- 13:20what was supposed to be an intellectual preparation meeting
- 13:23because logistics.
- 13:25SPEAKER_01: And I think the same thing happens for leaders, right?
- 13:27SPEAKER_01: Like you've got your PD time carved out in your schedule.
- 13:31SPEAKER_01: Like we do an audit of how much time we're actually using
- 13:35SPEAKER_01: to strengthen and build knowledge,
- 13:38SPEAKER_01: build capacity practice versus share logistics,
- 13:43SPEAKER_01: you know,
- 13:43SPEAKER_01: like make a bunch of announcements.
- 13:45Everybody is fighting for like the PD real estate because
- 13:47they've all got to get
- 13:48SPEAKER_01: their message out.
- 13:49And I think those might actually just be symptoms of what we
- 13:52were talking about
- 13:53SPEAKER_01: before,
- 13:53SPEAKER_01: which is PD kind of is like,
- 13:56SPEAKER_01: you know,
- 13:56it's like this big container and everyone's throwing a bunch of
- 13:59stuff in versus
- 14:00SPEAKER_01: saying,
- 14:00SPEAKER_01: nope,
- 14:01SPEAKER_01: in this system,
- 14:01SPEAKER_01: we have a strategy for improving instruction.
- 14:05and we're using our PD time really intentionally to in service
- 14:11of that strategy.
- 14:13SPEAKER_00: Yeah, I also yeah, that makes total sense.
- 14:17And what I'm thinking through right now is I go back and forth
- 14:21on this so much,
- 14:22SPEAKER_00: but I think the underlying premise for me is effective PD
- 14:29SPEAKER_00: is really hard to get right and do well.
- 14:33SPEAKER_00: So,
- 14:33SPEAKER_00: you know,
- 14:33SPEAKER_00: you can imagine the bigger your system is,
- 14:36the more leaders and principals you have in seats that you're
- 14:39asking to deliver PD
- 14:40SPEAKER_00: on a weekly basis because our,
- 14:42SPEAKER_00: you know,
- 14:42SPEAKER_00: we have early dismissal on Tuesdays and that's our PD afternoon,
- 14:46SPEAKER_00: etc.
- 14:46SPEAKER_00: It is a lot of
- 14:50to ask of somebody to make sure that every single Tuesday you
- 14:55have this incredibly
- 14:56engaging high quality PD and sometimes I think the trap that we
- 15:00get ourselves into
- 15:01SPEAKER_00: is
- 15:03SPEAKER_00: You're just trying to fill the time or you're like,
- 15:05SPEAKER_00: oh,
- 15:05SPEAKER_00: we could do that during the PD Tuesday,
- 15:06SPEAKER_00: or we all we could do that on PD Wednesday or whatnot.
- 15:09And so then what ends up happening is that time then gets
- 15:12hijacked by other things
- 15:14SPEAKER_00: without any system or strategy for how we think about that.
- 15:18And then I think those experiences where teachers end up
- 15:21getting conflated.
- 15:22So like now all of a sudden PD can also mean a grade level team
- 15:25meeting where
- 15:26you're discussing the field trip or it could also just mean
- 15:28like I'm getting talked
- 15:29out for an hour about like and all of those things are
- 15:32incredibly important like
- 15:33you have to talk about field trip logistics you have to talk
- 15:36about all like all the
- 15:38SPEAKER_00: things that come up in schools,
- 15:40but there's a part of me where in general I think knowing if
- 15:45you know the skill
- 15:46SPEAKER_00: level of your leaders within a system.
- 15:48and to me it's it's better to do less PD and get it really
- 15:53right than trying to do
- 15:55more PD because you're trying to improve teacher practice so
- 15:57quickly but don't have
- 15:59the skill level yet on the on the leadership side to be able to
- 16:02execute that at
- 16:03high quality each time and then I think sometimes what ends up
- 16:07happening is then
- 16:08SPEAKER_00: you outsource it to like a completely third party that's then
- 16:13If it's divorced from curriculum and they're not in your school
- 16:15every day,
- 16:15it becomes even more far away from like what we're trying to
- 16:19get at in the
- 16:20SPEAKER_00: classroom.
- 16:21SPEAKER_00: And so I,
- 16:22SPEAKER_00: you know,
- 16:22SPEAKER_00: I work with younger leaders who,
- 16:25SPEAKER_00: you know,
- 16:26SPEAKER_00: are trying to put in as much,
- 16:27SPEAKER_00: you know,
- 16:27SPEAKER_00: they'll do like 25 days of summer PD.
- 16:29SPEAKER_00: I was like, that is a lot to plan.
- 16:31SPEAKER_00: Like,
- 16:32how do you plan that much high quality PD so that people feel
- 16:36like I'm in a very
- 16:37SPEAKER_00: productive learning space for myself?
- 16:40and so I I think that's also the balance too is that like how
- 16:43do you protect that
- 16:44time and name it right and then figure out other ways to like
- 16:48do all the other
- 16:49stuff and so you know I I don't know that that that has always
- 16:54been sort of a
- 16:54nagging feeling for me because we used to do the half day like
- 16:57PD afternoons and to
- 16:59your point they they often derail into different things it's
- 17:02definitely dependent
- 17:03SPEAKER_00: on leader quality and their ability to lead them um you know
- 17:08I've done really long summer PDs really short summer PDs like
- 17:12it's yeah it's the
- 17:14timing and expertise to develop it is not insignificant yeah no
- 17:19it's a really good
- 17:20point and it makes me think too like perhaps for you know for
- 17:23leaders who are
- 17:24thinking about their PD calendars for the year ahead I wonder
- 17:28if like a good like
- 17:29self-check would be like what is what's the consequence what
- 17:33would the consequence
- 17:34SPEAKER_01: be of not doing this
- 17:37or like what is the opportunity cost right yes that's right
- 17:40that's right we we are
- 17:41we are making decisions and we are when we put together a pd
- 17:45calendar right like
- 17:47we're making decisions about where we believe folks should be
- 17:49spending their time
- 17:50so it's like if they're spending their time on this what does
- 17:54it mean they're not
- 17:54SPEAKER_01: spending time on if we
- 17:58train on this topic for five sessions,
- 18:02but there's no follow through,
- 18:04right?
- 18:04SPEAKER_01: Like,
- 18:04SPEAKER_01: well,
- 18:04what's the what is the consequence of setting it up like that
- 18:07versus maybe we have
- 18:08SPEAKER_01: a much slimmer,
- 18:10SPEAKER_01: more focused approach to what we're actually spending time together on,
- 18:15SPEAKER_01: but we're committed to the follow through,
- 18:18SPEAKER_01: right?
- 18:18SPEAKER_01: So anything that teachers can expect to learn within a PD session
- 18:22is not going to be one and done it's going to be something that
- 18:25then they're
- 18:26getting coaching on or that comes up in their sort of ongoing
- 18:29planning meetings or
- 18:30is like woven in some way to the fabric of the school as
- 18:33opposed to just you know a
- 18:35SPEAKER_01: layer that can you know be pulled on and off yes I agree I agree um
- 18:42SPEAKER_00: Okay,
- 18:42SPEAKER_00: so let's talk through some scenarios,
- 18:44SPEAKER_00: because I think people are probably grappling with like,
- 18:49SPEAKER_00: okay,
- 18:50SPEAKER_00: well,
- 18:50SPEAKER_00: this is the problem I'm trying to fix right now for next year,
- 18:53SPEAKER_00: in terms of our PD quality,
- 18:55SPEAKER_00: or just general instructional strategy.
- 18:58So Michelle and I had a couple of thoughts that we,
- 19:00you know,
- 19:01a couple of things that we said.
- 19:01And so the first one we had talked about was this idea where
- 19:07you have these very
- 19:09SPEAKER_00: input driven coaching practices with the assumption that like,
- 19:12SPEAKER_00: if we do coaching
- 19:13SPEAKER_00: Coaching Consistently,
- 19:14SPEAKER_00: if we do X,
- 19:14SPEAKER_00: Y,
- 19:15SPEAKER_00: and Z consistently,
- 19:16SPEAKER_00: then the assumption is it will drive student outcomes.
- 19:19And so and so then what ends up happening is that both the
- 19:22coaching and the PD
- 19:23SPEAKER_00: becomes more divorced from students.
- 19:25SPEAKER_00: And so what this looks like,
- 19:26SPEAKER_00: I think,
- 19:27SPEAKER_00: just to paint it more concretely is,
- 19:29SPEAKER_00: if you have like 70 trackers of like,
- 19:32SPEAKER_00: this is when we met with blood and these are all your action steps.
- 19:35SPEAKER_00: And that's what you're stressing,
- 19:37SPEAKER_00: like you're stressing the touch points,
- 19:39SPEAKER_00: rather than the quality of what's happening in those touch points.
- 19:43um because you're worried that people are not getting coached
- 19:46and therefore that's
- 19:46why people are not growing and therefore that's why students
- 19:48aren't achieving I
- 19:49like totally understand that thought process but just trying to
- 19:55like worry about
- 19:57inputs about did my APs meet with my teachers three times a
- 20:00week or two times a
- 20:01week or weekly I don't know um I know a lot of people are in
- 20:06that spot right now
- 20:07SPEAKER_00: where they're trying to get consistent practices for adult development
- 20:12SPEAKER_00: and find themselves in this wheel of just tracker management.
- 20:17SPEAKER_01: It always comes back to the trackers.
- 20:19SPEAKER_01: I'm telling you, the trackers kill me.
- 20:21SPEAKER_00: The trackers kill me.
- 20:23The number of beautiful trackers I've seen,
- 20:26I was like,
- 20:27well,
- 20:27what is this measuring?
- 20:28SPEAKER_01: Right, right, right.
- 20:30SPEAKER_01: No, I think it's an important issue to lift up.
- 20:36SPEAKER_01: And again, it also makes me think
- 20:38SPEAKER_01: Like thinking back to our conversation of last from last week.
- 20:41SPEAKER_01: So a lot of school systems have adopted HQAM.
- 20:44SPEAKER_01: Of course,
- 20:44SPEAKER_01: they realize if they didn't already know,
- 20:46SPEAKER_01: which some of them already know,
- 20:47SPEAKER_01: they've quickly realized it's no silver bullet.
- 20:49SPEAKER_01: Yeah.
- 20:50SPEAKER_01: They're wondering why they've invested all this,
- 20:52SPEAKER_01: you know,
- 20:52SPEAKER_01: time and resources into procuring new resources.
- 20:55SPEAKER_01: And then the, you know, the learning outcomes haven't changed.
- 20:58a natural progression from that is then to say oh okay well we
- 21:01realize our mistake
- 21:02now we got the materials out but the curriculum doesn't teach
- 21:05kids teachers teach
- 21:06kids so we've got to invest in all this training so guess what
- 21:09this year we're
- 21:09doing training and PD and coaching and you're getting all these
- 21:12supports but again
- 21:14it becomes this very input driven thing where like you and I
- 21:17were talking it's like
- 21:18coaching becomes the strategy it's like no coaching is not your
- 21:22strategy coaching
- 21:23SPEAKER_01: is a lever or a tool
- 21:25SPEAKER_01: to help you execute your strategy of improving literacy outcomes,
- 21:29SPEAKER_01: math outcomes,
- 21:30SPEAKER_01: you know,
- 21:30SPEAKER_01: whatever it might be.
- 21:32SPEAKER_01: And so I do wonder sort of,
- 21:33SPEAKER_01: yeah,
- 21:33for our peers who are sort of in this moment planning for the
- 21:38rollout of their
- 21:39strategy and also planning for those PD calendars and schedules
- 21:42and all and
- 21:43SPEAKER_01: trackers and hopefully not too many trackers,
- 21:44SPEAKER_01: but all the inputs that come along with it.
- 21:46SPEAKER_01: How do we help folks kind of shift the focus from, you know,
- 21:52naming the like types of supports to actually getting everyone
- 21:57in the system laser
- 21:58focused on what is the change that we're actually trying to
- 22:00create in adult
- 22:02practice that we believe will lead to student learning because
- 22:05that is where we
- 22:06SPEAKER_01: actually are going to
- 22:09SPEAKER_01: I think see the fruit of our labor.
- 22:11If we really are focused on naming the change and investing
- 22:16folks in the types of
- 22:17support they will need to actually change their practice as
- 22:20opposed to sort of this
- 22:21SPEAKER_01: disembodied,
- 22:22SPEAKER_01: decontextualized,
- 22:23SPEAKER_01: well,
- 22:23you got X hours of coaching or we did X number of sessions of
- 22:27PD may or may not
- 22:29SPEAKER_01: move the needle.
- 22:31SPEAKER_00: Yeah,
- 22:31SPEAKER_00: and I think like one of the things that I often think through is,
- 22:35SPEAKER_00: you know,
- 22:36we often have all of these tools related to what we're looking
- 22:39for in classrooms,
- 22:40SPEAKER_00: whether that's a teaching rubric,
- 22:42SPEAKER_00: whether that's a look for tool for the curriculum,
- 22:44SPEAKER_00: whether that and and all of those things are good and fine.
- 22:48SPEAKER_00: It's just that it's impossible to focus on all of those all the time.
- 22:52And so I think to your point around like what does the change
- 22:55actually look like my
- 22:56SPEAKER_00: my first question is,
- 22:58SPEAKER_00: well,
- 22:58what should I be seeing in terms of the engagement with
- 23:01students and the content
- 23:03SPEAKER_00: that like the teacher is supposed to be facilitating that we believe if
- 23:07Kids Are Getting This More Consistently At High Quality It's
- 23:10Going To Drive
- 23:11Outcomes And It's Not Can't Just Be Like Oh The Teacher Just
- 23:13Needs To Do The Lesson
- 23:15Better It's Like It Has To Be Like Well And I Think You Know
- 23:18One Of The Suggestions
- 23:19I Always Have For Folks Around This Time Of The Year Is There's
- 23:22Tons Of Students In
- 23:23Your System Right Now That Are Positive Outliers And In Just
- 23:28Like Very Normal
- 23:29Classrooms Or Schools That Are Very 50th Percentile Within Your
- 23:34District Or Network
- 23:35and my thing is like we have to study them we have to think
- 23:38about like what are
- 23:38they doing differently or what are they getting differently or
- 23:41how are they
- 23:41approaching that lesson differently even though it's the same
- 23:44teacher because I
- 23:45think those are the things that are easier to systematize than
- 23:49trying to make
- 23:49everyone an excellent teacher overnight is just like okay if I
- 23:53know that writing
- 23:54improves if like kids have 15 minutes of uninterrupted writing
- 23:58time every day and
- 24:00SPEAKER_00: that they're getting like two to three feedback points not like
- 24:04SPEAKER_00: with kids.
- 24:27SPEAKER_01: Right.
- 24:28SPEAKER_01: Well, I love that, too.
- 24:28I think that also goes back to like the Aguilar piece and like
- 24:31honoring adult
- 24:32SPEAKER_01: expertise,
- 24:32SPEAKER_01: like oftentimes not necessarily across an entire system,
- 24:36but there are classrooms and there are instances where we have
- 24:39the internal
- 24:40SPEAKER_01: expertise,
- 24:40SPEAKER_01: we have the models already.
- 24:42SPEAKER_01: And I think like to not leverage those as a real,
- 24:45SPEAKER_01: you know,
- 24:45it's a real missed opportunity to kind of lift up and celebrate
- 24:48and amplify the
- 24:49great things that are already happening in your system and
- 24:51think about how you can
- 24:52SPEAKER_01: get those ideas to spread.
- 24:53yeah and I think you have to think about that PD time being an
- 24:56opportunity to then
- 24:57show it whether that's through a video whether that's through a
- 25:00model where that
- 25:01you know or both and then have people practice it because I
- 25:05think it's one of the
- 25:06few times especially if you're in a large district or network
- 25:08to like really level
- 25:10set for what it is that we want to see in every classroom
- 25:14regardless of the day
- 25:15SPEAKER_00: that the teacher has
- 25:16SPEAKER_01: Right, right.
- 25:17A vision statement can be so squishy and we can,
- 25:20you know,
- 25:21everyone can kind of align.
- 25:22SPEAKER_01: Yes,
- 25:22SPEAKER_01: of course,
- 25:22SPEAKER_01: we believe in this vision,
- 25:23but we actually have so many different mental models of what
- 25:26that vision entails.
- 25:27SPEAKER_01: Right.
- 25:27SPEAKER_01: And actually looking at video together,
- 25:30SPEAKER_01: amplifying best practices,
- 25:32SPEAKER_01: not necessarily that a best practice,
- 25:34SPEAKER_01: so to speak,
- 25:34SPEAKER_01: is going to work in every context,
- 25:36SPEAKER_01: but I think showing people
- 25:38SPEAKER_01: more examples of the bar of what's possible in our system can be a really
- 25:42SPEAKER_01: productive way,
- 25:43SPEAKER_01: as you said,
- 25:43SPEAKER_01: to kind of,
- 25:44SPEAKER_01: you know,
- 25:44SPEAKER_01: level set or set the stage for,
- 25:46SPEAKER_01: you know,
- 25:46SPEAKER_01: what are we trying to accomplish here?
- 25:49SPEAKER_00: Yeah.
- 25:49SPEAKER_00: And I think as long as,
- 25:50SPEAKER_00: you know,
- 25:51SPEAKER_00: if,
- 25:51SPEAKER_00: you know,
- 25:51SPEAKER_00: if you were clear,
- 25:52SPEAKER_00: if I were clear,
- 25:53SPEAKER_00: leaders were clear on what that is,
- 25:55then there's less need for all of the paperwork or the trend of
- 26:00tracking because
- 26:00SPEAKER_00: you can just go into any classroom and just see it.
- 26:02And I think that's like my biggest point is like,
- 26:05just know that your PD works.
- 26:07is that you have to see the change the next day in classrooms
- 26:09consistently across your network.
- 26:11Like,
- 26:11are people trying to do the thing that you know that they saw a
- 26:14model of yesterday?
- 26:16SPEAKER_00: And if the answer is yes, then that's a great starting point.
- 26:20SPEAKER_00: And then I think that's where coaching then gets everyone to that bar.
- 26:23SPEAKER_01: Yeah.
- 26:24SPEAKER_00: Yeah.
- 26:25SPEAKER_01: Great.
- 26:25SPEAKER_00: Yeah.
- 26:26SPEAKER_01: So we had a second scenario.
- 26:28I think you and I have both been engaging with a lot of
- 26:30conversations about folks
- 26:31SPEAKER_01: who are saying,
- 26:32SPEAKER_01: You know,
- 26:33I've diagnosed that there's a need to develop teachers' content
- 26:41knowledge within a
- 26:42SPEAKER_01: discipline.
- 26:44And so they're building their sort of PD schedules and their PD
- 26:47plans around this idea,
- 26:48right?
- 26:48SPEAKER_01: Their sort of like implicit theory of action,
- 26:50SPEAKER_01: like,
- 26:50SPEAKER_01: okay,
- 26:50SPEAKER_01: if we can develop and strengthen teachers' content knowledge,
- 26:53SPEAKER_01: they'll be more prepared to deliver great instruction.
- 26:56SPEAKER_01: And so student outcomes will improve.
- 26:59SPEAKER_01: And I think we're a little, like, concerned.
- 27:02SPEAKER_01: Yeah.
- 27:04we love content knowledge by the way what do you think is going
- 27:08on there and how
- 27:09can we like how might we improve upon that theory of action
- 27:12yeah well I mean I
- 27:14think you had a great example with letters and so I want I
- 27:17would love like I mean I
- 27:19think that's like the most concrete like example so go ahead
- 27:23and explain the
- 27:24SPEAKER_01: letters example yeah yeah so I think like this idea here is
- 27:29SPEAKER_01: It's rooted in, I think, an important diagnosis.
- 27:34If we expect our teachers to deliver instruction that is
- 27:39aligned to evidence-based
- 27:41SPEAKER_01: practices,
- 27:42SPEAKER_01: science of reading,
- 27:43SPEAKER_01: et cetera,
- 27:45SPEAKER_01: then improving their content knowledge feels like a good first step.
- 27:49But without that bridge between building our content knowledge
- 27:53in a particular area
- 27:54SPEAKER_01: and then translating that into instructional practice,
- 27:57SPEAKER_01: and curriculum and content specific instructional practice.
- 28:00SPEAKER_01: I think like we just don't see the efficacy.
- 28:02SPEAKER_01: And so like letters,
- 28:03I think comes up a lot because a lot of folks have invested a
- 28:06lot of time and
- 28:07SPEAKER_01: energy and resources in letters,
- 28:10SPEAKER_01: which is a sort of a science of reading aligned sort of pretty intensive
- 28:14SPEAKER_01: professional learning regimen.
- 28:18SPEAKER_01: And the efficacy data is not there.
- 28:19SPEAKER_01: And I just suspect that the reason for that is because
- 28:23There Is Not A Clear Enough Way To Translate Okay I Have Like
- 28:27Increased My Content
- 28:29Knowledge For Science Of Reading Aligned Instruction If It's If
- 28:34I'm Not Able To
- 28:35Sort Of Build A Bridge Between My Increased Knowledge And Then
- 28:37How That Knowledge
- 28:38Impacts My Practice And My Routines That I'm Implementing In My
- 28:41Class Every Single
- 28:42Day I Think We Just See We See The Limits Of That Type Of
- 28:48Approach Right So So I
- 28:49SPEAKER_01: Think If Leaders Are You Know Like Probably
- 28:54Rightly diagnosing that this is an area of need and it's not
- 28:57confined to literacy.
- 28:57SPEAKER_01: I actually think in math, I'm hearing a lot of it.
- 28:59SPEAKER_01: Yeah, it's more so.
- 29:01SPEAKER_01: Yeah, yeah.
- 29:02SPEAKER_01: Middle school math, high school math.
- 29:04SPEAKER_01: Yes.
- 29:04Make sure that our teachers are really deeply knowledgeable and
- 29:08prepared to
- 29:10SPEAKER_01: deliver,
- 29:11SPEAKER_01: you know,
- 29:11SPEAKER_01: sort of these lessons that require deep levels of mathematical thinking.
- 29:16SPEAKER_01: Right.
- 29:16So it's not a bad diagnosis to say we have to do something to
- 29:19strengthen teachers
- 29:20SPEAKER_01: content knowledge.
- 29:22But then I think the flaw in the theory of action is we have to
- 29:24sort of be able to
- 29:24SPEAKER_01: say,
- 29:25SPEAKER_01: not only their content knowledge,
- 29:27but how are we going to help them translate their now expanded
- 29:31or improved content
- 29:32SPEAKER_01: knowledge into actual instructional practices,
- 29:35SPEAKER_01: so that we are facilitating a change,
- 29:38SPEAKER_01: not just in what they know,
- 29:40SPEAKER_01: but what they can actually do.
- 29:42yeah and I used to have this thing that I looked for every time
- 29:45I was providing
- 29:46feedback on PD and my kind of like trifecta that I was looking
- 29:50for was that it was
- 29:50like research curriculum practice and like all those three
- 29:55things need to be
- 29:56whether it's you're doing a one hour session whether you're
- 29:58doing a three hour
- 29:59session whether you're doing a full hour session it's like
- 30:01those three elements
- 30:03SPEAKER_00: have to always be present like
- 30:05SPEAKER_00: So letters in some ways is great, but it's like 100% research, right?
- 30:09SPEAKER_00: Like it's research and knowledge.
- 30:11SPEAKER_00: And so it's like,
- 30:12SPEAKER_00: but an ideal packaging of this is like,
- 30:14SPEAKER_00: okay,
- 30:15SPEAKER_00: this is what you know,
- 30:16this is what the science of reading and linguistics tells us
- 30:19about how reading and
- 30:20SPEAKER_00: language develops in students.
- 30:22SPEAKER_00: This is why our curriculum
- 30:25is designed this way and this is why we blend when we're doing
- 30:30this as opposed to
- 30:31segment when we're reading words and this is how it gets to
- 30:33reading and then here's
- 30:35what we're noticing in practice that we're not actually holding
- 30:38our kids to the
- 30:38SPEAKER_00: blending and therefore
- 30:40for the kids can't actually say it fast because they're not
- 30:43they're only seeing
- 30:44this this word in segments and being able to then connect those
- 30:47three things
- 30:47together really is like to me how you build content knowledge
- 30:50over time because the
- 30:52knowledge has to be in the context of something and then it has
- 30:54to be directly
- 30:55SPEAKER_00: impacted to why it might be prohibiting
- 30:58kids from learning at the rate that we know that they can learn
- 31:01because of
- 31:01something in our practice and so I think when people see that
- 31:05and you don't do that
- 31:06one time you can never build content knowledge in a day but
- 31:09imagine then you have
- 31:09longevity in your system and like teachers are with you for
- 31:12five six years and
- 31:13that's the way that they've always gotten developed you can
- 31:15imagine after year
- 31:16three how much more that teacher knows and how much is actually
- 31:19able to impact who
- 31:21SPEAKER_01: they are as a teacher yeah yeah that's powerful
- 31:24yeah so I don't know I think I agree and so I think the key
- 31:29here is I would also
- 31:33say I think there's one more thing I want to talk about I think
- 31:36the other part and
- 31:37SPEAKER_00: we didn't talk about this but now I'm thinking about it
- 31:40The other part too is that like sometimes I think when PD is
- 31:44ineffective and the
- 31:45teachers are giving feedback that PD isn't helping me or PD
- 31:48isn't like PD is a
- 31:49waste of time or whatever I think there's a there's a tendency
- 31:53to be like well how
- 31:54do we make this day really meaningful for teachers and so then
- 31:59you kind of stray
- 31:59away from content altogether and then you decide to do these
- 32:02like personal like you
- 32:05know choice is good but like you know would you like to figure
- 32:08out how your
- 32:08SPEAKER_00: benefits work and like
- 32:11PD that's really about raising morale or just giving teachers
- 32:16what they want
- 32:17SPEAKER_00: because they've asked for it,
- 32:18SPEAKER_00: but that gets more divorced from teaching and learning.
- 32:21SPEAKER_00: And I think it's just a really delicate balance there.
- 32:27I think that's the other kind of response that I see some
- 32:33people double down just
- 32:34the content knowledge but some people also just veer completely
- 32:37away and say oh
- 32:38we're doing this thing on how to take care of your mental
- 32:40health because people are
- 32:42burnt out and that's great but I think it's to your point
- 32:48before about what there's
- 32:50SPEAKER_00: only a finite number of hours so how are we using that time
- 32:54right right right so yeah I think that's an important point and
- 33:00thinking I think
- 33:01again I would always just bring it back to like what is our
- 33:03ultimate strategy and
- 33:04how do we help people see that these things are parts of a
- 33:08whole or if they're not
- 33:11and we have some totally separate initiative that actually
- 33:14we're not like we're not
- 33:15figuring a way right to get this initiative to actually impact
- 33:18the instructional
- 33:18SPEAKER_01: core
- 33:19SPEAKER_01: um or you know student learning yeah experiences then again maybe it's an
- 33:23opportunity to do some like self-auditing yeah and there's
- 33:26always time for like
- 33:27personal learning and development and it's just thinking about
- 33:29where in your
- 33:30SPEAKER_00: strategy is that time yeah yeah
- 33:33okay so let's take away take take do the key takeaways about
- 33:37like what we're I
- 33:37think Michelle and I were like what are the things that we want
- 33:41people to really
- 33:41think about and understand about PDE and I think the first one
- 33:45we talked about was
- 33:46just improving PDE can't be your strategy you can't just say
- 33:49we're gonna have
- 33:49better PDE and better coaching this year in order to improve
- 33:52student outcomes you
- 33:53SPEAKER_00: have to be really clear about the what and how of PDE
- 33:58and how those things are serving what you believe is the change
- 34:01you need to see in
- 34:02SPEAKER_00: classrooms,
- 34:04SPEAKER_00: not like what's happening in teachers heads,
- 34:06but like actual interactions between student teacher content
- 34:11that it's actually
- 34:11SPEAKER_00: driving towards because it's a means of moving your strategy forward.
- 34:16SPEAKER_01: Yeah, yeah, for sure.
- 34:17And I think related just kind of stamping this piece around the
- 34:21building content knowledge.
- 34:22SPEAKER_01: It is a
- 34:27SPEAKER_01: Likely,
- 34:28if leaders have identified this need to sort of really invest
- 34:30in improvement of
- 34:31SPEAKER_01: content knowledge,
- 34:32SPEAKER_01: it's based,
- 34:33SPEAKER_01: I would hope,
- 34:33SPEAKER_01: upon a meaningful diagnosis of what's happening within their systems.
- 34:38But I really think that the onus is on sort of school and
- 34:41system leaders to really
- 34:42SPEAKER_01: build a bridge between,
- 34:44SPEAKER_01: okay,
- 34:44we're strengthening this body of knowledge that our educators
- 34:48should have.
- 34:49What is the bridge between strengthening knowledge and then
- 34:51tying it to actual
- 34:53SPEAKER_01: instructional practice?
- 34:55um and again I think connects to your point like when we
- 34:58actually see that we have
- 35:03through PD facilitated a change in practice that is where we
- 35:10act that's where we
- 35:11can see the through line in our theory of action right it's
- 35:13like if we're if
- 35:14there's a gap in our theory of action and we have changed
- 35:17something that is true
- 35:18about what someone knows but we've not actually been able to
- 35:21facilitate a change
- 35:22SPEAKER_01: and what someone can do
- 35:25SPEAKER_01: Right.
- 35:25SPEAKER_01: Likely,
- 35:26likely we shouldn't be surprised if it doesn't result in
- 35:28different instruction or
- 35:29SPEAKER_01: different learning outcomes for kids.
- 35:32SPEAKER_01: Right.
- 35:32SPEAKER_01: Yeah.
- 35:33Sort of thinking about that through line,
- 35:34I think is going to be really important.
- 35:36Yeah,
- 35:36super important because I think the point of PD is to drive
- 35:40change,
- 35:40to drive outcomes.
- 35:41SPEAKER_00: And so the change part needs to be visible.
- 35:45And then the last part is this idea of like we can't call any
- 35:48time teachers are in
- 35:49SPEAKER_00: a room together PD.
- 35:50SPEAKER_00: Right.
- 35:52like I think yeah I we can't be unafraid to say actually this
- 35:56is a staff meeting
- 35:57about the field trip tomorrow versus like this is PD and I
- 36:01think there's two things
- 36:02that are really important about that I think because one is you
- 36:07know it's kind of a
- 36:08fine line once you start dancing around like what is PD then
- 36:10you're just more
- 36:11willing to put in logistics in that time and and and and not
- 36:15make that time sacred
- 36:16SPEAKER_00: the second thing too is like I think um
- 36:20SPEAKER_00: PD is so important,
- 36:22SPEAKER_00: not just for teachers,
- 36:23but I think it's also a chance for leaders and facilitators to
- 36:27model the learning
- 36:28SPEAKER_00: and vulnerability that they want in their culture.
- 36:31So if you want an adult culture that's responsive to feedback,
- 36:34that's always thinking critically
- 36:36I think this is the time to model it and and and just staff
- 36:40meetings just have a
- 36:41different tenor to it it's like this is where I need you to be
- 36:43during your duty
- 36:44tomorrow like it which is different from you know let's really
- 36:48investigate why this
- 36:49SPEAKER_00: is not working for our kids
- 36:50for Kids right now and get down to the root causes so that we
- 36:54can actually show up
- 36:54SPEAKER_00: better for students tomorrow.
- 36:56And so I think adult learning happens constantly in both formal
- 37:01and informal settings.
- 37:03SPEAKER_00: And we should just name when learning is supposed to be happening,
- 37:06SPEAKER_00: which is not just in PD,
- 37:07SPEAKER_00: but in the coaching time and in the PLC time,
- 37:10SPEAKER_00: et cetera,
- 37:11SPEAKER_00: and think about those more cohesively and collectively.
- 37:15SPEAKER_01: Yeah, I love that.
- 37:16SPEAKER_01: And again,
- 37:16SPEAKER_01: it goes back to what we talked about earlier,
- 37:17SPEAKER_01: which is how do you think about all of these different
- 37:20SPEAKER_01: sort of levers or tools for improvement as again,
- 37:22SPEAKER_01: like not just operating in isolation,
- 37:24but operating together in service of whatever your
- 37:27instructional improvement
- 37:28SPEAKER_01: strategy is.
- 37:29SPEAKER_00: Yeah.
- 37:30So I think,
- 37:31you know,
- 37:31I know people are thinking about a lot about PD right now.
- 37:35SPEAKER_00: And hopefully this gave some food for thought.
- 37:37But I think both Michelle and I really believe that PD can be
- 37:40extremely powerful
- 37:42SPEAKER_00: and we believe in it.
- 37:43SPEAKER_00: And so and
- 37:44And so I think if it doesn't feel like that culture is quite
- 37:47there yet in your
- 37:48SPEAKER_00: systems,
- 37:49SPEAKER_00: you know,
- 37:50SPEAKER_00: I think thinking about what it would take to get your culture there,
- 37:52SPEAKER_00: even just marginally more than it was this year,
- 37:54SPEAKER_00: it would be incremental improvement.
- 37:56SPEAKER_00: And so, but it's really hard to hold that time sacred and get it right.
- 38:02SPEAKER_00: Yeah.
- 38:03SPEAKER_01: Yeah.
- 38:04SPEAKER_00: Okay.
- 38:04SPEAKER_01: All right, Leslie, thanks for a great conversation.
- 38:07SPEAKER_01: And we'll see everyone soon.
- 38:08SPEAKER_01: All right.
- 38:09SPEAKER_00: Bye.
- 38:09SPEAKER_01: Bye.