Latest / Code & Cure / #63 - When AI Writes Back To Patient Messages

Transcript

#63 - When AI Writes Back To Patient Messages · Code & Cure

• 0:00
  SPEAKER_01: AI can draft a patient message.
• 0:02
  SPEAKER_01: But what happens when the provider has to edit it?
• 0:14
  SPEAKER_00: Hello and welcome back to Code and Cure, where we discuss decoding health in the age of AI.
• 0:20
  SPEAKER_00: My name is Vasant Sarathi.
• 0:22
  SPEAKER_00: I'm an AI researcher and cognitive scientist, and I'm here with Laura Hagopian.
• 0:26
  SPEAKER_00: I'm an emergency medicine physician and I work in digital health.
• 0:29
  SPEAKER_00: You know, I was thinking about um this article that we're going to talk about, and also thinking about how sometimes when you type Google like Gmail, I don't know if you use Gmail, but like, yeah, and I do know if you use Gmail.
• 0:39
  SPEAKER_00: I do, I do use Gmail.
• 0:40
  SPEAKER_00: Never mind.
• 0:41
  SPEAKER_00: But but um, you know, if people use Gmail, Gmail offers suggestions for email responses.
• 0:47
  SPEAKER_00: So like maybe you've gone back and forth with a friend about some like going out for a dinner or something, and at some point they say, All right, we got it all booked, all checked, whatever.
• 0:54
  SPEAKER_00: And then Google just writes up the Gmail just writes up the message for you saying, Yep, sounds good, see you there, right?
• 1:00
  SPEAKER_00: Or something like that automatically.
• 1:02
  SPEAKER_00: And personally, I sometimes select that option, but I a lot of times I don't.
• 1:08
  SPEAKER_00: I just write whatever.
• 1:09
  SPEAKER_01: Sometimes it actually gets it wrong.
• 1:10
  SPEAKER_01: Like it's like, oh, that's not actually what I wanted to say.
• 1:13
  SPEAKER_00: Yeah, right, right, right.
• 1:14
  SPEAKER_00: And it's good for like, you know, short, like two-word things like perfect, thanks, or uh sounds good.
• 1:21
  SPEAKER_00: You know, like stuff like that.
• 1:22
  SPEAKER_00: It's fine, I think.
• 1:24
  SPEAKER_00: But even then, I I still don't just take the edits.
• 1:26
  SPEAKER_00: I just write just write it up myself.
• 1:28
  SPEAKER_01: I particularly have trouble when it's like trying to select a date for me.
• 1:31
  SPEAKER_01: I guess it looks at my calendar and it's like, oh, these are the free times that I have.
• 1:35
  SPEAKER_01: And like sometimes it's just not correct.
• 1:39
  SPEAKER_00: Yeah, yeah, yeah, yeah.
• 1:41
  SPEAKER_00: So I think we're not quite there in the world of edits, but um, but we might be pretty pretty pretty pretty good in general.
• 1:48
  SPEAKER_00: I mean, this study talks about that.
• 1:49
  SPEAKER_00: So that's I think what is very interesting about this paper.
• 1:52
  SPEAKER_01: Well, I think the there's this whole idea like, hey, the patient portal is there, patients are using it, they're sending lots and lots and lots of messages, and the number of messages is increasing over time.
• 2:02
  SPEAKER_01: And so it's a it's a big administrative burden for providers.
• 2:06
  SPEAKER_01: It's it's great to have that sort of access to your provider.
• 2:10
  SPEAKER_01: But then if they're overwhelmed and they're in the middle of like 27 very quick 15-minute office visits, and then they have all these portal messages that they may or may not actually get reimbursed for responding to.
• 2:23
  SPEAKER_01: Now you have this like added workload that you're trying to figure out, hey, what do I do with this or how do I how do I handle this?
• 2:31
  SPEAKER_01: Um, I think it can be great for things like, hey, following up on a lab result or needing a medication refill or whatever it is.
• 2:38
  SPEAKER_01: Um, but it can take a while to respond to these, especially if you have a lot of them.
• 2:43
  SPEAKER_01: And so I think there's been this idea that if an AI system can draft a message back to a patient, it might decrease the provider workload.
• 2:53
  SPEAKER_00: Yeah.
• 2:54
  SPEAKER_00: This is like the Gmail drafting your email.
• 2:56
  SPEAKER_01: Right.
• 2:57
  SPEAKER_00: It's the same thing.
• 2:58
  SPEAKER_01: But like in practice, the studies have shown that there's like limited, very limited time savings.
• 3:06
  SPEAKER_01: And then, you know, what this paper was really focused on is like, hey, what do what do providers actually edit?
• 3:11
  SPEAKER_01: What do they change in the responses?
• 3:15
  SPEAKER_01: How can we learn more about that?
• 3:17
  SPEAKER_00: Yeah, exactly.
• 3:18
  SPEAKER_00: And it was a large-scale study in a sense that they looked at a period of about one year where they looked at over 13,000, 14,000 um messages and from over a thousand physicians.
• 3:30
  SPEAKER_00: From over a thousand physicians, right, right.
• 3:32
  SPEAKER_00: And they, you know, generally these um emails kind of fell into one of four or five categories, maybe not one, but maybe multiples of four and five categories.
• 3:44
  SPEAKER_00: They were either general emails or messages, or they were results-related messages, or they were medication-related messages, or they were just like paperwork requests.
• 3:53
  SPEAKER_00: Like these are the types of messages that were uh being sent by the patients and had to be responded to, or you know, were the content of the response itself.
• 4:02
  SPEAKER_01: Right.
• 4:02
  SPEAKER_01: And so the AI model like categorized into these four areas, and I'm sure there was like a different background model like responding to each of these four categories.
• 4:15
  SPEAKER_00: So the pipeline was that you would get these messages, the patient would send the messages in, the AI model would categorize it, and then for each of these four uh five categories, they had a different prompt, obviously, because that makes sense, right?
• 4:28
  SPEAKER_00: If it's a paperwork request versus a medication question or whatever, you want the AI to respond differently.
• 4:34
  SPEAKER_00: So they had a different prompt.
• 4:36
  SPEAKER_00: And what that just means is they uh pre-pended or added on to the AI model just some text about what an ideal response should be for that category of question, right?
• 4:48
  SPEAKER_00: And so they were able to generate these four or five different prompts and as a result of that uh run it through the system and have it produce um uh an email.
• 4:57
  SPEAKER_00: Now, the system also had access to AHR and patient health information, and so was able uh the L the AI was able to access that information and was able to use that to draft a response that was more personalized, that was more accurate, more all of that, right?
• 5:13
  SPEAKER_00: So it then produced the response um using that prompt and that medical information and the EHR information.
• 5:20
  SPEAKER_00: And then the idea was that you would offer it up to the doctor as either I think the doctors either got a blank uh were allowed to either choose between a blank, you know, template versus a pre-drafted version.
• 5:34
  SPEAKER_00: And once they had the pre-drafted version, they recorded how long these doctors took to make edits to them.
• 5:40
  SPEAKER_01: And exactly what types of edits.
• 5:42
  SPEAKER_01: Oh, yeah, yeah, yeah.
• 5:43
  SPEAKER_01: So they classified, there were like 15 different kinds of classifications they made.
• 5:47
  SPEAKER_01: Like, hey, was it that they wanted to um change something about scheduling or rescheduling an appointment?
• 5:54
  SPEAKER_01: Was there information about referring to a specialist that got altered?
• 5:58
  SPEAKER_01: Was there a different interpretation of lab results or a recommendation for testing, like an x-ray or lab imaging?
• 6:05
  SPEAKER_01: Um, was there recommendation for an urgent care or ED visit?
• 6:10
  SPEAKER_01: Was there um tapering a prescription medication or stopping it?
• 6:14
  SPEAKER_01: There were 15 of these that they that they categorized as like ways in which the providers changed things.
• 6:22
  SPEAKER_00: Yeah, exactly.
• 6:23
  SPEAKER_00: And and just to pause for a second, we've talked about this in our uh podcast quite a bit about this notion of human in a loop.
• 6:29
  SPEAKER_00: In the past, we've talked about the idea of a human coming in and making sure that the AI systems are working correctly.
• 6:35
  SPEAKER_00: And uh we've also talked about how maybe human in the loop is too broad a term.
• 6:40
  SPEAKER_00: Maybe we need something more specific.
• 6:41
  SPEAKER_00: What does it actually mean?
• 6:42
  SPEAKER_00: How much of a burden it is for the human to go and evaluate the AI response?
• 6:46
  SPEAKER_00: Is the trade-off of the human just like writing the email versus editing things worth it?
• 6:52
  SPEAKER_00: Right, given the fact that they have to accuracy fact-check it and things like that.
• 6:56
  SPEAKER_01: Um well, this is interesting because like there's some research that shows that when these portal messages, these drafts like come up, even if they're wrong, sometimes providers just send them through, right?
• 7:11
  SPEAKER_01: It's like it's you feel like, hey, this is automatic, it's probably correct, like I don't have time for this.
• 7:16
  SPEAKER_01: Go.
• 7:17
  SPEAKER_01: Yeah, right?
• 7:18
  SPEAKER_01: Right.
• 7:18
  SPEAKER_01: I mean, you could imagine a situation like one of the categories they have is a medication related thing.
• 7:25
  SPEAKER_01: So say someone, you know, types a message that says, Hey, I want my med refilled, right?
• 7:30
  SPEAKER_00: Yeah.
• 7:30
  SPEAKER_01: And so maybe your provider would say, Yeah, sure.
• 7:33
  SPEAKER_01: Like, let me provide you with a 90-day supply, um, whatever, whatever.
• 7:39
  SPEAKER_01: You could also imagine a scenario where your provider might say, Hey, I'd like to see you in the office to check on the status of this medication and see if it's continues to be a good fit for you.
• 7:50
  SPEAKER_01: Let's make an appointment.
• 7:52
  SPEAKER_01: I'm gonna give you a 30-day supply until then.
• 7:54
  SPEAKER_01: Yeah.
• 7:55
  SPEAKER_01: And so there's some nuance there.
• 7:56
  SPEAKER_01: It's not like an automatic yes.
• 7:58
  SPEAKER_01: There's some clinical decision making that may go into what the response would be.
• 8:02
  SPEAKER_01: Yes.
• 8:03
  SPEAKER_01: And so it's hard.
• 8:04
  SPEAKER_01: Like it's it's hard for the AI to necessarily know that or do that.
• 8:09
  SPEAKER_00: Well, there's two pieces to that, I to me, it seems like one is the AI might know that if that's standard practice, but if it's a physician-specific preference, then the AI might not know that, but in theory, could learn that over time.
• 8:22
  SPEAKER_00: Uh, but yes, you make a very good point, which is there's a lot of variation, even in very simple things like refilling a prescription, right?
• 8:29
  SPEAKER_00: What's seemingly simple might not be that simple.
• 8:32
  SPEAKER_00: Um, and and that's that's that's interesting here as well.
• 8:35
  SPEAKER_00: And so the the human in the loop it becomes a human on the loop when they stop like actually caring or not paying enough attention to the answer to the AI system and just kind of letting things go, right?
• 8:48
  SPEAKER_00: And and so you know, we're gonna keep talking about this.
• 8:50
  SPEAKER_00: I think this is a very interesting topic in general, but in this paper, uh, this is what they're operationalizing is trying to say, okay, the there's a human in the loop here.
• 8:59
  SPEAKER_00: What amount of time are they taking to make the edits and what kinds of edits are they making?
• 9:04
  SPEAKER_00: And is there a relationship between the kinds of edits and the time it takes?
• 9:09
  SPEAKER_01: Yeah.
• 9:09
  SPEAKER_01: And the number one um modification they made was around scheduling or rescheduling appointments.
• 9:18
  SPEAKER_01: That's the number one that took the most amount of time.
• 9:21
  SPEAKER_01: 38 point, I'm sorry, the most amount of time overall.
• 9:24
  SPEAKER_01: Yeah.
• 9:24
  SPEAKER_01: When you add it up overall, because even though it may be quick to like change change that copy in the in the message, 38.5% of the encounters had a change around scheduling or rescheduling an appointment.
• 9:39
  SPEAKER_01: I'm not particularly surprised by this because I have seen some of these AI drafted notes, and most of them say, like, I recommend you come into the office.
• 9:47
  SPEAKER_01: Like I see that all the time.
• 9:48
  SPEAKER_01: It's like, well, you can't actually have everyone come in for an office visit.
• 9:51
  SPEAKER_01: That's not actually practical.
• 9:53
  SPEAKER_01: Right.
• 9:53
  SPEAKER_01: And so maybe that has to do with prompting strategy as well.
• 9:57
  SPEAKER_01: But overarchingly, that was like the number one.
• 10:00
  SPEAKER_01: Um, and then the number two.
• 10:02
  SPEAKER_00: But that was bulk, though.
• 10:03
  SPEAKER_00: That was overbulk.
• 10:03
  SPEAKER_00: Overarching.
• 10:04
  SPEAKER_00: Let's just take a moment to talk about per email what took the patients more time.
• 10:08
  SPEAKER_00: And that was things like reviewing radiology charts, right?
• 10:11
  SPEAKER_00: That was like very technical.
• 10:12
  SPEAKER_00: It sounded to me like it was very technically specific and potentially something that the doctor had to read very carefully to make sure it was accurate to make and then made the edits accordingly.
• 10:23
  SPEAKER_00: So they took more time to work on those things, but those types of messages were much less frequent.
• 10:29
  SPEAKER_00: So overall, it didn't, it didn't like it didn't cause the same amount of workload, time load as scheduling and other stuff.
• 10:37
  SPEAKER_01: Right, because the scheduling was like almost 40% of the messages needed that edited.
• 10:40
  SPEAKER_01: Right.
• 10:41
  SPEAKER_01: Whereas the things that, I mean, and this makes sense, the things that are sort of requiring clinical judgment are the things that the providers are gonna take the most time to change and adjust and edit.
• 10:52
  SPEAKER_01: Things like you said, interpreting a radiology result, uh, clarifying or ruling out a diagnosis, interpreting a lab result.
• 11:00
  SPEAKER_01: It's like the stuff that gets complex that the AI maybe, I don't know, it's not able to give the right information to the patient.
• 11:11
  SPEAKER_01: And so these are the areas where they required the most editing.
• 11:15
  SPEAKER_01: And so it's like per in the messages that had those things, they required a lot more editing time.
• 11:21
  SPEAKER_01: But because those were less frequent, if you add up over time, it's the administrative stuff that took the longest because it was in the most percentage of these messages.
• 11:31
  SPEAKER_00: Yeah.
• 11:32
  SPEAKER_00: So, you know, I think that that was an interesting result.
• 11:35
  SPEAKER_00: And, you know, the the point they were making was that this is a nice way to measure the performance of these systems, which in theory could be improved by better prompting.
• 11:45
  SPEAKER_00: Maybe that would result in fewer edits needed because the messages were probably the uh the assumption there, of course, is that the messages were, you know, could be improved accuracy or could improve, like be more personalized to the physician or whatever.
• 11:58
  SPEAKER_01: Yeah, or maybe they just like shouldn't recommend a doctor's visit every single time.
• 12:01
  SPEAKER_01: You know what I mean?
• 12:02
  SPEAKER_01: It's like little things that if you see it over and over and over again, maybe it's like an adjustment that could be made.
• 12:07
  SPEAKER_00: It should remember, yeah, any time any kind of stuff, any kind of um preferences that the doctor might have as well.
• 12:13
  SPEAKER_00: Um, I I you know, I think this I have I have a few questions that I feel like haven't been covered in the study.
• 12:18
  SPEAKER_00: I mean, I don't know if you have more to say about the study particularly, but there were questions that I had as I was reading this that were um had to do again with the with sort of this human AI interaction piece.
• 12:30
  SPEAKER_00: Now I was just imagining these doctors using this, and this was only a one-year study, and there was a thousand physicians, and I forget how how I don't know that I saw any results about um sort of longitudinally, like one taking one physician and seeing what they did over the course of multiple um responses, like did their edit times go down over time for a certain category or collectively?
• 12:57
  SPEAKER_00: Because to me, I wonder sometimes with these studies is you get some result like this, and then you wonder if in fact, over time, do these physicians start to start to kind of uh assume that the AI is doing the right thing, or maybe it does it a right thing a couple of times, and then you kind of step back a little bit because you're like, okay, I think it seems to know what it's doing, I'm just gonna let it go, right?
• 13:18
  SPEAKER_01: Yeah, and they don't they don't I they didn't do that in this study, but it on the flip side, like so you could say maybe the physicians will say, Oh, it's automated, it's doing fine, I'm gonna send it through.
• 13:28
  SPEAKER_01: Or maybe they just get faster at editing because they know the areas where it errors, right?
• 13:32
  SPEAKER_01: Like it's like, oh, it always messes up this appointment thing, or like anytime there's an x-ray result include included, I'm gonna have to spend time at editing it.
• 13:40
  SPEAKER_01: They get to know like the nuances of where it does a good job versus where it doesn't.
• 13:45
  SPEAKER_01: Like maybe it's pretty good at at infusing empathy, yeah.
• 13:48
  SPEAKER_01: Um, etc.
• 13:50
  SPEAKER_01: So I think there are components of it that yeah, the provider could get to know.
• 13:54
  SPEAKER_01: But I do think it makes sense that people could kind of develop this automation bias even more over time.
• 14:01
  SPEAKER_01: Yeah.
• 14:02
  SPEAKER_01: Because it's like, hey, that took the administrative burden off me.
• 14:04
  SPEAKER_01: I'm gonna just like move it along.
• 14:06
  SPEAKER_00: Yeah.
• 14:07
  SPEAKER_00: And I think the one thing that counters that a little bit is the fact that new models come out.
• 14:12
  SPEAKER_00: And new models, you know, you could easily imagine your hospital or whatever changing from Claude Anthropic to OpenAI, or open AI releases a brand new model, or something else happens, and as a result, the types of emails, the types of messages that are created are totally different.
• 14:31
  SPEAKER_00: So then what do you do?
• 14:32
  SPEAKER_00: It's almost like you're working with a different person, right?
• 14:35
  SPEAKER_00: Totally.
• 14:36
  SPEAKER_00: So you've built over time as a physician, you've built an understanding of the strengths and limitations of the AI system you're working with.
• 14:43
  SPEAKER_00: But if that just changes all of a sudden, now you have to start again.
• 14:46
  SPEAKER_00: So that now, you know, now you have to figure out okay, this new AI system which reads differently.
• 14:52
  SPEAKER_00: I have to now read this thing again very carefully to understand what the strengths and weaknesses are.
• 14:57
  SPEAKER_00: Um, that could be an increased burden as you know, as we get new and new models, and new models come out every year.
• 15:02
  SPEAKER_00: So it's like it's going to be interesting when that happens.
• 15:05
  SPEAKER_00: And they're all different.
• 15:06
  SPEAKER_00: The interaction modalities are different, their prompt expectations are different, all of that is different.
• 15:10
  SPEAKER_01: Yeah, I think it's interesting because like newer doesn't always mean better, right?
• 15:14
  SPEAKER_01: It could be worse for this use case.
• 15:16
  SPEAKER_01: And also there has to be some component of like education of these providers to say, like, hey, we've changed this.
• 15:23
  SPEAKER_01: Here are the changes you can anticipate.
• 15:26
  SPEAKER_01: Um, and here's where, you know, maybe that means the underlying prompts need to get changed too when the model gets updated.
• 15:32
  SPEAKER_01: These things need to get tested, these things need to get governed.
• 15:35
  SPEAKER_01: You can't just snap your fingers and say, Oh, there's it's not like when your uh, you know, computer updates the operating system and you kind of expect it to just like keep working as is, maybe run a little faster.
• 15:47
  SPEAKER_01: It's like it could change everything.
• 15:49
  SPEAKER_00: Yeah.
• 15:49
  SPEAKER_00: Yeah.
• 15:50
  SPEAKER_00: And and honestly, to me, it seems like much more than response times.
• 15:55
  SPEAKER_00: I mean, is response time even the right metric for measuring, in fact, if um, you know, there's an appropriate level of load, cognitive load on the on the doctor.
• 16:05
  SPEAKER_00: Because ultimately what you're saying is, hey, I, doctor, don't want to respond to all these emails.
• 16:11
  SPEAKER_00: Um, I want to rely on AI system to help my burden so that I can I can I can be uh responsive to my patients and have get them the answers they need, but not like overburden myself.
• 16:20
  SPEAKER_00: Ultimately, that is the goal, right?
• 16:22
  SPEAKER_00: So then that means at some level, the question is one of trust.
• 16:26
  SPEAKER_00: Do you, as a doctor, trust the system to write the right emails or write the right responses?
• 16:33
  SPEAKER_00: And I how do you measure that?
• 16:35
  SPEAKER_00: Like, how do you um ensure that the pay physician is not overtrusting the AI system, um, or undertrusting for that matter?
• 16:43
  SPEAKER_00: So, like, if they you know, I don't know if response time captures that accurately because you could imagine a situation where a doctor who's so busy or so tired uh responds quickly or has a low response time, but that's got nothing to do with trust.
• 16:57
  SPEAKER_00: On the other hand, you could say the doctor completely trusts the system and it does great all the time, which is why the response time is low.
• 17:02
  SPEAKER_00: So it feels like we're not quite capturing the core aspect of this, which is the trust aspect, which to me I think is very important.
• 17:09
  SPEAKER_01: Well, it's interesting that you bring it up because I think that brings us back to this idea that, or what they found in the study, which is that the editing burden for anything requiring clinical judgment was longer.
• 17:22
  SPEAKER_01: So that's the area where you're like, hey, people don't people aren't trusting it because it's not necessarily giving the correct result.
• 17:30
  SPEAKER_01: Yeah.
• 17:30
  SPEAKER_01: It's like when it came to interpreting a lab or a diagnosis or interpreting a radiology study, saying, here's what this means for you.
• 17:38
  SPEAKER_01: That's the stuff that required clinical judgment.
• 17:41
  SPEAKER_01: And that's where it didn't do a great job because you see that people are editing there.
• 17:45
  SPEAKER_01: Yeah.
• 17:46
  SPEAKER_01: So it's like, well, maybe some more information needs to be built into the system to make that better, perhaps with prompting or macros or I don't even know what.
• 17:57
  SPEAKER_01: But I I think this study is showing that the trust isn't in those places where it's most clinical.
• 18:05
  SPEAKER_00: Yeah.
• 18:06
  SPEAKER_01: And and so how like how do you move forward from that?
• 18:09
  SPEAKER_00: Yeah.
• 18:10
  SPEAKER_00: I I also there's another piece of it which I think is more systemic, which is aren't at some level, if you have AI responding to your patient's messages, are you then losing the connection with that patient?
• 18:22
  SPEAKER_00: Because that patient, I I understand that there's a burden of of just volume, but outside of but just thinking for per patient perspective, the doctor is developing this relationship with the patient to understand what their needs are, what their medical situation is, it's unique for everybody.
• 18:37
  SPEAKER_00: Um, and by having the AI respond, they're they're not gonna see the signals that maybe they need to see as the human doctor.
• 18:45
  SPEAKER_00: And I worry sometimes that maybe that's skipping a step.
• 18:48
  SPEAKER_00: That is, they're not building that that understanding of the patient, and they're gonna over time going to get more and more separated from what the patient actually needs.
• 18:56
  SPEAKER_01: Yeah, I mean, this this brings me back to some research I've read like ages ago about how when you take notes, like in class, in a in a college class, if you were to take notes, yes, you like remember the information better than if you were to type it.
• 19:10
  SPEAKER_01: Here, I mean, presumably I'm extrapolating, but like if you write the message, you probably remember it better and build your relationship more than if you let AI write it and you just press send, right?
• 19:22
  SPEAKER_01: It's like when you spend the cognitive load thinking about your patient and what X, Y, or Z means for them as a human being in a personalized fashion, then you are working on building that relationship and building that trust between the two of you.
• 19:40
  SPEAKER_00: Yeah.
• 19:40
  SPEAKER_00: And at some level, what I'm saying, so I guess that goes back to the categories that they had, which was all about the scheduling versus like the medical heavy pieces.
• 19:48
  SPEAKER_00: You know, one one would one might argue that scheduling is a task that that's okay.
• 19:53
  SPEAKER_00: You can have it automated.
• 19:54
  SPEAKER_00: But on the other hand, a short conversation with a patient and you realize that the reason they want to reschedule is because something that was medically related is now relevant to you, could actually surface when you have that conversation, when you have that direct email.
• 20:07
  SPEAKER_00: So it's uh, I mean, even that, even a task that is seemingly not like medically relevant, like rescheduling an appointment, could have information in it that might be relevant to the doctor's understanding of the patient.
• 20:21
  SPEAKER_00: Um, so I I don't know what the right answer is because I do appreciate the burden and the and the you know the right answer is we need more primary care physicians, and the right answer is we need We need to give them more than 15 minutes to do an office with it.
• 20:33
  SPEAKER_01: And we need to reimburse them for responding to portal messages.
• 20:37
  SPEAKER_01: Like there are so many systematic issues that this is trying to get at.
• 20:42
  SPEAKER_01: And I think the truth of the matter is that AI is can be used as a as a tool, but it doesn't fix the systemic underlying problems that are so difficult right now.
• 20:54
  SPEAKER_01: People don't have access to care.
• 20:56
  SPEAKER_01: There are not enough providers.
• 20:58
  SPEAKER_01: The providers don't have enough time with patients, they don't get reimbursed for certain things.
• 21:03
  SPEAKER_01: Like a lot of practices actually don't bill for these portal messages.
• 21:07
  SPEAKER_01: So there are all these systemic problems that you're like really not fixing with AI.
• 21:11
  SPEAKER_00: Exactly.
• 21:12
  SPEAKER_00: And I think that's the point, right?
• 21:14
  SPEAKER_00: I think that's exactly right.
• 21:15
  SPEAKER_00: And I think the takeaway then is it might seem like AI is helping with handling workload, but the workload is a systemic problem in the first place.
• 21:24
  SPEAKER_00: And it's not a solution to just say, hey, I'll fix it with technology.
• 21:27
  SPEAKER_00: It's a solution to you may have to go back to the root cause and fix the root cause first, right?
• 21:32
  SPEAKER_01: Right.
• 21:32
  SPEAKER_01: And I think the research here is like, in terms of is this actually helping, right?
• 21:38
  SPEAKER_01: There's like limited to no time savings in these studies.
• 21:41
  SPEAKER_01: And then there's erroneous drafts that are just being passed through.
• 21:45
  SPEAKER_01: And then there's a lot of edits that need to be made on the clinical side of things.
• 21:49
  SPEAKER_01: So I think like the the concept of this is an interesting one.
• 21:53
  SPEAKER_01: Some providers may feel like this is helpful.
• 21:56
  SPEAKER_01: Some providers may not use this at all, but it it doesn't help with the systemic underlying issues that still do need to be addressed.
• 22:03
  SPEAKER_00: Yeah, and I think we always need to keep track of that with any kind of new technology that's being integrated into our socio-cultural fabric, right?
• 22:11
  SPEAKER_00: It's in it's a piece of technology that comes into our lives, and as a result, going to be in factored into the whole system.
• 22:18
  SPEAKER_00: And I think we need to think more about that as a society.
• 22:22
  SPEAKER_01: Absolutely.
• 22:23
  SPEAKER_01: All right, thank you for joining us.
• 22:24
  SPEAKER_01: We'll see you next time on Code and Cure.
• 22:26
  SPEAKER_01: Bye for now.