Latest / CareTalk: Healthcare. Unfiltered. / The Risk of Rushing AI Into Healthcare

Transcript

The Risk of Rushing AI Into Healthcare · CareTalk: Healthcare. Unfiltered.

• 0:06
  Let's talk about this business of having, you know, always having the need for physicians.
• 0:10
  Now, one, I can't mention who the radiologist was, but I can mention where I was at this conference and, uh, Zak Kohane from, uh, Boston Children's, who's a, a real leader in the whole AI world, FHIR, uh, et cetera, data.
• 0:27
  He mentioned that at Mass General Brigham, the residents themselves don't have primary care physicians, right?
• 0:34
  So we talked about this before when we talked about having, you know, the AI-based physicians do the triage for somebody that doesn't have a primary care physician.
• 0:41
  So the, the doctors themselves in training, they can't get primary care physicians, so it certainly puts them face to face right into this, uh, AI world.
• 0:50
  First of all, there's a lot to be worried about when we have models that are being adopted really fast and, you know, 60 to 70% of all doctors are using tools like OpenEvidence and Doximity and others to actually in the-- or, or even the frontier models like Open, op- uh, uh, Chat or Anthropic's tools to answer questions and to, and to help them accelerate getting answers to what they're doing.
• 1:16
  So we're sort of in the middle of a, uh, a flood of AI tools before we've thought through the regulatory and oversight gates to make sure that they are providing the right advice at the right time.
• 1:31
  And so I think there's-- that to me raises some questions as to whether in this rush to scale that the AI companies are doing, whether it's worth us spending a bit more time thinking about how to do it right.
• 1:45
  Let's-- So let's-- let me make that point.
• 1:47
  But part of the reason why people are accessing the tools so quickly individually and from an enterprise level, 'cause hospitals are also buying a lot of AI stuff, ambient listening tools, revenue cycle software, um, some of which, you know, one of the companies I'm involved in, Waystar.
• 2:05
  Um, and it's because they are, uh, they are, they are struggling with their own abilities to serve the people they care for with the tools available and the talent available, and they're using technology to augment what they're doing.
• 2:20
  And so as long as it's augmentation as opposed to replacement, Dave, I'm kind of for it.
• 2:27
  Um, what's your alternative to a world where we don't have enough supply of clinicians and there's a, there's a, there's a growing need for clinical support?
• 2:37
  Yeah, I mean, it really is interesting to tease out the differences, say, among the different professions within healthcare and then over time