Latest / Cardio Pod: Heart of the Matter / How Can AI Enhance Recruitment in Clinical Trials?
Transcript
- 0:06Well, good afternoon. I'm Chris O 'Connor, Principal
- 0:08Investigator of the Heart Failure Collaboratory,
- 0:11and we're here with Heart of the Matter, the
- 0:14Heart Failure Collaboratory podcast. And today's
- 0:17topic at hand is how can artificial intelligence
- 0:21improve the conduct and recruitment in clinical
- 0:25trials? Very exciting time for all of us in medicine,
- 0:29and we have a distinguished panel today, and
- 0:31I'm going to go around the room and ask. our
- 0:33panelists to introduce themselves, and then we'll
- 0:36jump into the topics. Dr. Cunningham. Hi, my
- 0:41name is John Cunningham. I'm a heart failure
- 0:42cardiologist at Brigham Women's Hospital in Boston,
- 0:45interested in how we can leverage AI to improve
- 0:48heart failure clinical care and clinical trials.
- 0:52Dr. Martin. All right, Trey G. Martin. I'm a
- 0:57heart failure transplant cardiologist at Cleveland
- 0:59Clinic's main campus. and Director of Heart Failure
- 1:02Population Health for the system. Dr. Bott. Good
- 1:07afternoon, everybody. I'm Ankit Bott. I'm a cardiologist
- 1:10and clinical investigator at the Kaiser Permanente
- 1:12Division of Research with an interest in digital
- 1:15tools and implementation science as they apply
- 1:17to clinical trials. Elise Shalowitz. Hi, good
- 1:22afternoon. My name is Elise Shalowitz. I'm a
- 1:25Senior Clinical Research Coordinator at the University
- 1:27of Colorado. Dr. Sopka. Hi, I'm Mitch Satka.
- 1:32I'm chief of heart failure and transplant at
- 1:34Nova Shara Heart and Vascular. Thank you for
- 1:37having me. Dr. Lala. Hi, Anulala. I am a heart
- 1:42function cardiologist at the Mount Sinai -Fooster
- 1:44Heart Hospital in New York, and I'm particularly
- 1:47interested in seeing how AI can significantly
- 1:49enhance clinical trial recruitment and increase
- 1:53efficiency, precision, and equity. And Dr. Jane.
- 2:00Hi, everyone. I'm Sneha Jain. I am a preventive
- 2:03and general cardiologist at Stanford University,
- 2:05and I spend a part of my time on AI development,
- 2:09deployment, and evaluation within our healthcare
- 2:10system. Well, fantastic. Well, we know that clinical
- 2:15trials are cumbersome, they're long, they're
- 2:18clunky, they're expensive. I don't even know
- 2:21why we do them the way we do them. And yet...
- 2:24There's hope. I think we think that artificial
- 2:27intelligence, the use of technology to enhance
- 2:31clinical trial conduct is particularly exciting.
- 2:35And there's an enormous interest from the entire
- 2:37ecosystem that participates in the clinical trial
- 2:41world to see if there are solutions to increase
- 2:44the value. That is the quality, increasing the
- 2:48quality, reducing the cost of how we develop.
- 2:51Therapeutics, one of the missions of the Heart
- 2:54Failure Collaboratory. And John Cunningham, I'm
- 2:57going to ask you to kick it off and say, how
- 2:59can we conduct clinical trials better by using
- 3:03technology? Well, we're all very excited about
- 3:08the potential of AI in large language models
- 3:10and clinical trials, because I think anybody
- 3:13who's used ChatGPT has seen just the incredible
- 3:17explosion in the technical side of And the ability
- 3:21of AI language model tools to summarize large
- 3:25amounts of unstructured information and distill
- 3:28them down into something that individuals can
- 3:31work with. And that can work from a recruitment
- 3:33and adjudication and a safety lens. And so we've
- 3:37been excited about the potential of AI in all
- 3:39areas of this, particularly in event adjudication
- 3:41for safety and efficacy. So thinking of ways
- 3:45that we can transform the unstructured data from
- 3:48patient notes. into efficacy outcomes, safety
- 3:52outcomes, as well as identifying patients who
- 3:55may be eligible for participation in the trial.
- 3:58So I'm really excited about all these areas and
- 4:01eager to hear from the panel on sort of the individual
- 4:03things that you're doing at your own institutions
- 4:05to bring this technology from sort of concept
- 4:09to actual implementation and patients. That's
- 4:14fantastic. I mean, that's on the downside of
- 4:18the clinical trials. Dr. Jane, what are you working
- 4:21on at Stanford that excites you about AI, artificial
- 4:26intelligence, and the way we might improve the
- 4:29ecosystem? Absolutely. Thank you. Just a couple
- 4:34of weeks ago, we announced a project we're working
- 4:36on called Chatter, C -H -A -T -E -H -R. And it's
- 4:40our way of talking with the patient's EHR across
- 4:44all kinds of data, both structured, unstructured,
- 4:47their notes that are in the EPIC system as well
- 4:49as in Care Everywhere, which is EPIC's pathway
- 4:52for looking at notes outside of the specific
- 4:55healthcare system, to be able to identify and
- 5:01find information about a patient in a way that's
- 5:03so much more conducive to a busy clinician or
- 5:07a busy study coordinator than typical search.
- 5:10And you can imagine with this system, it can
- 5:12become really easy to identify across very many
- 5:16patients who meets inclusion -exclusion criteria,
- 5:19the best way to contact them. And then it provides
- 5:22a platform and foundation for that kind of work
- 5:25within clinical trials, but then also just care
- 5:27in general. And then if possible, after the podcast,
- 5:30we can share some links if people want to learn
- 5:33further. But that on the technical side is what
- 5:35we're working on. On the non -technical side
- 5:38or, you know, everything else that's needed to
- 5:41help make AI as usable and as effective in our
- 5:46systems as possible. For clinical trials, we're
- 5:49really focused kind of on three areas. One is
- 5:51how do we think about digital strategy and data
- 5:54infrastructure? All of a patient's data that's
- 5:56important does not live in one place. So how
- 5:58do we think about that? Two, how do we think
- 6:00about the business model of clinical trials,
- 6:02which right now is very focused on clinical sites,
- 6:06not really on the patient? And then third, what
- 6:09do we need to think about in terms of the right
- 6:11evaluation and monitoring of AI tools over time
- 6:14to make sure that they are safe, they're effective?
- 6:17What do we need in terms of regulation, not just
- 6:20on a government level, but also within our health
- 6:22systems and our clinical trial platforms? Well,
- 6:25that's very exciting and really novel. And I
- 6:29think we're going to be looking forward to hearing
- 6:31more about these initiatives from Stanford to
- 6:35move things along. Trey, tell us a little bit
- 6:38about where you think AI could fit into the clinical
- 6:41trial ecosystem and improve it. Yeah, you know,
- 6:46I think that when you think about the conduct
- 6:48of clinical trials, I think like every domain,
- 6:52in healthcare, people are being asked to do more
- 6:54with less resources. And so I think there's a
- 6:57lot that we have to think about in terms of the
- 7:00shortage of research coordinators, for example.
- 7:03You know, if they are given a list of MRNs, for
- 7:07example, of patients who could be eligible without
- 7:10any of the justifications to go along with it,
- 7:13they're not going to use it. And I've actually
- 7:16had that experience more on the structured data
- 7:18side in the past. And so... If what we need is
- 7:22a user interface that actually cuts down time
- 7:25for research coordinators and provides valid
- 7:29justifications using AI and LLMs in order for
- 7:34it to be used. I think the opportunity is huge
- 7:37because the way we still recruit for the majority
- 7:39of our clinical trials is through the contact
- 7:42with the PI or co -Is who are aware of the study.
- 7:45Direct clinical contact. That's still the bread
- 7:48and butter of clinical trial recruitment. for
- 7:50most of the country. Now, how do you capitalize
- 7:53on the broadening of the search using LLMs? You
- 7:58actually need to come down in the time used in
- 8:01other circumstances. And I think for the recruitment
- 8:04standpoint, I think that's the screening portion.
- 8:08And we've deployed a technology within our health
- 8:11system, within our firewall, a proprietary LLM
- 8:15called Synapsus AI from a company called Diania
- 8:19Health that has been able in our system after
- 8:23doing some mapping of where structured data lives,
- 8:26be able to combine structured and unstructured
- 8:28data. And we've used them to recruit for several
- 8:31trials, including a study I'm involved with called
- 8:34Depletor, which is amyloid fibril removal in
- 8:38TTR amyloidosis. And what we found is that when
- 8:42you deploy this technology, you can actually
- 8:45increase diversity. racially and in terms of
- 8:48identifying variant amyloid, but also find those
- 8:52who may not necessarily be seeing our advanced
- 8:55heart failure group. So both geographically and
- 8:58racial diversity with increased recruitment.
- 9:01So I think it's an exciting technology, but we
- 9:04still need a lot more kind of ways to disseminate,
- 9:08ways to operationalize the technology and make
- 9:11sure that our research coordinators are brought
- 9:13along the way. in terms of providing feedback
- 9:16to the vendors. Those are terrific points. So
- 9:21we can eliminate perhaps some of the biases that
- 9:25are inherent in our current way of recruiting
- 9:27by taking this more structured approach. Ankit,
- 9:33I'm going to ask you about take us one step even
- 9:35before the recruitment, and that's protocol design.
- 9:41As you know, you've been involved in designing
- 9:43protocols and we get into this big event of inclusion,
- 9:49exclusion criteria. And before you know it, everything
- 9:51is put together as a very complicated protocol.
- 9:54Can we use AI, predictive analytics to say, listen,
- 9:57historically, these are the patients that are
- 10:01going to be excluded based on these factors are
- 10:04included. These are the patients that are going
- 10:06to drop out. because they couldn't adhere to
- 10:10the protocol. Can we use that type of approach
- 10:12to design better protocols? Yeah, thank you,
- 10:16Chris. I think that's a wonderful point. I really
- 10:18see the vision for AI across the clinical trial
- 10:22ecosystem. Trey and John and others have really
- 10:25mentioned how it might hyperpower sites to be
- 10:28more effective, to use their site coordinators
- 10:32more efficiently and recruit at a greater speed.
- 10:35Also, I think clinical trials have the power,
- 10:37now that real -world data sets are being constructed
- 10:41at scale, the application of AI to those types
- 10:45of data sets may better inform clinical trial
- 10:47protocols, the ambient event rates with contemporary
- 10:51guideline -directed medical therapy for many
- 10:53of the conditions in cardiovascular medicine
- 10:55that are moving more quickly. And then also from
- 10:59a sponsor standpoint, sponsors are conducting
- 11:01clinical trials across many sites. Some of them
- 11:03are conserved. They use the same sites for many
- 11:06of their clinical trials and using AI to power
- 11:09both the analysis of which sites to pick and
- 11:12which protocol amendments to make. If they made
- 11:15a particular amendment to their protocol and
- 11:17could see how that might change the number of
- 11:20potentially eligible patients at sites they use
- 11:22frequently, that could be very powerful for those
- 11:25study leadership to make. a decision based on
- 11:28data rather than our current structure, which
- 11:31is less data -driven, and actually speed up the
- 11:34recruitment in clinical trials and make in -trial
- 11:37planning. So I see it as AI really being transformative
- 11:40across the ecosystem from trial planning to trial
- 11:43recruitment and, as John mentioned, trial adjudication.
- 11:46I mean, those are really important points. If
- 11:49you think about, and we've talked about this
- 11:51in collaboratory meetings, the TOPCAT trial,
- 11:53the Data Safety Monitoring Board. This emerging
- 11:58data coming in from Georgia and Russia that didn't
- 12:01quite look right, but was coming in really fast.
- 12:04And the native eye of the human eye could not
- 12:08pick up the patterns fast enough before there
- 12:10was the washing of all these patients randomized.
- 12:13And it really took down an important trial. Elise,
- 12:18I'm going to ask you, you're the one that's on
- 12:20the front line of all of us on this call. And
- 12:23you're faced with... running and conducting the
- 12:27monitoring audits and the monitoring sessions
- 12:30when you're doing a clinical trial as someone
- 12:33who's on the front line. How can AI, you think,
- 12:36help monitoring in the conduct of clinical trials?
- 12:41So much of it's labor intensive. It's like the
- 12:44most expensive part of running a clinical trial.
- 12:48Yeah, that's a great question. I don't know if
- 12:50we'll be able to solve it, but I think that just
- 12:53bringing forward the data, like we spend so much
- 12:56time digging through charts and looking through
- 12:58notes and trying to aggregate structured and
- 13:02unstructured data and bring everything together.
- 13:05So I think that if there's a tool that can really,
- 13:07you know, surface everything in one, you know,
- 13:10summarized format, we've talked a lot about that,
- 13:12like the chart chat sounds so incredible for
- 13:15that purpose, where you can kind of bring all
- 13:17the points rather than kind of in your head,
- 13:19bringing the notes and the structured data. into
- 13:23one place, I think that's where it can have a
- 13:25really great impact. Any other aspects from your
- 13:30point of view, being so close to the front line
- 13:33that you think AI could help with the conduct
- 13:35of trials? I think with recruitment, we've touched
- 13:39upon it a little bit already today, just, you
- 13:42know, targeting those diverse and role and community
- 13:45health system, you know, affiliates, because
- 13:48we are only limited to those, like you guys said,
- 13:51that the PIs, you know, really touch with, but
- 13:54being able to disseminate, you know, through
- 13:56BPAs or CDS alerts to providers who may not necessarily
- 14:00be so in tune to the clinical trials underway
- 14:03and kind of bring forward those patients who
- 14:05may not necessarily be at the academic center
- 14:08so that we can screen more broadly and more equitably
- 14:12across the entire health system. Now, because
- 14:16I write Dr. Sotka's paycheck, I can ask him any
- 14:20question I want and, you know, Mitch, the concept
- 14:25of not eliminating controls, but maybe augmenting
- 14:31controls with the concept of digital twins. What
- 14:35in the world is that, a digital twin? Can we
- 14:39get to a point where we don't have to utilize
- 14:43so much energy around control groups the way
- 14:46we do now? I'm so glad you asked me, Chris. The
- 14:52idea, and I think if we just take a step back
- 14:56here, the potential with which AI is talked about
- 15:00in general and in the clinical trial space is
- 15:04often grandiose. I think if we look at this concept
- 15:09of digital twins, it really comes from, as you
- 15:13mentioned earlier, that it is really costly to
- 15:16run a clinical trial. In the end, though, the
- 15:19truth is that we still need the data that is
- 15:21generated in a randomized fashion to understand
- 15:25the effects of an intervention on a population
- 15:28of people and whether or not that is beneficial
- 15:30or harmful or really has no effect whatsoever.
- 15:34And the truth here is that even when you're talking
- 15:38about, I think, the use cases where AI has most
- 15:41of its potential, when that comes to trial recruitment,
- 15:45it still needs to be used as a screening tool
- 15:49that then often requires manual confirmation
- 15:52that the patients are correct. When you get to
- 15:56this idea of a digital twin, meaning you create
- 15:59a digital version of a patient that then you
- 16:04can in silico express a treatment or not and
- 16:08see what happens to them. And you can emulate
- 16:11a clinical trial based on inputting vast quantities
- 16:15of information, either known from clinical trial
- 16:18data that already exists or from real world data
- 16:21that is being collected. And you can pretend
- 16:23that you know what would happen. That trial in
- 16:26the current setting still needs to be performed
- 16:28because we don't know. We don't have a detailed
- 16:32enough understanding of. The physiology of the
- 16:35medicine, of the interaction with the drug, of
- 16:36the side effects, of the off -target effects
- 16:38of a treatment to actually emulate what will
- 16:42happen in silico and know what will happen in
- 16:44the real world. So this idea of being able to
- 16:48eliminate control groups, while a very attractive
- 16:54ideal because it would be astoundingly cheaper
- 16:56than our current clinical trial infrastructure,
- 16:59currently remains unachievable based on our current
- 17:02knowledge. and current understanding of how AI
- 17:05works. Okay, so we're not ready yet, but you
- 17:10haven't given up hope. Anu, where do you think
- 17:14AI could have the biggest impact in our clinical
- 17:18trial ecosystem? Yeah, thanks so much, Chris.
- 17:21I'm so glad we're doing this because I feel like
- 17:23we all are talking about AI and yet we don't
- 17:25fully, we've seen glimpses of it work, but really
- 17:30seeing it in full. fledged implementation in
- 17:33our healthcare system still remains to be seen.
- 17:37I would say Sinai, for example, has an AI institute,
- 17:41a data science institute, and we're seeing pockets
- 17:44of things come up. For example, like Epic Notes,
- 17:47we have an automated generated reply to patients
- 17:51when they send us messages, for example. But
- 17:54it's still, like Mitch just pointed out, it needs
- 17:57that human oversight. To me, what I'm most excited
- 18:00about about, many people have already mentioned
- 18:02this, is I oversee our clinical trial coordinators.
- 18:05You know this well, Chris, because you and Mona
- 18:07do such an amazing job with our interns. And
- 18:10they are, especially with heart failure trials,
- 18:13these patients are complex. There's multiple
- 18:15comorbid conditions. There are multiple criteria
- 18:18that need to be met, both that are found in unstructured
- 18:22and structured sources. And the screening part
- 18:25is really the pain point. And so I would say.
- 18:29mitigating that process would be an ideal scenario.
- 18:34And Trey, we heard, spoke about his experience
- 18:37in this respect. And then also reaching those
- 18:40individuals who are traditionally under -enrolled.
- 18:43I think that's critically important. And then
- 18:45I'm also really excited about this idea of AI
- 18:49enabling deep phenotyping of certain subgroups
- 18:53using multiomics, imaging, longitudinal data
- 18:57to potentially define specific molecular and
- 19:00physiologic subgroups that then we can learn
- 19:02more from moving forward. So I think the promise
- 19:05is tremendous. I am actually optimistic. The
- 19:08question will be how things are implemented and
- 19:11how they're implemented in a way that can be
- 19:14translatable across health systems and not just
- 19:17at Sinai or just... at Stanford, but what can
- 19:19we ubiquitously use across all of our healthcare
- 19:22systems such that we develop more of a uniform
- 19:26way of implementing AI across regular care and
- 19:30clinical trial design and enrollment? Well, that's
- 19:34optimistic and I think hopeful. I mean, I do,
- 19:37you know, EHRs, I think 70 % are, you know, are
- 19:42utilizing Epic. So there's some... harmonization
- 19:45of EHRs. And so tools that can go into the EHR
- 19:50and identify patients. Dr. Jane, one of the concerns
- 19:55we have here is that, okay, now there's a tool
- 19:58to identify hypertrophic cardiomyopathy patients.
- 20:01We're doing HC trials. There's a concern about
- 20:05turning this on because we don't have enough
- 20:08physicians. to see all those patients if we turn
- 20:12it on and get this tidal wave of activity. And
- 20:16then, you know, what are the liabilities? What
- 20:18are the downsides of misdiagnoses, et cetera?
- 20:21So tell us a little bit about your thoughts on
- 20:24these tools that are doing, assisting in maybe
- 20:29rarer forms of conditions that we recruit for
- 20:33in clinical trials. I am so glad you brought
- 20:35this up. I think that this is... This is critical,
- 20:38right? Because everyone thinks that, oh, we can
- 20:40identify more patients. That's great. But if
- 20:43we don't have the capacity to actually help those
- 20:45patients, what are we doing? So that's why part
- 20:49of, I'm glad you brought up HCM in particular,
- 20:52because we've been looking at this with the American
- 20:53Heart Association. And part of what we're starting
- 20:56to do now is create target product profiles for
- 20:59health AI. in the same way that there are target
- 21:01product profiles for drugs to try to meet clinical
- 21:04and regulatory guidance or for public health
- 21:07efforts with the WHO. And by doing these target
- 21:11product profiles, we not only look at the technology,
- 21:13but the workflow in which they're supposed to
- 21:15operate. So for hypertrophic cardiomyopathy,
- 21:17we mapped out the patient journey, if they were
- 21:20identified with or without AI, found the bottlenecks
- 21:24in our system. and identified how well a model
- 21:27needs to work to actually move the needle in
- 21:29terms of mortality or symptoms or whatever it
- 21:32might be. This was for clinical practice. And
- 21:35this blueprint, this target product profile,
- 21:38also allows you to go to your leadership and
- 21:40say, hey, if we turn this on, what's going to
- 21:42happen if we move the lever of capacity, if we
- 21:44hire more APPs in this area, if we increase our
- 21:47echo capability? And I think that that's been
- 21:51really powerful because we move from this reactive
- 21:54nature where most of health care is right now,
- 21:56where an AI tool is built, and then we try to
- 21:58retrofit it into clinical practice and instead
- 22:00start with what's the clinical reality now? How
- 22:04can AI improve this and where are we going to
- 22:06run into unintended consequences? And can we
- 22:08build our business and healthcare delivery systems
- 22:11around this? How can we innovate those systems
- 22:13to actually enhance care, especially for these
- 22:16rare diseases? So we've done this for HCM. We've
- 22:19done this now for cardiac amyloid as well. And
- 22:22so that's kind of how we're approaching it. Exciting.
- 22:28Gosh, can we fast forward and get through all
- 22:30the growing pains and get to the seamless clinical
- 22:34trial that is much easier to do? When you look
- 22:37at what the journey we've been on, these large
- 22:41clinical trials take five years, seven years.
- 22:45You know, you can only do so many of these in
- 22:47a lifetime. And so we have to solve this problem
- 22:50by being able to be simultaneous and doing many,
- 22:54many trials in a shorter period of time. John
- 22:57Cunningham, I'm going to give you the last word
- 22:59from what you've heard. Summarize for our audience
- 23:02what the hope is, what are the challenges? Well,
- 23:07I think we've heard a number of examples of promising
- 23:11areas and the sense that now the challenges are
- 23:14less technical and more related to implementation
- 23:18and getting this technology in the hands of...
- 23:23practicing physicians and research coordinators
- 23:26to really make this happen. I think there's a
- 23:30number of different pieces of software that can
- 23:32do interesting things and really penetrating
- 23:34hospitals is the next step. And I think expanding
- 23:37to some of these perhaps less glamorous but really
- 23:42important clinical trial areas like monitoring
- 23:45really offer some low -hanging fruit to decrease
- 23:50cost, improve reliability, and avoid fraud, while
- 23:55also starting with the task that's easily checkable
- 23:58and really not dangerous to patients or trial
- 24:03integrity at all. So I'm really excited about
- 24:05that going forward. Well, terrific. Well, I want
- 24:09to thank my colleagues here today for starting
- 24:12the conversation. This is not one that will end
- 24:14anytime soon, but we've started this conversation.
- 24:17This is a major emphasis of the Heart Failure
- 24:21Collaboratory, and I want to thank you here today
- 24:24for being on this podcast, Heart of the Matter,
- 24:26Heart Failure Collaboratory, and we'll see you
- 24:28next time. Thank you.