Latest / Let's Talk Risk! Podcast / Deep Dive: When Patient Preference Becomes Regulatory Evidence
Transcript
- 0:00SPEAKER_00: Imagine sitting across from the FDA and you're sliding
- 0:03SPEAKER_00: a pivotal clinical trial report across the table.
- 0:06SPEAKER_01: Oh, boy.
- 0:06SPEAKER_00: Yeah.
- 0:07SPEAKER_00: And the raw data on your novel implantable device shows an 80% serious adverse event rate.
- 0:14SPEAKER_00: 80%.
- 0:15SPEAKER_01: Which is just, I mean, that's catastrophic on paper.
- 0:17SPEAKER_00: Right.
- 0:17SPEAKER_00: And your acute kidney injury rate is sitting at 40%.
- 0:21SPEAKER_00: Under the traditional regulatory paradigm,
- 0:23SPEAKER_00: a quality and regulatory affairs VP looking at those numbers is doing two things.
- 0:29SPEAKER_00: Uh...
- 0:29SPEAKER_00: Drafting the project as postmortem and quietly updating their resume?
- 0:33SPEAKER_01: Exactly.
- 0:34SPEAKER_01: You're packing your desk.
- 0:35SPEAKER_00: Because the assumption has always been that safety thresholds are rigid,
- 0:38SPEAKER_00: you know, objective lines in the sand.
- 0:40SPEAKER_00: But in a landmark case,
- 0:41SPEAKER_00: one sponsor took that exact data,
- 0:44SPEAKER_00: that brutal 80% SAE rate, and used it to secure a PMA approval.
- 0:48SPEAKER_00: It's wild.
- 0:49SPEAKER_00: Today, we are unpacking the mechanism that made that possible.
- 0:52SPEAKER_00: Our mission in this deep dive is to equip you,
- 0:55SPEAKER_00: the QRA executive,
- 0:56SPEAKER_00: with a highly strategic,
- 0:58SPEAKER_00: technical,
- 0:58SPEAKER_00: and ROI-focused blueprint of the FDA is March 30,
- 1:01SPEAKER_00: 2026, And
- 1:06SPEAKER_01: the paradigm shift here is just profound.
- 1:08SPEAKER_01: When we look at this 33-page final guidance document,
- 1:12SPEAKER_01: along with the detailed regulatory breakdowns we've sourced from RAPS,
- 1:16SPEAKER_01: Pure Global,
- 1:17SPEAKER_01: and an audio case study of that exact PMA rescue we just mentioned,
- 1:21SPEAKER_01: A completely new regulatory architecture emerges.
- 1:24SPEAKER_00: Yeah.
- 1:25SPEAKER_01: I mean, the historical mindset dictated that the FDA alone decided what constituted
- 1:29SPEAKER_01: a mathematically acceptable safety profile.
- 1:31SPEAKER_00: Right.
- 1:32SPEAKER_00: They held all the carbs.
- 1:33SPEAKER_01: Exactly.
- 1:33SPEAKER_01: But the 2026 guidance fundamentally rewrites the benefit risk equation across
- 1:38SPEAKER_01: the total product lifecycle, the TPLC.
- 1:41SPEAKER_01: The FDA now formally accepts rigorous mathematical proof of
- 1:45SPEAKER_01: a patient's personal risk tolerance as valid scientific evidence.
- 1:49SPEAKER_00: So the subjective desperation of a patient population has been converted into
- 1:53SPEAKER_00: a quantifiable, heavily regulated statistical model.
- 1:56SPEAKER_01: That's exactly it.
- 1:57SPEAKER_01: It's taking human emotion and putting it on a utility curve.
- 2:00SPEAKER_00: And that conversion is what generates the executive ROI.
- 2:04SPEAKER_00: Because before we get into the heavy compliance mandates of how
- 2:08SPEAKER_00: to actually design these studies,
- 2:10SPEAKER_00: you know,
- 2:10SPEAKER_00: the strict rules in Section V of the guidance,
- 2:12SPEAKER_00: we have to establish why a QRAVP should be allocating budget to this in
- 2:17SPEAKER_00: the first place.
- 2:18SPEAKER_01: Yeah, because these studies aren't cheap.
- 2:19SPEAKER_00: No, they're not.
- 2:20SPEAKER_00: We're talking about rescuing borderline clinical trials,
- 2:24SPEAKER_00: securing subpopulation approvals,
- 2:26SPEAKER_00: radically downsizing clinical trial enrollment targets,
- 2:29SPEAKER_00: and in some cases bypassing clinical trials entirely for indication expansions.
- 2:34SPEAKER_00: Right.
- 2:35SPEAKER_00: But to unlock any of that, we have to isolate a fundamental industry trap first.
- 2:41SPEAKER_00: There is a persistent,
- 2:42SPEAKER_00: expensive misconception that patient-reported outcomes,
- 2:46SPEAKER_00: PROs, and patient preference information, PPI, are interchangeable.
- 2:50SPEAKER_00: Oh, yeah.
- 2:50SPEAKER_01: And conflating those two will guarantee your rejected submission seen all the time.
- 2:54SPEAKER_01: A PRO is a snapshot of clinical efficacy.
- 2:57SPEAKER_01: Right.
- 2:57SPEAKER_01: You ask a patient to rate their joint pain on a scale of 1 to 10 after receiving
- 3:00SPEAKER_01: an orthopedic implant, or,
- 3:02SPEAKER_01: you know,
- 3:02SPEAKER_01: you have them fill out a standardized quality of life questionnaire at
- 3:05SPEAKER_01: a six-month follow-up.
- 3:06SPEAKER_01: It simply measures how the patient feels as a direct result of the therapy.
- 3:11SPEAKER_01: It is data generated by the device's performance.
- 3:14SPEAKER_01: PPI is entirely different.
- 3:16SPEAKER_01: Patient preference information measures the complex,
- 3:19SPEAKER_01: hypothetical tradeoffs a patient is willing to make before they ever receive
- 3:22SPEAKER_01: the therapy.
- 3:23SPEAKER_00: It captures the value they assign to specific clinical outcomes versus specific clinical risks.
- 3:29SPEAKER_01: Exactly.
- 3:29SPEAKER_01: The question shifts from does this device reduce your daily pain to would you accept
- 3:35SPEAKER_01: a 20% absolute risk of a systemic infection up front and a 10% risk of
- 3:40SPEAKER_01: a surgical revision in exchange for a 50% probability
- 3:44SPEAKER_01: of eliminating your daily pain?
- 3:45SPEAKER_00: Wow.
- 3:46SPEAKER_00: Okay.
- 3:46SPEAKER_01: Yeah.
- 3:47SPEAKER_01: So PPI maps the breaking point of the patient's risk tolerance.
- 3:50SPEAKER_01: It establishes preference heterogeneity,
- 3:53SPEAKER_01: acknowledging that the theoretical average patient doesn't exist.
- 3:56SPEAKER_01: Some patients are highly risk averse.
- 3:58SPEAKER_01: Others are willing to accept massive safety risks to achieve a specific benefit.
- 4:02SPEAKER_00: Which brings us back to the hook,
- 4:03SPEAKER_00: the alpha pump case study,
- 4:04SPEAKER_00: because this is the perfect distillation
- 4:06SPEAKER_00: of preference sensitive decision making rescuing a seemingly doomed PMA.
- 4:11SPEAKER_01: Absolutely.
- 4:12SPEAKER_00: So the alpha pump is a wirelessly charged implant designed for adult patients
- 4:16SPEAKER_00: with liver cirrhosis who suffer from refractory acytes,
- 4:19SPEAKER_00: which is a condition where massive,
- 4:21SPEAKER_00: debilitating amounts of fluid accumulate in the abdomen.
- 4:24SPEAKER_01: And the baseline standard of care for these patients is incredibly severe.
- 4:28SPEAKER_01: It involves large volume paracentesis, or LVP.
- 4:31SPEAKER_00: Which is awful!
- 4:33SPEAKER_01: It's brutal.
- 4:34SPEAKER_01: Patients must travel to a clinic every week or two,
- 4:36SPEAKER_01: have a large bore needle inserted into their abdomen,
- 4:39SPEAKER_01: and remain there while several liters of fluid are physically drained.
- 4:43SPEAKER_00: Right.
- 4:43SPEAKER_01: It utterly dominates their existence.
- 4:45SPEAKER_01: Gripping-way mobility, autonomy, quality of life.
- 4:49SPEAKER_01: So Sequana Medical ran the Poseidon Pivotal trial to test the alpha pump against this baseline.
- 4:55SPEAKER_00: And the data from Poseidon yielded that 80% serious adverse event rate
- 4:59SPEAKER_00: through 24 months alongside the 40% acute kidney injury rate.
- 5:03SPEAKER_00: Pump pocket infections, catheter blockages requiring surgical intervention.
- 5:07SPEAKER_01: Yeah, tough numbers.
- 5:09SPEAKER_00: It's really tough.
- 5:10SPEAKER_00: If you look at this purely from a traditional objective safety threshold,
- 5:15SPEAKER_00: the device appears unapprovable.
- 5:17SPEAKER_00: My immediate thought as a regulatory strategist looking at that is liability
- 5:21SPEAKER_00: and statutory obligation.
- 5:23SPEAKER_00: The FDA's mandate is to ensure safety and efficacy.
- 5:27SPEAKER_00: How does factoring in a patient's subjective hatred of their standard
- 5:30SPEAKER_00: of care circumvent the statutory requirement that a device must be safe?
- 5:34SPEAKER_00: I mean, risk is risk.
- 5:36SPEAKER_00: An 80% SAE is an 80% SAE.
- 5:39SPEAKER_01: Well, see,
- 5:39SPEAKER_01: the 2026 guidance clarifies that safety is no longer a monolithic,
- 5:43SPEAKER_01: uniform threshold applied indiscriminately across all therapeutic areas.
- 5:48SPEAKER_01: Safety is now relative to the mathematically validated preference of the end user.
- 5:52SPEAKER_00: Okay, so how did they prove that mathematically?
- 5:54SPEAKER_01: To capture this,
- 5:54SPEAKER_01: the sponsor partnered with RTI Health Solutions to conduct
- 5:57SPEAKER_01: a discrete choice experiment, a DCE.
- 6:00SPEAKER_01: And the FDA views a properly structured DCE as valid scientific evidence.
- 6:05SPEAKER_01: In a DCE, you do not just ask a patient, hey, would you like this pump?
- 6:08SPEAKER_01: You force them into a structured, exhaustive series of tradeoffs.
- 6:12SPEAKER_01: You present Profile A,
- 6:14SPEAKER_01: which entirely eliminates the need for paracentesis,
- 6:17SPEAKER_01: but carries a high risk of kidney injury and surgical revision.
- 6:20SPEAKER_00: Okay.
- 6:21SPEAKER_01: The methodology here is critical because they are generating a utility curve.
- 6:24SPEAKER_01: Exactly.
- 6:24SPEAKER_01: The respondent is taken through perhaps 15 or 20 of these choice tasks.
- 6:38SPEAKER_01: Right.
- 6:38SPEAKER_01: Right.
- 6:39SPEAKER_01: Right.
- 6:53SPEAKER_01: Statisticians can calculate the exact beta coefficients.
- 6:56SPEAKER_01: That's the relative weight the patient population signs to each attribute.
- 6:59SPEAKER_01: They pinpoint the exact moment the patient says, okay, the risk is now too high.
- 7:03SPEAKER_01: I will just stick with the needle.
- 7:04SPEAKER_00: This operates a lot like corporate financial hedging or actuarial risk modeling.
- 7:07SPEAKER_01: Yes.
- 7:08SPEAKER_00: You are identifying a known quantifiable high yield risk,
- 7:12SPEAKER_00: in this case,
- 7:12SPEAKER_00: the revision surgery,
- 7:14SPEAKER_00: and accepting it to eliminate a systemic debilitating baseline cost,
- 7:18SPEAKER_00: which is the paracentesis.
- 7:21SPEAKER_00: The utility curve mathematically proved that patients were willing to accept
- 7:24SPEAKER_00: a greater than 35% risk of a minor procedure,
- 7:27SPEAKER_00: like a device explained or revision, to escape their standard of care.
- 7:31SPEAKER_01: When you overlay that mathematically validated threshold onto the clinical data from
- 7:35SPEAKER_01: the Poseidon trial, the narrative completely flips.
- 7:39SPEAKER_01: The actual trial rate for minor revisions was 20%.
- 7:42SPEAKER_01: So while 20% looks catastrophic on a traditional risk matrix,
- 7:46SPEAKER_01: it is 15 percentage points below the patient's maximum acceptable risk, the MAR.
- 7:51SPEAKER_00: That's fascinating.
- 7:52SPEAKER_01: Right.
- 7:52SPEAKER_01: The FDA evaluated the clinical data through the lens of the utility curve.
- 7:56SPEAKER_01: The subjective desperation of the cirrhosis patient was converted into
- 7:59SPEAKER_01: a quantified minimal acceptable benefit, a MA.
- 8:03SPEAKER_01: Because the device's performance fell safely within
- 8:05SPEAKER_01: the validated preference threshold of that specific subpopulation,
- 8:09SPEAKER_01: the PMA was approved.
- 8:10SPEAKER_00: That concept,
- 8:11SPEAKER_00: the minimal acceptable benefit,
- 8:13SPEAKER_00: is a massive lever for QRA leaders because it allows you
- 8:16SPEAKER_00: to define highly specific performance goals.
- 8:19SPEAKER_00: If you can define the MA mathematically,
- 8:21SPEAKER_00: you can potentially downsize costly clinical trial enrollment targets.
- 8:25SPEAKER_01: Huge cost savings there.
- 8:26SPEAKER_00: Absolutely.
- 8:27SPEAKER_00: You aren't powering a trial to prove an arbitrary safety margin.
- 8:30SPEAKER_00: You are powering it to clear the specific patient-validated MA.
- 8:35SPEAKER_00: Oh, this is one of my favorite examples.
- 8:36SPEAKER_00: Yeah.
- 8:36SPEAKER_00: Okay.
- 8:36SPEAKER_00: Okay.
- 8:37SPEAKER_00: Okay.
- 9:03SPEAKER_01: The sponsor wanted to expand the indication to allow for solo home use,
- 9:07SPEAKER_01: granting the patient complete autonomy.
- 9:09SPEAKER_00: The roadblock there is immediate and obvious.
- 9:11SPEAKER_00: You cannot run a clinical trial for that indication.
- 9:14SPEAKER_00: No.
- 9:14SPEAKER_00: No institutional review board on the planet is going to approve a trial protocol
- 9:19SPEAKER_00: where you intentionally leave a hemodialysis patient alone in a room to see how many
- 9:24SPEAKER_00: of them experience a fatal needle dislodgement and bleed out.
- 9:27SPEAKER_01: Yeah, that's not happening.
- 9:28SPEAKER_00: The clinical pathway was completely blocked.
- 9:31SPEAKER_01: So with a clinical trial off the table, the sponsor pivoted to a PPI strategy.
- 9:36SPEAKER_01: However,
- 9:37SPEAKER_01: instead of a discrete choice experiment like we saw with the alpha pump,
- 9:41SPEAKER_01: they utilized the threshold technique, or TT.
- 9:44SPEAKER_00: Right.
- 9:45SPEAKER_01: The threshold technique is the optimal statistical model when you have
- 9:48SPEAKER_01: a single fixed clinical benefit,
- 9:51SPEAKER_01: in this case,
- 9:52SPEAKER_01: the total autonomy of solo therapy,
- 9:55SPEAKER_01: and you need to find the maximum acceptable limit for a specific severe risk.
- 9:59SPEAKER_00: So they tested the risk of death and the risk of needle dislodgement.
- 10:02SPEAKER_01: Yes.
- 10:02SPEAKER_00: They surveyed 142 patients.
- 10:04SPEAKER_00: And the threshold technique...
- 10:06SPEAKER_00: Forces the patient to weigh that single fixed benefit
- 10:09SPEAKER_00: against incrementally increasing probabilities of the catastrophic risk.
- 10:12SPEAKER_00: The data proved that the patient population heavily valued their autonomy.
- 10:17SPEAKER_00: They were statistically willing to accept the higher,
- 10:19SPEAKER_00: potentially fatal risks of solo therapy in exchange for not having to rely on
- 10:24SPEAKER_00: a caregiver.
- 10:25SPEAKER_01: And the result was that the FDA reviewed the threshold technique data,
- 10:29SPEAKER_01: accepted the mathematically validated preference threshold,
- 10:32SPEAKER_01: and granted the 510k indication expansion.
- 10:36SPEAKER_01: The sponsor secured a major market advantage without ever enrolling a single patient
- 10:40SPEAKER_01: in a new, impossible clinical trial.
- 10:43SPEAKER_01: Millions of dollars and years of development time were saved
- 10:46SPEAKER_01: because they successfully converted subjective patient preference
- 10:49SPEAKER_01: into objective regulatory data.
- 10:51SPEAKER_00: But the underlying reality here is that capturing that ROI is incredibly difficult.
- 10:56SPEAKER_01: Oh, really?
- 10:56SPEAKER_00: It requires navigating a highly prescriptive minefield of regulatory design rules.
- 11:01SPEAKER_00: Because the FDA didn't just open the floodgates and say, hey, send us your surveys.
- 11:04SPEAKER_01: No, no, no.
- 11:05SPEAKER_00: Section V of the final guidance outlines strict compliance mandates.
- 11:10SPEAKER_00: If a QRA team does not execute these methodologies perfectly,
- 11:13SPEAKER_00: the FDA will outright reject the multi-million dollar prefix study.
- 11:18SPEAKER_00: The most immediate compliance trap involves how the survey is administered to the patient.
- 11:22SPEAKER_01: Historically,
- 11:23SPEAKER_01: a sponsor might contract a third-party vendor to email a survey link to
- 11:27SPEAKER_01: a patient panel.
- 11:29SPEAKER_01: The patient clicks through it on their phone while watching television,
- 11:32SPEAKER_01: and the sponsor submits the resulting data.
- 11:35SPEAKER_01: The 2026 guidance explicitly bans this casual approach.
- 11:39SPEAKER_01: If a preference survey is self-administered,
- 11:42SPEAKER_01: meaning the patient is completing it independently,
- 11:44SPEAKER_01: without real-time guidance and moderation
- 11:46SPEAKER_01: from trained clinical research— Staff participants are now required to complete
- 11:50SPEAKER_01: a mandatory educational tutorial followed by a formal comprehension quiz
- 11:55SPEAKER_01: before they're even allowed to view the preference questions.
- 11:58SPEAKER_00: And this isn't just a basic I agree checkbox at the bottom of a terms and conditions page.
- 12:02SPEAKER_00: The sponsor has to document the results of those comprehension quizzes
- 12:05SPEAKER_00: and submit them as supportive evidence in the regulatory filing.
- 12:09SPEAKER_00: If you cannot objectively prove that the respondent thoroughly understood
- 12:13SPEAKER_00: the clinical tradeoffs being presented,
- 12:15SPEAKER_00: The FDA considers the entire dataset invalid.
- 12:19SPEAKER_01: The statistical reasoning behind this mandate is sound.
- 12:22SPEAKER_01: If a patient does not genuinely comprehend the difference between
- 12:25SPEAKER_01: a transient acute kidney injury and a chronic systemic infection,
- 12:29SPEAKER_01: the utility curve generated by their choices is mathematically worthless.
- 12:33SPEAKER_01: It is noise.
- 12:34SPEAKER_01: The FDA requires you to prove you have isolated the true preference signal from
- 12:38SPEAKER_01: the noise of misunderstanding,
- 12:40SPEAKER_01: which leads to another critical boundary established in the guidance,
- 12:42SPEAKER_01: the commercial cost prohibition outlined in Section VG.
- 12:46SPEAKER_00: QRA executives need to monitor this closely when their marketing
- 12:49SPEAKER_00: and commercial teams get involved in survey design.
- 12:52SPEAKER_00: When you are establishing the attributes,
- 12:54SPEAKER_00: the specific variables the patient will weigh against each other,
- 12:57SPEAKER_00: they must be framed neutrally,
- 12:59SPEAKER_00: and you absolutely must exclude any commercial cost variables.
- 13:04SPEAKER_00: You cannot ask a patient if they would accept a device with
- 13:06SPEAKER_00: a slightly higher failure rate if it saved them $500 out of pocket.
- 13:10SPEAKER_01: Yeah, marketing teams always try to sneak that in.
- 13:12SPEAKER_00: They do.
- 13:13SPEAKER_01: But the FDA's statutory authority is limited to evaluating clinical safety
- 13:18SPEAKER_01: and clinical efficacy.
- 13:20SPEAKER_01: They do not possess the statutory mandate to regulate pricing,
- 13:23SPEAKER_01: insurance reimbursement tiers, or hospital purchasing contracts.
- 13:27SPEAKER_01: Right.
- 13:27SPEAKER_01: Including a financial cost attribute in
- 13:30SPEAKER_01: a regulatory preference survey fundamentally corrupts the clinical risk model.
- 13:34SPEAKER_01: It introduces a non-clinical confounding variable.
- 13:37SPEAKER_01: If the FDA detects that financial costs influence the patient's risk tolerance in
- 13:41SPEAKER_01: the data, the study is invalidated for regulatory decision making.
- 13:45SPEAKER_00: Because it creates an artificial risk threshold.
- 13:48SPEAKER_00: A patient might accept a dangerous device simply
- 13:50SPEAKER_00: because they are economically disadvantaged,
- 13:53SPEAKER_00: which the FDA obviously cannot use as a justification for clinical safety.
- 13:56SPEAKER_01: Exactly.
- 13:57SPEAKER_00: So you have to eliminate the financial variables.
- 13:59SPEAKER_00: But communicating the actual clinical variables accurately brings up
- 14:03SPEAKER_00: a massive psychological hurdle.
- 14:06SPEAKER_00: Yeah, health numeracy refers to a patient's capacity to process,
- 14:08SPEAKER_00: interpret, and act on statistical risk information.
- 14:20SPEAKER_01: The general population struggles immensely with probability and statistics.
- 14:24SPEAKER_00: Oh, for sure.
- 14:25SPEAKER_01: The FDA recognizes this,
- 14:26SPEAKER_01: and the guidance is incredibly prescriptive about the formatting and presentation
- 14:30SPEAKER_01: of statistical risk to prevent sponsors from manipulating patient perception.
- 14:34SPEAKER_00: The banned practices read like a textbook on what medical device marketing teams do every day.
- 14:39SPEAKER_00: You are prohibited from using fractions.
- 14:41SPEAKER_00: You cannot use decimals because patient might see .02 and .2 and fail
- 14:46SPEAKER_00: to immediately grasp the magnitude of the difference.
- 14:49SPEAKER_00: You absolutely cannot use changing denominators.
- 14:52SPEAKER_00: You cannot say one in five patients experiences localized pain,
- 14:55SPEAKER_00: but three in 50 experience an infection.
- 14:58SPEAKER_01: That specific prohibition addresses denominator neglect.
- 15:02SPEAKER_01: When patients see 1 in 5 versus 20 in 100,
- 15:06SPEAKER_01: they often perceive 1 in 5 as a more significant threat because
- 15:09SPEAKER_01: the numerator represents a larger proportion of the stated denominator,
- 15:13SPEAKER_01: even though the absolute probability is identical.
- 15:16SPEAKER_00: Right.
- 15:16SPEAKER_00: It feels bigger.
- 15:17SPEAKER_01: Exactly.
- 15:18SPEAKER_01: To eliminate this cognitive distortion,
- 15:20SPEAKER_01: the FDA mandates the use of absolute frequencies with a consistent denominator,
- 15:25SPEAKER_01: such as 20 in 1,000.
- 15:27SPEAKER_00: They also ban purely verbal descriptions of risk.
- 15:30SPEAKER_00: You cannot label an attribute as having a high risk of revision or a low risk of revision.
- 15:35SPEAKER_01: Because verbal descriptions are entirely subjective anchors.
- 15:39SPEAKER_01: A patient who has endured five invasive surgeries might consider
- 15:42SPEAKER_01: a 20% revision rate low risk,
- 15:45SPEAKER_01: while a patient newly diagnosed with a condition might consider
- 15:48SPEAKER_01: a 5% risk catastrophically high.
- 15:51SPEAKER_01: The FDA requires the subjective feeling to be anchored to an objective absolute frequency.
- 15:57SPEAKER_01: Furthermore,
- 15:57SPEAKER_01: the guidance explicitly mandates the use of validated visual aids,
- 16:02SPEAKER_01: specifically 100% icon grids.
- 16:05SPEAKER_00: It's a very specific graphical representation.
- 16:08SPEAKER_00: You display an array of 100 small human figures,
- 16:12SPEAKER_00: all shaded in one color,
- 16:13SPEAKER_00: with two figures shaded in a contrasting color to visually represent a 2% risk.
- 16:18SPEAKER_01: Yeah, it's very clear.
- 16:19SPEAKER_00: Yes, you have to present the whole picture.
- 16:21SPEAKER_00: But looking at this from an executive strategy level,
- 16:23SPEAKER_00: I have a fundamental question about the cognitive science here.
- 16:25SPEAKER_00: Okay, let's hear it.
- 16:43SPEAKER_00: We know human beings are not supercomputers.
- 16:45SPEAKER_00: Even if you meticulously design a 100% icon grid and use absolute frequencies,
- 16:51SPEAKER_00: a patient reviewing a complex discrete choice experiment is naturally going
- 16:55SPEAKER_00: to suffer from cognitive fatigue.
- 16:56SPEAKER_00: Oh absolutely.
- 16:57SPEAKER_01: They're going to mentally recode those precise statistical grids back
- 17:01SPEAKER_01: into heuristic buckets of low, medium, and high just to get through the survey.
- 17:07SPEAKER_01: It cares how the human brain simplifies complex data.
- 17:10SPEAKER_01: If the patient is ultimately going to use a heuristic shortcut anyway,
- 17:14SPEAKER_01: why is the FDA so originally obsessed with the exact graphical formatting
- 17:18SPEAKER_01: of these grids?
- 17:20SPEAKER_00: Well, the FDA is fully aware of heuristic recoding.
- 17:22SPEAKER_00: In fact, the statisticians at CDRH actively hunt for it in your data.
- 17:27SPEAKER_00: The FDA relies on formal statistical tests within the survey structure itself
- 17:32SPEAKER_00: to detect this exact behavior.
- 17:34SPEAKER_00: One common heuristic is lexicographic behavior.
- 17:36SPEAKER_01: Lexicographic behavior.
- 17:37SPEAKER_00: Yeah, where a respondent becomes overwhelmed by the complexity of the choice task
- 17:41SPEAKER_00: and simply focuses on a single dominant attribute,
- 17:44SPEAKER_00: say, the risk of infection, ignoring all other variables entirely.
- 17:47SPEAKER_01: Ah, I see.
- 17:48SPEAKER_00: If a Siri is poorly designed or lacks visual clarity,
- 17:51SPEAKER_00: it exacerbates this cognitive fatigue and encourages extreme heuristic recoding,
- 17:55SPEAKER_00: which completely flattens the nuance of the utility curve.
- 17:58SPEAKER_01: The visual grids are designed to enforce a minimum cognitive load.
- 18:03SPEAKER_01: They force the patient's brain to repeatedly confront the objective,
- 18:07SPEAKER_01: proportional reality of the math.
- 18:10SPEAKER_01: During the analysis phase, statisticians use consistency checks and holdout tasks.
- 18:15SPEAKER_01: So, presenting the same choice in a different format later in the survey to measure
- 18:20SPEAKER_01: the rate of heuristic use.
- 18:21SPEAKER_00: That's clever.
- 18:22SPEAKER_01: It is.
- 18:23SPEAKER_01: If the grids and tutorials were effective,
- 18:25SPEAKER_01: the patient's choices will demonstrate a consistent,
- 18:28SPEAKER_01: nuanced weighting of all attributes.
- 18:31SPEAKER_01: The FDA demands these specific visual formats because they mathematically reduce
- 18:36SPEAKER_01: the noise of cognitive fatigue,
- 18:38SPEAKER_01: ensuring the resulting utility curve reflects a genuine clinical threshold rather
- 18:42SPEAKER_01: than a stressed patient's gut reaction.
- 18:44SPEAKER_00: So the formatting is essentially a required That makes complete sense.
- 18:51SPEAKER_00: But that brings us to the operational reality.
- 18:53SPEAKER_00: You can spend $2 million contracting a health economics firm to build
- 18:57SPEAKER_00: the most robust,
- 18:58SPEAKER_00: visually compliant, mathematically perfect discrete choice experiment in the world.
- 19:03SPEAKER_00: But if you field that survey and then hand the final report to the FDA,
- 19:08SPEAKER_00: they will likely dismiss it entirely if they didn't agree to
- 19:11SPEAKER_00: the foundational parameters first.
- 19:12SPEAKER_01: Oh, executing a PPI study in a silo is a fatal strategic error.
- 19:18SPEAKER_01: The Q submission program is the operational battleground where the success
- 19:21SPEAKER_01: or failure of a patient preference study is determined.
- 19:24SPEAKER_01: A sponsor must submit their proposed methodology,
- 19:27SPEAKER_01: specifically their attribute tables,
- 19:29SPEAKER_01: to the FDA for formal alignment well before a single patient is tested.
- 19:33SPEAKER_00: And the attribute table is the structural skeleton of the survey.
- 19:37SPEAKER_00: It maps the patient-facing clinical labels to
- 19:39SPEAKER_00: the actual statistical ranges you expect to see in your forthcoming clinical trial.
- 19:44SPEAKER_00: If your engineering and clinical teams project that your novel device might carry
- 19:48SPEAKER_00: a 10 to 15 percent localized infection rate,
- 19:51SPEAKER_00: your attribute table must test patient tolerance across that spectrum
- 19:55SPEAKER_00: and ideally push slightly beyond it, perhaps testing up to 20 or 25 percent.
- 20:00SPEAKER_01: Right.
- 20:00SPEAKER_01: Right.
- 20:00SPEAKER_01: Right.
- 20:26SPEAKER_01: The FDA will reject the inferred data because preference curves are rarely linear.
- 20:32SPEAKER_01: A patient's risk tolerance might cliff drop at 16%.
- 20:36SPEAKER_00: Let's evaluate the risk management aspect of this.
- 20:38SPEAKER_00: We are sitting in a Q-sub meeting, locking in this attribute table.
- 20:42SPEAKER_00: We use the Q-sub to call our shot in advance, much like playing billiards.
- 20:47SPEAKER_00: You have to declare exactly which pocket you're aiming for.
- 20:49SPEAKER_00: You cannot wildly strike the Q-ball,
- 20:51SPEAKER_00: sink the 8-ball off three cushions by accident,
- 20:54SPEAKER_00: and claim it was your intended strategy.
- 20:56SPEAKER_00: You must declare the analytical intent.
- 20:58SPEAKER_01: That's a great analogy.
- 20:59SPEAKER_00: But what happens if the clinical reality diverges from our Q-sub projection?
- 21:04SPEAKER_00: Let's say our regulatory team aligns with the FDA to test a revision rate up to 20%.
- 21:09SPEAKER_00: We execute the survey and the utility curve clearly shows patients will accept a 20% risk.
- 21:15SPEAKER_00: We then run our multi-year pivotal trial and the final data shows
- 21:19SPEAKER_00: an actual revision rate of 22%.
- 21:20SPEAKER_00: Uh-oh.
- 21:21SPEAKER_00: That exact scenario is the nightmare keeping QRA directors awake.
- 21:37SPEAKER_01: That's brutal.
- 21:37SPEAKER_01: That's brutal.
- 22:04SPEAKER_01: Or in the worst case scenario, start the preference study over entirely.
- 22:07SPEAKER_00: Wow.
- 22:08SPEAKER_01: So the strategic imperative during the Q-sub is to establish
- 22:11SPEAKER_01: a maximum acceptable risk,
- 22:13SPEAKER_01: a MAR, that stretches comfortably beyond your worst case clinical projections.
- 22:18SPEAKER_01: Of course.
- 22:18SPEAKER_01: Right.
- 22:39SPEAKER_01: The Q-sub negotiation is a delicate balancing act between securing a wide safety net
- 22:44SPEAKER_01: for your clinical trial and maintaining the clinical realism of
- 22:48SPEAKER_01: the survey instrument.
- 22:49SPEAKER_00: That requires deep alignment between the clinical trial designers,
- 22:52SPEAKER_00: the regulatory strategists,
- 22:54SPEAKER_00: and the health economists before you ever speak to the agency.
- 22:56SPEAKER_00: Absolutely.
- 22:57SPEAKER_00: Another critical element of the Q-sub alignment is
- 23:00SPEAKER_00: the pre-specified statistical analysis plan in the SAP.
- 23:03SPEAKER_01: Yeah, the 2026 guidance places a heavy emphasis on the SAP to prevent data dredging,
- 23:08SPEAKER_01: or p-hacking.
- 23:09SPEAKER_01: You cannot run a preference survey,
- 23:11SPEAKER_01: dump the raw data into an analytical software package,
- 23:14SPEAKER_01: and then continuously slice and re-slice the patient demographics
- 23:17SPEAKER_01: until you magically discover a sub-hot.
- 23:18SPEAKER_01: Because if you fail to pre-specify the SAP,
- 23:21SPEAKER_01: the FDA will view any favorable subpopulation analysis as highly exploratory
- 23:24SPEAKER_00: and likely biased by the sponsor's desire to find a path to approval.
- 23:49SPEAKER_01: Speaking of subgroups and specific populations,
- 23:51SPEAKER_01: the guidance also clarifies the pathway for utilizing outside U.S.
- 23:54SPEAKER_01: or OUS preference data under 21 CFR A12.28.
- 23:59SPEAKER_00: For global medtech organizations running decentralized
- 24:02SPEAKER_00: or international clinical trials, this is a massive operational factor.
- 24:07SPEAKER_00: The FDA has stated they will accept OUS preference data, but the regulatory burn of proof...
- 24:13SPEAKER_00: Shifts heavily onto the sponsor.
- 24:15SPEAKER_00: You have to definitively prove cultural and health system applicability.
- 24:19SPEAKER_01: Yes.
- 24:19SPEAKER_01: The underlying mechanism here is that risk tolerance is intimately tied
- 24:24SPEAKER_01: to socioeconomic context.
- 24:26SPEAKER_00: Right.
- 24:26SPEAKER_01: A patient residing in a European country with
- 24:29SPEAKER_01: a robust nationalized social safety net,
- 24:32SPEAKER_01: comprehensive disability coverage,
- 24:34SPEAKER_01: and zero out-of-pocket health care costs might evaluate the risk of
- 24:38SPEAKER_01: a severe adverse event entirely differently than a patient in the United States.
- 24:42SPEAKER_00: That makes total sense.
- 24:43SPEAKER_01: Furthermore, the baseline standard of care might vary significantly between regions.
- 24:47SPEAKER_01: If a QRA leader submits a discrete-choice experiment connected entirely
- 24:51SPEAKER_01: with patients in Germany,
- 24:52SPEAKER_01: they must provide a formal,
- 24:54SPEAKER_01: evidence-based justification detailing why the German standard of care
- 24:57SPEAKER_01: and risk tolerance profile directly translates to the specific patient population
- 25:01SPEAKER_01: in Ohio or Texas.
- 25:02SPEAKER_00: And if they don't buy it.
- 25:03SPEAKER_01: If the FDA deterrents the socioeconomic variables confound the risk profile,
- 25:08SPEAKER_01: they will disregard the OUS data.
- 25:11SPEAKER_00: The strategy clearly requires rigorous upfront planning.
- 25:14SPEAKER_00: But the value of a meticulously executed PPI study extends far beyond the moment
- 25:19SPEAKER_00: the FDA hands over the PMA or 510k clearance.
- 25:23SPEAKER_00: The guidance details how this data impacts the device across the entire total product lifecycle.
- 25:29SPEAKER_00: Moving into the post-market phase,
- 25:30SPEAKER_00: one of the most aggressive and highly strategic applications of PPI is deploying it
- 25:35SPEAKER_00: as a post-market compliance and enforcement shield.
- 25:38SPEAKER_01: This represents a fascinating evolution in FDA enforcement discretion.
- 25:42SPEAKER_01: The guidance explicitly reveals how robust patient preference information influences
- 25:46SPEAKER_01: the agency's decisions regarding administrative actions,
- 25:49SPEAKER_01: enforcement protocols, and compliance crackdowns.
- 25:51SPEAKER_00: Okay, lay this out for us.
- 25:52SPEAKER_01: Consider a scenario where a device has been on the market for three years and
- 25:55SPEAKER_01: a post-market surveillance signal identifies that
- 25:58SPEAKER_01: the device is technically not conforming to a specific performance standard.
- 26:02SPEAKER_00: Historically,
- 26:03SPEAKER_00: a technical nonconformance almost automatically triggers a recall,
- 26:07SPEAKER_00: a cessation of distribution, or a warning letter.
- 26:10SPEAKER_00: The regulatory reflex is to pull the product.
- 26:13SPEAKER_01: Wow.
- 26:34SPEAKER_01: It provides the FDA with the mathematical cover they need to keep a non-conforming
- 26:38SPEAKER_01: but critical device in the hands of physicians.
- 26:40SPEAKER_01: But there is a massive operational tradeoff.
- 26:58SPEAKER_00: If you win pre-market approval or
- 27:00SPEAKER_00: if you secure post-market enforcement discretion based heavily on preference data,
- 27:04SPEAKER_00: the FDA will almost certainly mandate strict conditions
- 27:07SPEAKER_00: of approval regarding product labeling.
- 27:09SPEAKER_01: Yeah, the data cannot live exclusively in a regulatory filing cabinet.
- 27:13SPEAKER_01: The FDA requires the sponsor to translate the complex beta coefficients
- 27:18SPEAKER_01: and utility curves of the discrete choice model into plain language,
- 27:22SPEAKER_01: patient-facing documents known as shared decision-making tools.
- 27:27SPEAKER_00: These tools function as informed consent forms on a completely different operational level.
- 27:32SPEAKER_01: Oh, they are highly structured clinical documents.
- 27:35SPEAKER_01: The guidance stipulates that physicians must physically walk through these tools
- 27:39SPEAKER_01: with the individual patient in the examination room before the device is prescribed
- 27:43SPEAKER_01: or implanted.
- 27:43SPEAKER_01: Right.
- 27:44SPEAKER_01: The objective is to verify that the specific patient sitting on
- 27:47SPEAKER_01: the exam table genuinely shares the exact risk tolerance profile of
- 27:51SPEAKER_01: the mathematical model that justified the device's approval in the first place.
- 27:55SPEAKER_01: That ensures the macro-level statistical model accurately maps
- 27:57SPEAKER_01: the micro-level clinical reality of the individual.
- 27:59SPEAKER_01: But I want to scrutinize the boundaries of this enforcement shield concept
- 28:02SPEAKER_01: because there is a very dangerous extrapolation a QRA team could make here.
- 28:06SPEAKER_00: Okay.
- 28:22SPEAKER_00: If a company gets hit with a devastating 483 observation or a warning letter for
- 28:27SPEAKER_00: a blatant systemic manufacturing defect,
- 28:30SPEAKER_00: let's say they have a massive sterile barrier failure on the packaging line,
- 28:34SPEAKER_00: or their software engineering is completely undocumented and riddled
- 28:37SPEAKER_00: with catastrophic bugs,
- 28:39SPEAKER_00: they cannot simply slide a utility curve across the table and argue, yes,
- 28:43SPEAKER_00: our quality system is a disaster,
- 28:45SPEAKER_00: but the patients are desperate, so you must let us keep selling it.
- 28:49SPEAKER_00: There has to be a hard statutory limit to preference data.
- 28:52SPEAKER_01: Oh, absolutely.
- 28:53SPEAKER_01: There is an absolute limit.
- 28:54SPEAKER_01: And the FDA aggressively defines it in Section IXE of the guidance,
- 28:58SPEAKER_01: which covers the hard safety limits.
- 28:59SPEAKER_00: Okay, good.
- 29:00SPEAKER_01: PPI is a highly sophisticated regulatory lever.
- 29:03SPEAKER_01: It evaluates and quantifies clinical risk tolerance.
- 29:06SPEAKER_01: Makes sense.
- 29:34SPEAKER_01: The FDA draws a very sharp,
- 29:35SPEAKER_01: impenetrable boundary between a patient mathematically accepting
- 29:39SPEAKER_01: the inherent unavoidable clinical risks of a novel,
- 29:41SPEAKER_01: life-saving therapy versus a manufacturer failing
- 29:44SPEAKER_01: to execute basic quality assurance.
- 29:46SPEAKER_01: If your sterile barrier is failing,
- 29:48SPEAKER_01: no amount of patient preference data will prevent a mandatory recall.
- 29:51SPEAKER_00: That distinction protects the structural integrity of the entire regulatory framework.
- 29:56SPEAKER_00: It allows for flexibility and clinical risk without compromising
- 29:59SPEAKER_00: the baseline standards of manufacturing quality.
- 30:03SPEAKER_00: So as we synthesize this blueprint for the quality
- 30:06SPEAKER_00: and regulatory VPs listening today, the core takeaway is absolute.
- 30:10SPEAKER_00: Patient preference is no longer a soft qualitative afterthought.
- 30:14SPEAKER_01: No, it's not.
- 30:15SPEAKER_00: It is not anecdotal evidence relegated to marketing brochures or focus groups.
- 30:20SPEAKER_01: It has been elevated to quantitative,
- 30:22SPEAKER_01: valid scientific evidence governed by strict statistical rules.
- 30:26SPEAKER_00: When executed correctly,
- 30:28SPEAKER_00: adhering strictly to the Section V design rules and leveraging the QSub process
- 30:32SPEAKER_00: to lock in the SAP and attribute tables,
- 30:34SPEAKER_00: PPI can rescue borderline pivotal trials like the AlphaPunk.
- 30:38SPEAKER_01: Which leaves us with a final highly strategic concept to consider,
- 30:41SPEAKER_01: drawn directly from the pure global regulatory analysis.
- 30:45SPEAKER_01: Pure Global noted a critical alignment.
- 30:48SPEAKER_01: This 2026 FDA guidance aligns conceptually with the foundational principles of
- 30:52SPEAKER_01: the European Union medical device regulation and in vitro diagnostic regulation,
- 30:57SPEAKER_01: specifically regarding post-market clinical follow-up, or PMCF.
- 31:01SPEAKER_00: The international implications there are massive.
- 31:03SPEAKER_01: Consider the long-term global strategy.
- 31:06SPEAKER_01: If a U.S.-based regulatory team successfully utilizes
- 31:09SPEAKER_01: a complex discrete-choice experiment to mathematically justify a 20% revision rate
- 31:13SPEAKER_01: to the FDA and secures a PMA based on that utility curve,
- 31:17SPEAKER_01: how will the notified bodies in Europe react to that exact same math?
- 31:21SPEAKER_00: That's the million-dollar question.
- 31:22SPEAKER_01: Could this FDA guidance effectively become a global regulatory Trojan horse,
- 31:26SPEAKER_01: standardizing the mathematical proof of risk tolerance across international borders?
- 31:42SPEAKER_00: That is a strategic avenue every VP should be actively mapping out
- 31:45SPEAKER_00: with their global regulatory teams.
- 31:47SPEAKER_00: It highlights the profound evolution of this field.
- 31:49SPEAKER_00: We began this deep dive discussing rigid safety thresholds and objective lines in the sand.
- 31:54SPEAKER_00: But as the 2026 guidance proves,
- 31:57SPEAKER_00: when you apply rigorous statistical modeling to the messy,
- 32:00SPEAKER_00: subjective reality of human suffering and preference,
- 32:03SPEAKER_00: the regulatory landscape doesn't become murkier.
- 32:05SPEAKER_00: It actually becomes more precise.
- 32:06SPEAKER_00: It just demands an entirely new level of executive navigation.