Latest / This Is Why with Dr. Busti / Regression Analysis Explained: Confounders & Clinical Meaning
Transcript
- 0:00SPEAKER_00: Well, welcome to this lecture where I'm going to be covering the very basics of regression analysis.
- 0:06SPEAKER_00: And this is part of our series on summary statistics, specifically in the area of inferential statistics.
- 0:13SPEAKER_00: Hey guys, I'm Dr.
- 0:14SPEAKER_00: Bustaye, your faculty and host on This Is Why, a show that helps healthcare professionals transform their medical knowledge from what to why.
- 0:23SPEAKER_00: Because when you know why you do what you do in the proper context of the evidence, it changes the how.
- 0:30SPEAKER_00: And that changes everything about how we approach everyday decisions and the patients that are depending on us.
- 0:37SPEAKER_00: Okay.
- 0:38SPEAKER_00: In this particular topic, if you need a full access to the playlist and all the topics that go around it in the area of descriptive and inferential statistics, okay, check out that summary statistics playlist andor collection over on YouTube or over at the website thisiswhy.
- 0:59SPEAKER_00: Okay.
- 1:00SPEAKER_00: This stuff is relevant not only for board exams, but for those of you learning andor developing clinic uh clinical research protocols that are going to go through the IRB.
- 1:09SPEAKER_00: You want to set it up right at the beginning, right?
- 1:12SPEAKER_00: Especially if you're going for funding.
- 1:14SPEAKER_00: But you also need this for real-world practice if you're reading papers.
- 1:18SPEAKER_00: Okay.
- 1:20SPEAKER_00: Now, this particular topic follows other inferential statistics, things like p-value, the effect sides, that's like odds ratios, risk ratio, relative risk, hazards ratios, and those things.
- 1:31SPEAKER_00: And again, those are in that overall series.
- 1:34SPEAKER_00: So I'm just trying to help you stay oriented.
- 1:37SPEAKER_00: So as we go through the topics, we're in the biostatistics series, and there's three parts.
- 1:42SPEAKER_00: Okay.
- 1:43SPEAKER_00: Part one is before the study starts, that statistical analysis plan.
- 1:47SPEAKER_00: Part two is the part that happens when you get the completion of the study.
- 1:51SPEAKER_00: And then part three is really a separate discussion on its own.
- 1:56SPEAKER_00: But when we talk about evaluation of studies, uh, it has to do with diagnostic tests.
- 2:01SPEAKER_00: All right, so remember, before the study starts, so if you're in that research development stage and this topic is applicable to you, right?
- 2:11SPEAKER_00: That's when you're doing the statistical analysis plan.
- 2:14SPEAKER_00: You're coming up with your hypothesis.
- 2:16SPEAKER_00: You're establishing what type of data is it nominal, ordinal, continuous?
- 2:20SPEAKER_00: What type of study groups do you have?
- 2:22SPEAKER_00: Are you going to use parametric, non-parametric statistical analysis?
- 2:26SPEAKER_00: And then do you need to do an alpha uh analysis and to set that and do a power analysis to determine your sample size?
- 2:33SPEAKER_00: Whereas part two, which is where we're at, again, just to keep you oriented, there's descriptive statistics that describe our data that we collected, how it is interacts with each other, how far away from it it is, what kind of data does it generate, mean, median, modes, those kind of things, right?
- 2:51SPEAKER_00: Interquartile ranges and things like that.
- 2:54SPEAKER_00: And then there's that inferential statistics.
- 2:56SPEAKER_00: And we're on this topic regression analysis, where we really start to think about how variables and confounders that exist in patients are interacting and influencing one another.
- 3:13SPEAKER_00: Okay.
- 3:14SPEAKER_00: Now, um, so when we start thinking about that in regression analysis, we need to think about the application.
- 3:22SPEAKER_00: Okay, as a clinician or as a researcher, the so what who cares?
- 3:27SPEAKER_00: So let's take, for example, a scenario like we have a 55-year-old patient with known chest pain, okay, and you you say, okay, well, what factors independently are going to predict the risk of myocardial infarction?
- 3:44SPEAKER_00: And how do we adjust then for going to look at other variables?
- 3:49SPEAKER_00: How do we adjust for things that we know can influence and are associated with that outcome?
- 3:56SPEAKER_00: Things like age, smoking, diabetes, and the list goes on, right?
- 4:01SPEAKER_00: You can do BMIs, waist circumference, things like that.
- 4:04SPEAKER_00: All of those things start to interact with each other because when you do a study and at the end of it you get a result, what you're hoping to be able to help the clinician, right?
- 4:17SPEAKER_00: Bringing new information to the front lines is this intervention that we were looking at the result of the outcome?
- 4:28SPEAKER_00: Or were there other things that could be influencing that outcome?
- 4:33SPEAKER_00: And did we control for them?
- 4:35SPEAKER_00: And do we even know what they are?
- 4:37SPEAKER_00: They also help us when we're thinking about risk stratification tools.
- 4:42SPEAKER_00: We think about those patients who have risk factors for a disease.
- 4:46SPEAKER_00: All of these things become important in developing risk calculators, guideline committees use them for establishing recommendations.
- 4:55SPEAKER_00: Okay.
- 4:56SPEAKER_00: And almost every observational study that you read will do that.
- 5:00SPEAKER_00: For example, things like the Framingham, ASVC, uh ASCVD scores, things like, and confounders adjustments that are occurred in those observational studies.
- 5:13SPEAKER_00: That's how we developed those tools.
- 5:16SPEAKER_00: Without them, we would not be able to stratify and understand those risk factors that play the predominant role on that outcome that we're worried about.
- 5:26SPEAKER_00: And so when you think about regression analysis, it's a mathematical model, an equation that predicts the influence of one variable, an association, on another variable, especially as it changes potentially.
- 5:40SPEAKER_00: All right?
- 5:40SPEAKER_00: And you're gonna hear from me a lot of words that sound a little confusing.
- 5:47SPEAKER_00: I'm just gonna say that up front.
- 5:50SPEAKER_00: It's difficult to sometimes, if you don't do this on a regular basis, or if you're not a biostatistician, which I'm not, and other people are not, while I've had training in evidence-based healthcare, doesn't mean I know everything, but it can be confusing the terminology.
- 6:07SPEAKER_00: You're gonna hear things like linear regression or simple regressions analysis, multiple regression, multivariable logistic regression analysis, things like that, those words start to run together.
- 6:24SPEAKER_00: But what we're really trying to figure out here is we're trying to provide a mathematical model and sort of an objective indicator of a what degree of statistical control can we have on a confounder.
- 6:41SPEAKER_00: Helps us to isolate those independent effects of a predictor while also holding other variables in the background constant because they exist.
- 6:54SPEAKER_00: And we remember, even thinking about baseline characteristics on a clinical trial, you randomize people and you write up these tables and you describe them.
- 7:02SPEAKER_00: And why are we doing that?
- 7:04SPEAKER_00: Because we're trying to show people, the reader, that we considered these variables about the patient.
- 7:13SPEAKER_00: And here's what they look like between the groups.
- 7:16SPEAKER_00: Now, this is where things like wordings of terminology like associations, correlations, predictability start to get also again fuzzy.
- 7:26SPEAKER_00: So if you think about the differences between correlation and regression, correlation is measuring the association only, whereas regression is looking at the association as well, but it provides a model for direction, the magnitude, and it helps in the prediction while also controlling for other variables.
- 7:49SPEAKER_00: And that is the difference between just doing a correlation analysis, which I discuss in another lecture.
- 7:57SPEAKER_00: If you need to go and review that, okay.
- 8:02SPEAKER_00: Regression analysis is providing an additional perspective while holding other variables accountable.
- 8:10SPEAKER_00: Okay, so now this is where we start to dive in first to the linear regression.
- 8:17SPEAKER_00: Okay, there is simple and then there's multiple linear regression.
- 8:23SPEAKER_00: Okay, those are two separate things, and I'll cover multiple here in a minute.
- 8:28SPEAKER_00: It's also different from multivariable logistic regression analysis.
- 8:36SPEAKER_00: It's how we hold the variables and the endpoints and how we look at the data and the angles that we're doing.
- 8:44SPEAKER_00: That's what makes them different.
- 8:45SPEAKER_00: And so I just try to help us all stay on the same page, especially if this is the first time you've interacted with this topic, okay, and you're trying to learn it or figure out how it applies to your potential paper, or if you're reading a study and you're trying to understand what they did.
- 9:07SPEAKER_00: Okay.
- 9:08SPEAKER_00: So simple linear, okay, that's about one independent variable and its influence on a continuous dependent variable, all right?
- 9:21SPEAKER_00: And so you get this, you can create a line, right?
- 9:24SPEAKER_00: And there's an equation for this that I'll show you here in a minute.
- 9:28SPEAKER_00: We're not going to spend a lot of time.
- 9:29SPEAKER_00: I'm not going to do any math here, not going to try to overwhelm you, but I'm going to show you the equation for those of you that are interested in that.
- 9:36SPEAKER_00: But an example is does the age of the patient predict the systolic blood pressure?
- 9:44SPEAKER_00: Now think about systolic blood pressure is a continuous data endpoint.
- 9:49SPEAKER_00: Continuous being it can go on to infinity, and the magnitude of difference between each level of the blood pressure is the same.
- 9:58SPEAKER_00: Again, I do a lecture on the type of data and how you treat it.
- 10:03SPEAKER_00: Is it nominal, ordinal, or continuous?
- 10:05SPEAKER_00: So if you don't understand the word continuous dependent variable, and in the context of systolic blood pressure, you should pause and go watch the lecture that I do on the type of data that we're dealing with.
- 10:22SPEAKER_00: Okay, and that's also the end point of a study.
- 10:24SPEAKER_00: It's not just applicable to regression analysis.
- 10:27SPEAKER_00: Okay.
- 10:29SPEAKER_00: So that's an example.
- 10:30SPEAKER_00: Independent variable associated in its impact on in its relationship with a dependent continuous variable.
- 10:38SPEAKER_00: Multiple linear regression obviously is beyond just simple.
- 10:44SPEAKER_00: So there's multiple variables, right?
- 10:47SPEAKER_00: So you have a relationship between greater than one independent variable and one continuous variable.
- 10:54SPEAKER_00: And again, looking at that, going back and building on the age and blood pressure example.
- 11:01SPEAKER_00: Does the patient's age predict the systolic blood pressure after adjusting for their BMI, smoking, and exercise status and behaviors?
- 11:15SPEAKER_00: You see where the multiple is now being integrated, and you're trying to look at the impact and control for things and try to understand the influence of the association of one variable's impact on another, especially when they're changing.
- 11:32SPEAKER_00: And so, for example, if you want to think about how would I apply this, what would it look like in real-world clinical practice when you, and this is an example, of course, it's not from some you know real day.
- 11:45SPEAKER_00: I'm just showing you what it feels like, what it looks like.
- 11:49SPEAKER_00: And that would be for every one year increase in the age of the patient, the systolic blood pressure increases by X amount of millimeters of mercury pressure while holding other variables constant.
- 12:06SPEAKER_00: Like we know they're there, but we're gonna hold them constant because we want to understand the impact of age.
- 12:12SPEAKER_00: And we know that's true, isn't it?
- 12:15SPEAKER_00: As we age, our blood pressure increases.
- 12:18SPEAKER_00: Why?
- 12:18SPEAKER_00: Because the vascularity of the system builds up plaques, it gets hardened, it becomes less compliant, less elastic.
- 12:28SPEAKER_00: And so the pressures that have to be generated to keep forward flow have to go up.
- 12:33SPEAKER_00: And so when you look at patients in their 20s and 30s, they look different than in their 50s, 60s, and 70s as it relates to who has hypertension and how many meds are you on.
- 12:46SPEAKER_00: So that statement makes sense to us, but we get that understanding because of things like this, and we can quantify it, we can measure it out mathematically, and that's where this formula really comes in, okay?
- 13:04SPEAKER_00: And you fill in these components and you look, and we'll talk about error and again a little bit when we talk about residuals and things like that, but you want to understand and be aware of these formulas, not so much that I'm gonna again spend time doing it.
- 13:21SPEAKER_00: Now, there's mnemonics that can guide us to understanding, especially when you're reading a paper where linear regression results are being presented.
- 13:32SPEAKER_00: You you want to know as a reader, is it are they trustworthy?
- 13:37SPEAKER_00: As a writer, author, researcher, you want to make sure you address things, especially if you're gonna try to get it published.
- 13:47SPEAKER_00: Hopefully, a a good peer review peer reviewer will apply these principles and ask these questions and look for these things.
- 13:56SPEAKER_00: But a good clinician who understands this and is trying to build maybe something else needs to understand what some of these things mean.
- 14:03SPEAKER_00: So when we think about there's a mnemonic called line, L-I-N-E, and it and it works for linear regressions, both simple and then multiple, as some things that you also can add on and assumptions.
- 14:18SPEAKER_00: But linear linearity, right, that's the relationship in a straight line.
- 14:23SPEAKER_00: So remember earlier you saw the X and the Y and the variables, independent variable and a continuous dependent variable.
- 14:31SPEAKER_00: We talked about that.
- 14:33SPEAKER_00: And that's the true average of change in y being constant per unit change in X.
- 14:41SPEAKER_00: And I gave you kind of an example, and that's a kind of a check scatter plot look.
- 14:46SPEAKER_00: That there's independence of observations.
- 14:50SPEAKER_00: Okay, so each data point is unique.
- 14:54SPEAKER_00: There's no clustering, there's no repeated measures on the same patient.
- 14:58SPEAKER_00: Okay.
- 14:59SPEAKER_00: Now, when we start to think about, especially multiple uh linear regression, this is the normality of the residuals, okay, not the raw variables themselves.
- 15:11SPEAKER_00: And this is really about errors, the interval between the space and result from the observed raw variables from the predicted models, okay?
- 15:23SPEAKER_00: And if it should follow a Bell curve around zero, not the raw data, but the errors, okay.
- 15:31SPEAKER_00: And then there's something called for E, L-I-N-E, equal or constant variance of the residuals.
- 15:40SPEAKER_00: Okay.
- 15:42SPEAKER_00: Now, when you have multicollinearity, okay, these are when predictors are not highly correlated to one another.
- 15:50SPEAKER_00: Okay, you want this variable inflation factor or VIF to be low.
- 15:57SPEAKER_00: Okay, we do not want it to be high.
- 16:00SPEAKER_00: And so low, and they should kind of guide you to that, especially when they're really trying to define these variables, that that's what their VIF is, less you usually less than 5 to 10, especially important in that multiple linear regression analysis.
- 16:17SPEAKER_00: And the spread of those residuals should be roughly the same no matter what the predictor value is.
- 16:23SPEAKER_00: Okay, so there's no funnel, there's no cone shaped in the residual plot.
- 16:28SPEAKER_00: Okay.
- 16:29SPEAKER_00: Now, context of line, the mnemonic L-I-N-E, okay, assumes things that the linear regression follows in ordinary least squares, OLS.
- 16:42SPEAKER_00: Okay, so it's both simple, that applies for both simple and multiple.
- 16:48SPEAKER_00: Whereas multivariable regression analysis, which we're starting to transition to here, uses maximum likelihood estimations, not the OLS.
- 17:00SPEAKER_00: Okay, it doesn't require the normality of the residuals.
- 17:05SPEAKER_00: Okay.
- 17:06SPEAKER_00: Um, instead, logistical analysis has its own set of core assumptions.
- 17:14SPEAKER_00: All right.
- 17:15SPEAKER_00: So that that was primarily obviously linear, simple and multiple linear regression.
- 17:22SPEAKER_00: Uh, I'm not gonna say it's straightforward and crystal clear, easy.
- 17:27SPEAKER_00: It's not.
- 17:28SPEAKER_00: You have to dive into this stuff and apply it, see it used.
- 17:33SPEAKER_00: But again, going back, we're trying to think of the big picture.
- 17:37SPEAKER_00: What are these confounders, background variables doing to influence each other at some level?
- 17:44SPEAKER_00: What is the association of the change in one variable and its impact on another?
- 17:48SPEAKER_00: So when we think about multivariable logistic regression, this is when we use, and the outcome, the endpoint, is binary.
- 17:59SPEAKER_00: Think of nominal data, yes or no.
- 18:02SPEAKER_00: An event happened or it did not.
- 18:06SPEAKER_00: Okay.
- 18:07SPEAKER_00: Now the goal here is to identify when variables independently predict the probability of that outcome.
- 18:16SPEAKER_00: Okay, and a reason that a variable may not remain significant is that there's no true relationship, or that it's highly correlated with another variable already in that model, and that's that multicollinearity.
- 18:36SPEAKER_00: Okay.
- 18:36SPEAKER_00: We don't remember, we don't want that to be typically that VIF variable inflation factor to be high.
- 18:45SPEAKER_00: Insufficient statistical power.
- 18:47SPEAKER_00: And so when we think about what does it look like, because you're gonna see these in a lot of papers, it'll say the adjusted odds ratio of this example is 2.8, okay, and you see that 95% confidence interval is between 1.5 and 5.3, right?
- 19:11SPEAKER_00: So that you would say that there's about a three times greater odds or higher odds of an outcome after adjusting for confounders.
- 19:24SPEAKER_00: Okay, so that but the one of the key things in here is this addition of adjusted odds ratio.
- 19:33SPEAKER_00: Okay, and so that becomes very important.
- 19:35SPEAKER_00: Now we will use things because you'll see like survival analysis, which is a kind of a Cox proportional hazards regression.
- 19:44SPEAKER_00: Okay, this is a time to an event data versus a continuous linear and binary logistic, right?
- 19:53SPEAKER_00: So if the logistic regression answers, did the patient die?
- 19:59SPEAKER_00: Well, that's a yes or a no, isn't it?
- 20:02SPEAKER_00: And Cox regression says, yeah, did the patient die, but how long did it take for that to happen?
- 20:10SPEAKER_00: Okay, and that's where you see uh survival curves that are based on a time, time to a an event.
- 20:20SPEAKER_00: Okay, so it's another part of that regression.
- 20:24SPEAKER_00: So now as we start to close up on this conversation, there's a few pearls and pitfalls, some degrees of clinical relevance that I just want to make sure that we hit on.
- 20:36SPEAKER_00: The first is that regression shows us associations, not causation.
- 20:42SPEAKER_00: And it's really about how one variable changes when another one is also potentially changing.
- 20:49SPEAKER_00: What impact does it have?
- 20:51SPEAKER_00: Okay.
- 20:53SPEAKER_00: Multicollinearity, when you have two or more predictors that are highly correlated, that makes unstable estimates and a difficulty in isolating the individual effect of those variables.
- 21:08SPEAKER_00: Remember again, we want that VIF to be low.
- 21:12SPEAKER_00: Overfitting, you have too many predictors uh that are relative to events, and so you end up creating your the the researcher creates this poor ability to generalize it to new patients.
- 21:29SPEAKER_00: Okay?
- 21:31SPEAKER_00: So there's a balance because we need to apply data in the context of the patients that we all see every day.
- 21:40SPEAKER_00: You need also enough people.
- 21:42SPEAKER_00: So there's a sample size rule of thumb, if you will, for logistics.
- 21:47SPEAKER_00: You need 10 to 20 events, not patients per se, but events per predictor variable, so that you have enough to get that proper mathematical.
- 22:00SPEAKER_00: Objective evaluation.
- 22:01SPEAKER_00: Common misuse.
- 22:03SPEAKER_00: Treating adjusted OR, odds ratio, as a risk ratio when the outcome is common.
- 22:13SPEAKER_00: Okay.
- 22:15SPEAKER_00: People use again, this is where terminology gets a little wonky.
- 22:19SPEAKER_00: You gotta keep yourself oriented.
- 22:21SPEAKER_00: And then there's the real world impact.
- 22:24SPEAKER_00: Things that are used in scoring tools, prognostic models, observational studies that adjust for and control for confounders.
- 22:36SPEAKER_00: Okay.
- 22:37SPEAKER_00: Now remember, a confounder is just this variable.
- 22:40SPEAKER_00: You may want to again mathematically remove adjusting age when you're looking at coffee and heart disease.
- 22:48SPEAKER_00: So an effect modifier is a biological reality that you need to highlight.
- 22:56SPEAKER_00: A drug works wonderful in a female or woman, but poorly in a man.
- 23:00SPEAKER_00: So sex modifies the effect.
- 23:06SPEAKER_00: Next is when you see an adjusted odds ratio or eight uh hazards ratio in a paper, you need to ask, was it adjusted for properly?
- 23:14SPEAKER_00: What were the assumptions and were they checked?
- 23:18SPEAKER_00: Is the sample size adequate for the events?
- 23:23SPEAKER_00: Okay.
- 23:26SPEAKER_00: Regression is again predictability and control plus control of that confounder.
- 23:31SPEAKER_00: And you want to choose a model based on the outcome type, remember?
- 23:36SPEAKER_00: So this is where your orientation to your data and endpoints goes back to that type of data and understanding it.
- 23:44SPEAKER_00: So continuous, you do a linear, straight line, binary, logistic regression, right?
- 23:51SPEAKER_00: And that math is done to convert the straight line into probability between zero and one, and so you get this sigmoid effect.
- 24:01SPEAKER_00: Okay.
- 24:02SPEAKER_00: Lastly, is you always want to interpret in the clinical context and you check those assumptions.
- 24:08SPEAKER_00: And that's why those mnemonics and things like that are available to us to try to create that.
- 24:15SPEAKER_00: That's why we also have critical appraisal tools to systematically help us to walk through a paper and ask the right questions.
- 24:26SPEAKER_00: It's to help us to get to a meaningful endpoint.
- 24:28SPEAKER_00: So I I hope at some level the introduction of these terms, while may not be perfectly crystal clear to you, especially if you've never applied them or read about them, begins to lay that foundation along with the other topics in evidence-based medicine and biostatistical analysis.
- 24:47SPEAKER_00: It's not easy, it takes time.
- 24:50SPEAKER_00: I spent years reading, studying, trying to apply it myself.
- 24:55SPEAKER_00: And it just takes that time.
- 24:57SPEAKER_00: So don't give up.
- 24:58SPEAKER_00: You sometimes have to learn things in the context of the overall big picture, which is why we put together those collections and playlists on individual topic areas, and we do offer you a order to go through if you need that guidance.
- 25:15SPEAKER_00: Now, they individually stand as topics on their own, but sometimes people need the continuous discussion and orientation as we move through the topics because it's overwhelming to do it all at once, isn't it?
- 25:28SPEAKER_00: And so please check those over out on our YouTube channel, okay, or at thisiswhy.
- 25:34SPEAKER_00: But I'm Dr.
- 25:35SPEAKER_00: Bustaye, and I thank you so much for joining us and participating and investing in your knowledge.
- 25:39SPEAKER_00: I hope that you would subscribe if you're not already a subscriber.
- 25:43SPEAKER_00: Follow us, give us a like, provide a comment.
- 25:46SPEAKER_00: We that's how we learn from each other.
- 25:49SPEAKER_00: If there's a little pearl or thing that you can share with your friends and colleagues, let's do that.
- 25:54SPEAKER_00: Okay.
- 25:55SPEAKER_00: I know that I've benefited from those over the years, and others want to benefit from it as well.
- 26:00SPEAKER_00: So we'll see you next time.
- 26:01SPEAKER_00: Take care.