Latest / Professor Peterson’s Psychology Classroom / Behind the Numbers: Hypotheses, Errors, and What Statistics Really Tell Us
Transcript
- 0:05Welcome to Professor Peterson's Psychology Classroom,
- 0:09connecting the science of human behavior to everyday life.
- 0:13Here's Dr. Curtis Peterson.
- 0:17Quantitative methods, we have basically 2 kind
- 0:21of hypotheses that we usually state. Okay,
- 0:24and if you remember, we divided quantitative methods
- 0:28into descriptive methods and experimental methods.
- 0:33Descriptive methods are when
- 0:39we just want to describe data.
- 0:45Oops, one second.
- 0:52And/or we want to know the relationship between 2 given variables.
- 0:57Okay, and we want to see how they're related. When we're doing
- 1:01the experimental method, we're manipulating some
- 1:04variable to see if it causes an influence
- 1:08on another variable. The variable that we manipulate
- 1:13is called the independent variable. The variable that we
- 1:16measure to see if it's changed is the dependent variable.
- 1:25Whoops, whoops, let me go back.
- 1:33And we have 2 basic types of hypotheses.
- 1:36One of the interesting things that we do as scientists
- 1:41when we're using quantitative methods is we actually
- 1:45try to prove ourselves wrong.
- 1:49We try to prove what we think is going on is not correct.
- 1:52So The hypothesis
- 1:56that we really investigate is what's called the null hypothesis.
- 2:01And in the null hypothesis, what we're saying is that there's no association
- 2:06between variables. Okay, so let's give a basic
- 2:10research descriptive example. If I want to study whether or not study
- 2:14time influences grades, so as a person,
- 2:18the amount of time someone studies goes up the higher their
- 2:22grade is. My null hypothesis would
- 2:26be that there is no association between the amount of time
- 2:30we study and the grade on an exam or a
- 2:34grade in the class. The alternative
- 2:38hypothesis is the hypothesis that we think is
- 2:42going on in the relationship. So in, in this example,
- 2:45it would be assumed that the more we study,
- 2:49the better we'll do on a test. So that would be the alternative
- 2:53hypothesis in this example.
- 2:58The experimental research— in
- 3:01experimental research, again, we're talking about whether something
- 3:05influences something else.
- 3:08So if we go back to the study group example,
- 3:13is let's say I set up an experiment where I randomly
- 3:16assign participants to study 3
- 3:20hours a week, or I have another group studying,
- 3:23let's go 9 hours a week. So they're studying 3 times the
- 3:27amount as the one group. Okay?
- 3:30And what I'll want to do is then I'll have them study for something
- 3:34over several weeks, and then I would give some type of test or exam.
- 3:39And what I would want to know is, is there a statistically significant
- 3:43difference between the 9 hours of studying versus the 3 hours
- 3:47of studying? In the hypothesis,
- 3:51the null hypothesis is that there would be no differences
- 3:55between study times and its influence on test grades.
- 3:59And then of course the alternative hypothesis would be is there
- 4:03would be a difference between individuals who studied 3 hours
- 4:07a week versus individuals who studied 9 hours a
- 4:10week. So that's kind of how we set up
- 4:15experimentations when we're dealing with quantitative
- 4:19methods. And as I said, when we have
- 4:23results, let's say that there was a significant difference between the
- 4:282 groups, the 3 hours for the 9 hours. I wouldn't say my null
- 4:32hypothesis is correct— what,
- 4:35my alternative hypothesis is correct, excuse me. What I
- 4:39would say is I'm rejecting the null hypothesis.
- 4:43Okay, because What I'm stating is
- 4:47that there is differences,
- 4:50but I'm not going to say that I've completely
- 4:55proven that study time influences
- 4:58test grades because then what would need to happen is this would need
- 5:02to be retested somewhere else by another experimenter using
- 5:06the same methods. So now
- 5:10when we're dealing with quantitative methods, we run
- 5:14the chance of having what's called errors or Type I
- 5:18error versus Type II error.
- 5:21Type I error is incorrectly rejecting the null hypothesis
- 5:26in favor of the alternative hypothesis. So a Type I
- 5:29error is when I say that there was a difference
- 5:34between 2 groups, but there truly wasn't. It was
- 5:37just a statistical anomaly. I had to deal with error in my
- 5:41experiment.
- 5:46When we have a Type II error,
- 5:50this is when we accept— we
- 5:54fail to reject the null hypothesis, meaning that we accept the null hypothesis
- 5:58when there was actually differences. Okay, so the first
- 6:03one is when I reject the null hypothesis
- 6:06but there was actually differences. And the second
- 6:10one is when I reject the null hypothesis when there wasn't
- 6:14any actual differences between the groups.
- 6:18And a large part of the reason why we care about these
- 6:23errors is because— these types of errors is because
- 6:27there's always noise, what I would call noise in our data.
- 6:32So there's in our experiment There might
- 6:37have been somebody in the 9-hour— a group of individuals in the 9-hour
- 6:41study that didn't quite actually do the full 9 hours of
- 6:44studying. And that would introduce error into
- 6:48my experiment. We're going into— again, we're going
- 6:52into biological psychology.
- 6:58And one of the concerns with biological psychology is
- 7:02that when we're dealing with, for example, brain imaging,
- 7:08A lot of the experiments are done because it's so expensive
- 7:12to do those types of experiments. Your sample size
- 7:16is usually 7 to 9 people,
- 7:21and that's about it.
- 7:24So for a lot of experiments, when they come
- 7:29out in the news and they say the
- 7:35limbic system, this little part
- 7:39of the limbic system controls anger,
- 7:42for example. And this is just an example, okay?
- 7:47Well, a lot of times you won't ever hear that again because
- 7:51what they're saying is that that area represents everybody
- 7:54based on a sample of about 7 to 9 people.
- 7:59And usually what happens in these experiments is they repeat them
- 8:03And they do them over and they don't find any results.
- 8:07And it usually has to do with the sample size. So when
- 8:11dealing with imaging studies, we usually use what's
- 8:16called a meta-analysis technique, where instead of
- 8:19looking at a single experiment to see if there's
- 8:24results, we take all the experiments that are similar
- 8:28to each other and we smush them together. And then that creates
- 8:33a large enough sample that we can actually say something reliable
- 8:36with it. Okay, so those are just some
- 8:40examples of type of errors and what we
- 8:44have to look out for when we're, when we're really interpreting data
- 8:48that comes out. We're not really going
- 8:52to spend too much time on sampling techniques, but I do want to talk about
- 8:57I actually want to go on here.
- 9:06Okay, what I want to start with is some concepts
- 9:10in quantitative methods
- 9:14that's kind of really important to understand.
- 9:19Most statistical methods assume that data is
- 9:22what's called normally distributed, and we'll get to this
- 9:26if you've ever heard of the bell curve.
- 9:30What this is, is when you sample something
- 9:34long enough, it will create
- 9:38what's called a bell curve. And the bell curve looks like
- 9:41this, this figure right here, where if we draw a
- 9:45line down this middle, that's going to represent our mean
- 9:49or our average, where 50% are on one
- 9:52side and 50% are on the other. But what the bell curve does
- 9:56is it tells us something about the population.
- 10:01So when we look at the mean, for example, of a normal distribution,
- 10:0650% lays on one side, 50% lays on the other.
- 10:10But then we have something called a standard deviation.
- 10:14Okay, standard deviation is a measure of what we call variation,
- 10:19the variation between scores. Okay, and what the
- 10:23basic definition of a standard deviation deviation is
- 10:28it's the average distance between individual
- 10:32scores and the mean. Okay,
- 10:35so it's telling us what the average differences between
- 10:40individual scores are. Okay, well,
- 10:43when we set the standard deviation, which is just
- 10:47a representation of variation on the normal distribution,
- 10:51we can tell a lot about the population.
- 10:55For example, we know that
- 11:00when we look at both directions from the mean,
- 11:04that in the population, 68% of people
- 11:09score between 1 standard deviation of the mean,
- 11:12as you can see right here.
- 11:19We know that 68% of people will lie between
- 11:23these 2 scores. We also
- 11:27know that 95% of people
- 11:32lay between 2 standard deviations and
- 11:35then the rest go beyond
- 11:39that. So the other 4% are beyond that
- 11:43in the third range. Okay, now how is this
- 11:47stuff kind of helpful? Okay, well, when we look at,
- 11:51for example, intelligence tests, Or IQ tests.
- 11:56Most IQ tests are standardized at
- 12:01a mean score of 100. I wonder
- 12:06if there's— no, there's not. And the standard deviation
- 12:10is 15.
- 12:14So when we go this direction, we'll just go 1 standard deviation,
- 12:18it would be 85, right? 100 minus
- 12:2215. Yeah. Okay.
- 12:27And then above that is 115.
- 12:32Really bad writing. Kind of. That says 115,
- 12:36I promise. And so we know that
- 12:4068% of people's IQ is somewhere between
- 12:43an 85 and 115.
- 12:48When using IQ tests to say people
- 12:52who are super
- 12:56intelligent, if you want to put it that way, or people who might have developmental
- 13:00issues, is we start looking beyond this.
- 13:05If someone scores below an 85, we'll do further testing
- 13:10to see if they have some type of developmental cognitive
- 13:14issue. When people score above a 115,
- 13:18then we start looking to see, well, why is it that they are scoring
- 13:22so much higher than the average population?
- 13:25And so this is kind of what's unique about the standard
- 13:30bell curve is that it can really tell us a lot about what's
- 13:34going on in the population. But as I said, it usually
- 13:38takes a lot of sampling.
- 13:41When we look at— and the bell curve occurs anywhere,
- 13:45even in nature. So for example, when a biologist
- 13:48measures the growth of a plant,
- 13:51If they measure the growth of that plant enough, it will
- 13:55fall along this normal curve where some plants will not grow
- 13:59too high, others will grow too large, but 68%
- 14:04of them will grow within a certain range.
- 14:07Okay, we know this with animal growth and
- 14:11the like. So this is kind of the use of it,
- 14:17of that normal curve that kind of gives us a description of the population.
- 14:22Real exciting stuff, huh? All right,
- 14:26so that's the normal curve. So the other part of it is, is we
- 14:30want to know what type of variables that we have.
- 14:33So I mentioned independent variables and dependent variables,
- 14:38and again, independent variables are those variables
- 14:41that we manipulate, and the dependent variables
- 14:45are those variables that we measure. To see if
- 14:49that manipulation had an effect.
- 14:55There's also something called mediating variables and moderating
- 14:58variables, which we'll get to. Just keep that
- 15:02in mind. And then confounding and control variables.
- 15:06Confounding variables are just those variables that in an experiment
- 15:10I can't control as an experimenter. So for example,
- 15:15I can't control anything
- 15:19that you went through before you came into the lab.
- 15:22There's not everything I can control
- 15:26in a laboratory or a natural setting. So those are all confounding
- 15:30variables. Control variables are
- 15:34those things that we want to not have an
- 15:39effect on our research. So for
- 15:43example, some very common control variables when
- 15:46we're studying things like cognition or emotions
- 15:50or something like that can be things like age.
- 15:56Trying to think of the other ones. Gender, those types of things.
- 16:00So we'll put in a control for those so that we can— so
- 16:04we're not saying that something is due to gender or due to
- 16:08age or something like that.
- 16:13And then we have 3 types of scales. A nominal
- 16:17scale is things like yes
- 16:21or no, male or female. They're categorical
- 16:25in nature. When we put things in age groups,
- 16:28they're nominal. Ordinal and continuous
- 16:33are ones that are put on a scale
- 16:37from, for example, strongly agree to strongly disagree,
- 16:41measurement of just age, height,
- 16:45All of those things that can go from 0 to some upper
- 16:49limit are what we consider ordinal or continuous.
- 16:54These are important because we
- 16:58have to analyze these slightly different. And we can't
- 17:03use regular statistical methods when we have nominal
- 17:07data because it just skews everything.
- 17:12So there's some statistical analysis that are most commonly used
- 17:16in psychology, which are descriptive methods, because a
- 17:21lot of what we study we can't really experiment
- 17:25on. So for example, if I want to study
- 17:29the environment on development, right, I can't
- 17:33ethically take a child at birth and put one
- 17:37in a really good environment and one in a really
- 17:40bad environment to see the success or
- 17:44the development of the child. That would be unethical. What we
- 17:47really rely on a lot are descriptive methods such as correlation,
- 17:52regression. It's important to go
- 17:56over these methods really quick.
- 18:00When we're talking about correlation, what we're
- 18:03talking about is whether 2 variables are associated with
- 18:07each other. If we look at these diagrams in this slide,
- 18:14we want to know if something is positively correlated,
- 18:18which is this first one up here,
- 18:22or whether something is negatively correlated.
- 18:27When we're seeing if something is positively correlated,
- 18:30it means when the scores in one measure go up,
- 18:34the scores in the other measure go up.
- 18:37So in our example, it's study time and
- 18:40tests. So the amount of study time goes up, we would
- 18:44expect the the test
- 18:50scores to go up. I forgot what we were measuring.
- 18:54A negative correlation is when the scores in one variable
- 18:59go up, the scores in the other variable go down.
- 19:04And then we can have spurious relationships, which is this one.
- 19:07So this one's probably more curvilinear. When we're dealing with correlations,
- 19:12we're only talking about linear analysis. And then this one here,
- 19:17this one represents where there would be no correlation because you
- 19:20couldn't fit a positive or negative line like you can
- 19:24with these here. Okay.
- 19:28So we want to know direction with correlation, but we also want to
- 19:32know the strength of the relationship.
- 19:36And how correlation is measured— and this isn't really that important—
- 19:42is it's measured using that formula on this scale here.
- 19:45It goes from -1 to +1.
- 19:50If a correlation is 0, it means that there
- 19:54is no relationship between the variables.
- 19:58So if we did a scatter plot, it would
- 20:01be this one right here. Okay? Meaning that there's just
- 20:05no relationship between them.
- 20:09A perfect positive 1 means that the
- 20:13relationship is perfect, meaning as one goes up, the other one
- 20:17exactly goes up in tandem. A negative
- 20:211 means that there's a perfect negative relationship.
- 20:26But then the strength of the relationship can be determined between
- 20:290 to positive 1. So we know direction,
- 20:32but we can also know the strength of the relationship.
- 20:37And this is a good part where I would
- 20:41encourage everybody to become good consumers of information. When you hear about
- 20:46Coca-Cola is associated with cancer or something like that,
- 20:50Okay, I heard that a lot when I was a kid.
- 20:54I don't know why I always remember that, but— or you hear something
- 20:58about, you know, school shootings
- 21:01are associated with mental health or something like that.
- 21:05Okay, is that the majority of correlations
- 21:10we get in social sciences is
- 21:14somewhere between a 0 and a 0.2. Or -0.2,
- 21:19meaning that there are so many other factors
- 21:24that go into that relationship that that
- 21:28relationship usually is very weak. But in popular
- 21:32media, because this would be publishable, of course,
- 21:35because it'd be significant, we go
- 21:39and think that those associations are one-to-one.
- 21:44But in most of social sciences, we actually have very weak correlations or
- 21:49very weak associations. And so when consuming
- 21:53this, always kind of look at that correlation coefficient if it's reported and
- 21:59keep that in mind.
- 22:05The other type of associative analysis we can do is
- 22:08what's called linear regression. And this is
- 22:12when we want to take a predicted
- 22:16variable and see if it is predicted
- 22:21by another variable. So in this
- 22:25example, we can go back to the
- 22:30study example one. Maybe I want to run a regression analysis on
- 22:34the amount of time someone studies and what
- 22:41their predicted score on an exam would be. That's one thing
- 22:45I can do with regression analysis. And so my
- 22:48predicted variable in this case is exam scores.
- 22:52That's the y-hat. Okay.
- 22:56My variable that I think
- 22:59predicts test scores would be study
- 23:03time. Okay. So this is time and that's the—
- 23:06this little b or what's called the beta.
- 23:11Okay. The x is
- 23:16what we call the slope of the line. Okay.
- 23:21The a is what we call the constant.
- 23:25So that's where it intersects our y-axis.
- 23:29So it's always going to be constant. So regardless of
- 23:33amount of study time, you'll always score a score of something.
- 23:37And that's the y-axis. So what
- 23:41I do to analyze this is let's say I
- 23:45have a person who, who studies for 6 hours
- 23:49a week. What I would do is I would put the 6 hours a
- 23:53week here. I would multiply it by the
- 23:57slope of the line, which is this, this line here,
- 24:00and then I would add the constant. And what
- 24:05that would give me is a predicted score that that person would
- 24:09score on an exam.
- 24:12This is regression analysis. And really,
- 24:15because of error and everything and because there's really no perfect relationships,
- 24:20what we want to know is what is the strength of the predictability
- 24:24usually.
- 24:30Okay, so again, the power of regression
- 24:34analysis is it tells us how much one variable
- 24:38can predict another variable. Correlation shows us
- 24:42the strength of relationships.
- 24:47So I also mentioned that there's 2 other types of
- 24:51variables. One is a mediating variable and one is a moderating variable.
- 24:57In mediation,
- 25:01what we want to know is if there's variables between 2 associations.
- 25:05So again, we'll go back to study time. So this would be
- 25:09study time and this would be exam scores.
- 25:16With that little E kind of. And so let's say
- 25:20we found an association between those 2.
- 25:25What if I think
- 25:29that there's some type of something that mediates study time with exam scores?
- 25:35Let's say
- 25:39location where the person studies or something like that. So school or home
- 25:44or in a group or not in a group. Let's go with that.
- 25:47So how many people I feel people study with
- 25:51mediates the relationship. Well, what should
- 25:55happen is if it is truly a mediating variable,
- 25:59what it should do is lower the relationship
- 26:03between study time and exam when I put this in the middle
- 26:07of those 2. So if we did a graph, kind of,
- 26:13and let's say this is the association between study time
- 26:17and exams. What I would expect to happen
- 26:22is if I put in— into
- 26:26my statistical software, if I put
- 26:30the number of people that the individual studies with, what I
- 26:33would expect is this association to go down.
- 26:38And that's what mediation means, is it weakens
- 26:42the relationship or it changes the relationship between
- 26:46your 2 original variables.
- 26:51Moderation changes the
- 26:55relationship completely. And this actually comes
- 26:59from a real experiment where there's moderation.
- 27:03So mediation just changes the relationship. It either weakens
- 27:07it or strengthens it. Moderation makes the relationship
- 27:11go away completely.
- 27:14Mostly. In one study,
- 27:18they found that stress is
- 27:23associated with depression. The amount of stress
- 27:27someone was experiencing was associated with depression.
- 27:35What the experimenters thought though is that
- 27:38the moderating variable between stress and depression would
- 27:44be something like social support. How many people does that person
- 27:49have to rely on in their social system?
- 27:53What they found is that, as you can
- 27:57see in this graph, when there
- 28:01was no social support, there was a strong relationship
- 28:05between stress and depression.
- 28:09But once you've had individuals who had good social support,
- 28:14the relationship between stress and depression went
- 28:22That has then informed us about people
- 28:26who are heavily stressed and who are also experiencing
- 28:30depressive symptoms. Because if we know, if we
- 28:34get them to engage their social system, if we provide social support,
- 28:39stress will no longer be a variable that
- 28:43will be influencing their depressive symptoms.
- 28:46If their depression continues after implementing some
- 28:50type of social support program, that means the depression
- 28:54is associated with something else besides stress.
- 28:59Does that make sense? Okay with that?
- 29:03Okay.
- 29:05I'm not going to go through that.
- 29:12Okay. Now, the other thing that I do want to talk about is in a
- 29:16lot of research, when you hear the term statistically significant,
- 29:23okay, everything is based upon probability
- 29:26of a result. Okay? And in the field of science,
- 29:30not only psychology, biology, physical science,
- 29:34we always allow a little bit of error. Okay,
- 29:38and so we set our probability value, which is called
- 29:41the p-value, at less than 0.05,
- 29:46meaning that when I run some analysis of either difference
- 29:50or a correlation, I will say that that result
- 29:54is statistically significant if the
- 29:58value I get is less than 0.05,
- 30:02which means that there's less than a 5%
- 30:06chance that the results I obtained
- 30:11were obtained by error,
- 30:15meaning that it was some flaw in the research design.
- 30:23But what does that p-value mean? It really
- 30:27means the probability that those results can be replicated.
- 30:31The problem is, is it's based upon the same
- 30:35population. So if I I go back and resample
- 30:41the population that I did my research on,
- 30:44that's the probability that I'll get those results again.
- 30:48Okay, the mistake a lot of people make,
- 30:51and this again goes back to the importance of reading psychological
- 30:56research or social science research, is that we assume,
- 31:01especially when someone says this was statistically
- 31:05significant, that that then applies to
- 31:09everybody. And that's not what
- 31:12actual p-value means. It means that if I go resample the same
- 31:17people I just sampled, I'll get those results.
- 31:21And so when you hear the term statistically significant,
- 31:26know that that doesn't mean that it might apply to
- 31:29all the population. In fact, what we should do is
- 31:33go back and read the sample that it came from and
- 31:37to see what are the races, what are the gender distribution,
- 31:42what is the even education level and all
- 31:46those, because that is what that probability represents.
- 31:51And this has been an issue in psychology over the
- 31:56last about 20, 30 years because we're having what's called a replication
- 32:00issue. In that a lot of people are starting to
- 32:04replicate really traditional research that has been done
- 32:09with different populations, and we're finding that there's
- 32:13differences, that the results don't replicate.
- 32:17And indeed, this kind of makes it easy to study this class.
- 32:21About 90% of statistical research has not
- 32:25been replicated. It's not replicatable.
- 32:29Because we relied on what's called this p-value.
- 32:33Okay,
- 32:38so what we— what a lot of good scientists have started
- 32:43to do is we've added the p-value, but we've started
- 32:47to look at something called effect sizes. Okay,
- 32:51an effect size— so when we're looking at differences in
- 32:55data, Effect size tells us how large
- 32:59of a difference there is. When we're looking
- 33:03at associations such as correlation, it tells
- 33:06us how much one variable can
- 33:10account for another. And let me kind of explain
- 33:14why this is important.
- 33:20So there has been— I think there was a book written years
- 33:24ago called Men are from Mars and women
- 33:29are from Venus. Because what they argued
- 33:33is that there's such big differences between males
- 33:37and females that we're
- 33:412 foreign entities almost. I'm going
- 33:45to go back here and use this.
- 33:48Hopefully I can draw. Let's say
- 33:53we're measuring some gender difference. I don't
- 33:58know, masculinity versus femininity.
- 34:01Masculinity being dominance, femininity being
- 34:05caring and nurturing. Let's say this
- 34:09graph right here, the black line represents women.
- 34:14Then if we measure men, this line,
- 34:18let me see if I can draw it, the blue line,
- 34:23represents men.
- 34:32Okay, based on this research,
- 34:35because there is this difference, this mean difference,
- 34:40I would find a statistically significant
- 34:43difference between men and women on masculinity
- 34:48to femininity. With masculinity being on this
- 34:51side and femininity being on this side.
- 34:57The problem is, is in most gender
- 35:01research— whoops— in most gender
- 35:04research,
- 35:09we don't look at the effect size, how big of a difference there
- 35:13is. And when we look at things like masculinity and
- 35:17femininity, this would be the actual true
- 35:21story. There are a few men
- 35:26that are more masculine than feminine,
- 35:32and there's a few women who are more feminine
- 35:36than masculine. So there are a few men
- 35:39who come from Mars, there are a few women
- 35:43who come from Venus, but the majority of us
- 35:48right here represented in underneath here,
- 35:52the rest of us just come from the planet Earth, meaning that there's
- 35:56so much overlap between genders that really when
- 36:01we're talking about gender differences, we're usually talking about a
- 36:05few subset of the male population and a few subset
- 36:09of the female population.
- 36:13That looks like something my grandbaby drew this last weekend.
- 36:18Anyways, so that's what effect size tells us, and it
- 36:22gives us a better prediction of what actually is going on
- 36:26in a population and how much true differences there are
- 36:31in a population. In the correlational example,
- 36:35and this is something that does come out of our example
- 36:39of study time and test scores,
- 36:43is if we run a a power analysis or an effect
- 36:48size analysis on that, we find that the effect
- 36:51size is what we call 0.2— it's around 0.20.
- 36:57Okay, now what does this mean?
- 37:00If we convert this into a percentage, it would be 20% by
- 37:04moving the 2 decimal points. Okay, and what we
- 37:09would be able to say at that point is that based
- 37:12on our measures of just study time and our measures
- 37:16of exams, the variability
- 37:19in exam scores— what someone receives
- 37:24on exam— 20% of it can be explained
- 37:28by study time. Okay, now that's really valuable
- 37:33because that tells us that there's 80% of
- 37:37something else that explains study time, that we're only
- 37:40explaining about 20% using
- 37:44study time. So our exam scores, we still
- 37:48haven't explained about 80% of the reason why someone does good
- 37:53on an exam. So this is an example of effect
- 37:57size when we use it, when we're using regression or
- 38:01correlation. All right.
- 38:05And so that kind of gives us the full story of what's going on.
- 38:11All right. Now that we've gone through all that, did everybody understand everything I just
- 38:16said? You're good with it?
- 38:20How about, how about, how about online? Everybody kind of follow
- 38:24that so far?
- 38:29Okay. And the conclusion is— and thank you, Marissa and
- 38:32Heidi. And Kelly and Joe,
- 38:36the conclusion is, is whenever we're consuming some type of research,
- 38:41we need to look beyond statistical significance.
- 38:45We need to see if they reported things like effect size so
- 38:48we know how big of a difference or similarities there are. And we
- 38:52have to look at where did the research come from, who was the sample,
- 38:57who were the participants. Before we should make conclusions that
- 39:01something is universal or something applies to everyone.
- 39:04Okay, and so those are kind of the takeaway points.
- 39:08All right, all right, so that is— excuse
- 39:12me, Professor? Yes? Um, with these studies that,
- 39:15you know, you're obviously looking into for research, um,
- 39:19would time also be implemented in this? Because,
- 39:23you know, it happened say the research happened back in the
- 39:27'80s or '90s, would that carry over as well,
- 39:31or would we have to look for a newer
- 39:36form of research in order to, I guess, come up
- 39:40with our solution?
- 39:44Sometimes yes and sometimes no, because we assume time
- 39:48is a variable. And so yeah, in some of this research, it's,
- 39:51it's whether it was replicated or not,
- 39:54we, we may think it's due to time, we may think it's because
- 39:58we used a different sample or something like that. But you
- 40:02bring up a really good point about whether something is universal
- 40:06or not, whether or not, you know, what, what happened to people 40,
- 40:1050 years ago still applies today.
- 40:14And there's some really good examples of this,
- 40:17um, in social psychology. So Last
- 40:22week we watched that video with Philip Zimbardo and he went over the Milgram
- 40:27studies as an example. And every
- 40:30generation that comes along in the field of psychology assumes
- 40:35that my generation would not be
- 40:39as compliant as previous generations, that back in the '60s
- 40:43there was much more compliance
- 40:47to authority, much more respect for authority.
- 40:50And so psychologists have the habit
- 40:55of trying to replicate that research every 10,
- 41:0020 years. In fact, the last replication I think was done in 2018.
- 41:06Now they use a different methodology because it
- 41:11was unethical what Milgram did. And so there's some alterations to that research
- 41:15to make it more ethical.
- 41:18But what we have found is that compliance rates to authority,
- 41:23just as many people today would shock someone or
- 41:27would injure an animal or would do something just
- 41:33by the orders of some authority figure that they see,
- 41:36that really compliance
- 41:41rates have not gone down.
- 41:44Now, on the other hand, there is some famous social psychological research
- 41:48where you
- 41:54have a group of people anywhere from 3 to about 7,
- 41:58okay? And you show the individuals
- 42:02some lines in one area. Here,
- 42:06I'll try and— so in
- 42:11one box, for example,
- 42:15there's what's called a reference line.
- 42:19And then in another box,
- 42:23There is like 3 different shaped lines,
- 42:27okay? And they're
- 42:33labeled A, B, and C. I'll just do the A because I'm
- 42:37not writing very well today. A, B, and C.
- 42:40And the question that they ask is, is the
- 42:44reference line in box 1 is
- 42:49equivalent to which line, A, B, or C? Okay,
- 42:53now in this research, the only participant is the person
- 42:57on the end. The rest of the individuals work
- 43:01for the researcher, and sometimes they give the correct
- 43:05answer and sometimes they give the incorrect answer. And our—
- 43:09the question we have as researchers is, what will that
- 43:13person on the end answer? What answer would they give?
- 43:17So if they know that, let's say in the So we
- 43:21have 5 people and the first 4 say it's A,
- 43:27so it's too short of a line, but maybe it's the middle
- 43:31line that is equivalent. And so they want to know, will that last person give
- 43:36the correct answer, which should be B, or will they conform
- 43:40to the social group, which is A?
- 43:44Well, in that original research,
- 43:4775% of individuals initially gave
- 43:51the incorrect answer because of the group.
- 43:55They went with the group instead of knowing what that line really
- 44:00represents. Okay, well, in this example,
- 44:05this is where we have seen changes— to get to your question
- 44:09in a long way— this is where we have seen changes in
- 44:13people is that in the original research,
- 44:17about 75% of people would give the incorrect answer.
- 44:22And today, in more modern— in, in replications of that
- 44:25study, only about a third, only about 33%,
- 44:29which is still a lot, but only about 33%
- 44:33will give the wrong answer because of that social influence of
- 44:37everyone else giving the incorrect answer. So that's an example
- 44:42of how time and generations can influence outcomes.
- 44:45In some areas, like conformity to authority,
- 44:49we don't see time changes. When we look
- 44:52at things like social influence, as the example given earlier,
- 44:57we have seen a shift in the way people
- 45:00respond. Does that, in a roundabout way, answer your question?
- 45:05Like, yes, it does. It gives me sort of an answer.
- 45:10It just kind of seems like socially we're advancing,
- 45:14but in other terms,
- 45:18in other ways, we aren't. Yeah. And maybe
- 45:22another good example is IQ scores. Okay.
- 45:25Um, I don't know if any of you in this room realize it.
- 45:29I, I'm assuming everyone's in here of average intelligence.
- 45:33But does everybody know that you would score higher on
- 45:37an IQ test than Einstein?
- 45:44You guys are smarter according to IQ tests
- 45:50than Einstein. You're smarter than the
- 45:54guy that got hit on the apple, Newton. In fact, you have twice as much
- 45:57intelligence statistically as Isaac Newton.
- 46:02Because what we've seen again is a generational shift.
- 46:06We see that about every 10 years IQ
- 46:10scores within a generation increase between 2 to
- 46:145 points. And so Einstein scored
- 46:18around 130 during his time.
- 46:23While his 130 compared
- 46:27to IQs— what people score on IQ scores today— his 130, he would have
- 46:31scored around down to 75 to 85,
- 46:36where again, I assume
- 46:39because this is a bright group, everyone here scores average or more.
- 46:44I'm assuming a lot more. Okay, so really when
- 46:47we look at things like IQ, we see our IQs
- 46:51actually every 10 to 20 years are increasing
- 46:55and we have to reset the average. So that's
- 46:59another example that people often don't
- 47:03think about, that yes, you're more intelligent than Einstein
- 47:07and Newton. You should go home and tell your parents that.
- 47:16So, and Tommy, your question is very good. We really
- 47:21don't know. There's been a lot of research that
- 47:24suggests that, you know, maybe it's the education, it's access
- 47:28to information. If you think about, you know, Einstein, he didn't didn't
- 47:32have access to Google or Google Scholar
- 47:36or research or the mass amount of information
- 47:40that we have today. And so there's some theories and some
- 47:44thoughts, but we actually don't know why IQs
- 47:47have been increased like that. It's just an effect that we see.
- 47:51So, but that's a good question, maybe a doctoral
- 47:55dissertation in your future, maybe. So Yeah,
- 48:01and I kind of think it has to do with technology.
- 48:05So, okay. All right, any other questions on
- 48:09the research part?
- 48:17All right,
- 48:25so what I would like everybody to do for for
- 48:33the rest of the class, last 15 minutes, or make up the time later,
- 48:39is go to— so
- 48:43everybody knows, I did— I put this in the
- 48:47announcements this morning. I did redesign our
- 48:53Canvas page. So when you go into it,
- 48:58and collapse the Getting Started, we now just have the 3
- 49:03modules. And I'm hoping it'll make it a little bit easier to navigate.
- 49:07So the first module is our recorded lectures.
- 49:10The second module has all of our assignments that are due in
- 49:14the assignment area. And then this last one
- 49:18is just all the course learning materials. So if you want to go study more
- 49:23about sensations and perceptions when we get to that, you can go to that.
- 49:27But it also has the learning materials And what I'd
- 49:30like everybody to do between now and Wednesday is go into
- 49:34the course learning material and download
- 49:40or read this. It's in a PDF. It's the Lieberman,
- 49:43Einsberg, Williams article from 2003.
- 49:48And it talks about an fMRI study dealing with—
- 49:52I can't talk— social exclusion.
- 49:56Okay? And kind of take a look at that because we want
- 49:59to look at the measurements that they used and whatnot on Wednesday when
- 50:03we get into understanding how we measure things
- 50:07when it comes to, for example, social exclusion
- 50:11or any of the other variables that we measure. But also
- 50:15we'll have a discussion about the relation between these areas of the brain and
- 50:20functioning.