Latest / Politics with Paul / It's Election Polling Season - Here's What You Should Know About it | Politics with Paul #82
Transcript
- 0:00Welcome back to the Politics with Paul podcast, your home for nonpartisan discussion of
- 0:05political science and civics.
- 0:07I am your host, Paul Rader.
- 0:09Today, we're going to be talking about how it's election polling season and here's what you
- 0:14should know about it.
- 0:15We have a midterm election this year, and that means you're going to see a whole bunch of
- 0:19polls for a whole bunch of races.
- 0:21Polls make for easy fodder for political media of all sorts of political stripes, hardcore
- 0:28voters, and even somewhat engaged voters to gobble up and discuss ad nauseam.
- 0:35But then some polls turn out to be off the mark, and then people start complaining about
- 0:39them being fake and bad and yada yada yada, and then the cycle repeats for every election.
- 0:45Now it is true that polls have faced a lot of obstacles in recent years, and some polls are
- 0:51just bad, and they're becoming harder to do.
- 0:54But they are still a valuable source of info on public opinion if you know how to use them
- 1:02correctly.
- 1:04They should not be treated as the end all be all, but they also shouldn't be tossed to the
- 1:09side.
- 1:09And you certainly shouldn't treat them as gospel and then flip flop and say, Oh, they're
- 1:13trash, after they turn out to be wrong.
- 1:16So as we approach the twenty twenty six election and for subsequent elections, what are
- 1:22the biggest misconceptions about polls or surveys?
- 1:26What are the most important things to know about polls so that you can be equipped in how
- 1:32to best interpret and discuss them?
- 1:35And which ones should you care about?
- 1:37Well, that's what today's episode is about.
- 1:39Here we go.
- 1:40Let's first of all clear up some misunderstandings about polling, and there's a
- 1:44lot of them.
- 1:44A lot of them are pervasive.
- 1:47And oftentimes, these criticisms of polls are overblown, and sometimes that's for political
- 1:52gain.
- 1:53And sometimes, it's just a simple misunderstanding about what polls actually do.
- 1:58Now commentators might say polls suck so that they can gain clout in some way, even though
- 2:04they'll trip over themselves to still report on another poll whenever it's convenient for them
- 2:09or it says something that's in some way interesting to them.
- 2:13And then some politicians will just dismiss polls that say they aren't winning and say that
- 2:18they're fake, they're rigs, that they're dumb.
- 2:20They don't measure true American support or some sort of nonsense because for some reason,
- 2:26they think some of them, some of these politicians think that they can't possibly be
- 2:32losing at something, or they don't heed warnings in these polls that say, hey.
- 2:37Look.
- 2:38You might want to think about x issue here so that people start actually supporting you.
- 2:44But, you know, politicians wanna hear only what they want to hear, and candidates only want to
- 2:50hear what they want to hear a lot of times.
- 2:53And then other people simply just don't understand or like polls or they think that
- 2:58they negatively impact election outcomes significantly by swaying people's opinions.
- 3:04Now polls can influence people's decisions a little bit.
- 3:08Some people really do believe in the, oh, I want to vote for a winner.
- 3:12But that's really not that common.
- 3:15It doesn't really have that much influence on what people do in elections or whether they
- 3:23come out.
- 3:24For a few people have that that impact.
- 3:26And in a really close race, it could potentially make a little bit of a difference.
- 3:31But by and large, it's not really gonna make any sort of like, this election was won because
- 3:37this poll came out.
- 3:39No.
- 3:39That's that's not gonna happen.
- 3:40Another misconception about polls is that people think that polls are lying just because
- 3:46they turn out to be incorrect.
- 3:48That there's just something inherently fundamentally flawed in these polls, if not
- 3:54outright fabricating what people are thinking.
- 3:58There are polls that are fake, but they are few and far between, and they are purposely there
- 4:03to skew people's opinions about something.
- 4:06And and sometimes it's just a pure troll job.
- 4:08Like, back in the twenty sixteen election cycle, there was a fake poll that was being
- 4:14circulated that said that if the election was held on whatever day it was, that Kid Rock
- 4:21would beat Democratic US senator Debbie Stabenow in a race for her seat to for her to
- 4:30win that seat again.
- 4:31And, of course, this was well before Kid Rock headlined an alternate Super Bowl halftime
- 4:36show, but this was not a poll that actually existed.
- 4:41The so called company that that administered it that didn't exist.
- 4:46And problem is the media kept circulating it just because it looked so, oh, wow.
- 4:51This was crazy.
- 4:52Can you believe this?
- 4:53People want Kid Rock over Debbie Stabenow.
- 4:56That wasn't a thing.
- 4:57Kid Rock didn't say he was gonna run for election.
- 5:00Part that is part of the problem is that media, including media that wants to deride polls when
- 5:06they turn out to be wrong, this media often treats all polls as worthwhile for discussion
- 5:11because it's a very easy way to get clicks and views.
- 5:14People see, oh, who's winning this race?
- 5:16They have to know who's winning right now when that's not really a it's not really a thing.
- 5:23Like, this person is winning at this point in time.
- 5:25I mean or at least their concept of who's winning right now is not really quite winning.
- 5:33But, know, there there is this this whole obsession with winning that people have,
- 5:37whether it's they want their candidate to win or they're just simply interested in, well,
- 5:42which of these candidates in this race is is is in the lead for this for this office?
- 5:47People just have this need to know, and it and it happens to everybody.
- 5:51To to some extent, we all have an interest in, oh, who's winning such and such.
- 5:56But problem is a lot of times media will just circulate polls without even thinking about
- 6:02whether they're actually, a, whether they're real polls, and b, whether they're real polls,
- 6:09but they're actually good and worthwhile.
- 6:11Not every poll is worthwhile.
- 6:13That is true.
- 6:14It's just when you make a blanket statement about all polls being crap is the problem.
- 6:20So even crappy polls and mediocre pollsters still can get publicity if what they report
- 6:27seems interesting enough, and so that can really cloud people's perceptions about the
- 6:32reliability of polls.
- 6:34And so you can just get hoodwinked by fake polls because of this lack of vetting.
- 6:38And and also just the need for media to be first because they in their minds, they're
- 6:43winning at the media game.
- 6:44And then also media consumers want everything now, and so they want to hear about things
- 6:50right away before things can necessarily be vetted.
- 6:53But polls are not lying to you.
- 6:56At least the good ones are not lying to you.
- 6:59We can't know with a 100% certainty what the entire public is thinking.
- 7:04That's why we're polling them.
- 7:06If we could figure out what the entire public was thinking, we wouldn't need polls.
- 7:10So we we can't know with full certainty, this is what the entire public is thinking.
- 7:15So there's gonna be inherently a little bit of uncertainty there.
- 7:19And we don't know the relatively few people that are going to change their mind even though
- 7:24a lot of people eventually or have made up their minds well in advance, but there are
- 7:29gonna be a few people that change their minds.
- 7:30And you don't know which people are going to show up to vote.
- 7:33So polls can be a bit off in that regard.
- 7:35And you don't know which people are gonna show up.
- 7:38Lot of people you do know are who are going to show up based on their voting history, and
- 7:42we'll talk about that in a little bit here.
- 7:44But sometimes people who seem like they're going to vote right now don't actually turn out
- 7:49to vote, and some people you won't necessarily know who that is.
- 7:53And also, another big issue with polls is that there's these non response biases that we
- 8:02encounter.
- 8:03Non response bias being when a pollster calls a home that they randomly sampled, they could not
- 8:12get somebody on the phone or or they did get somebody on the phone, but they just did not
- 8:17wanna answer a survey.
- 8:18So then they have to go sample somebody else.
- 8:20And early on in public research, this was not much of a problem.
- 8:25People were much more willing to pick up the phone and answer these polls.
- 8:30Now as landline phones have disappeared and spam calls have dramatically risen and general
- 8:36distrust of polling and anything politically related has increased, it's become harder to
- 8:42get people to answer these surveys.
- 8:44And the reason why it's such a problem for these surveys is because when you're inherently
- 8:49when you're randomly sampling and somebody decides, I'm not answering this poll, they're
- 8:55still part of that population you're trying to figure out the opinions of, but they've taken
- 9:01themselves out of it.
- 9:02So you can't really gauge what they're thinking.
- 9:05You're only able to sample people who are willing to answer the poll.
- 9:09So that can really skew the results, and more on that in a little bit.
- 9:13So legitimate polls are doing the best they can with the information and respondents that are
- 9:19available.
- 9:20Another misconception about polls, they are not supposed to be exact measures of what the
- 9:27public feels.
- 9:29They are estimates.
- 9:31People do not distinguish between what a sample is and a population.
- 9:36A sample is a segment of the population that you are polling, that you are surveying, that
- 9:41you are figuring out information about so that you can hopefully extrapolate across the whole
- 9:49population because the population is ultimately what matters in the end.
- 9:54They're the ones who are actually voting on the whole thing.
- 9:57It's not just your sample.
- 9:59So polls are the sample.
- 10:01Electra results are population based because it's the whole population.
- 10:05But the reason we do samples is, again, because it's impossible to get the entire population's
- 10:11feelings on something.
- 10:13If we could get the whole population, we wouldn't need polls.
- 10:16So we have to do the best we can with what we got, and so sampling is what we need to do.
- 10:24And they're also supposed to be a snapshot in time, not necessarily a prediction.
- 10:29It's not trying to say, like, oh, candidate a got 43% of the vote and candidate b got 41% of
- 10:36the votes.
- 10:37And so that means we're predicting that candidate a is getting 43% of the vote in the
- 10:42election.
- 10:42No.
- 10:43That's not what it It's just at this point in time, this is the estimate of what people feel
- 10:49right now.
- 10:50And ideally, you want multiple snapshots in time so that you can measure a trend and
- 10:55therefore come up with an even more accurate estimation of what the public thinks.
- 11:02And another big misconception about polling, something that people misunderstand, and it is
- 11:09one of the biggest misconceptions, and we actually talked a little bit about it with my
- 11:13guest, Alex Patton, from a few episodes ago because he has been ingrained in the polling
- 11:19business for quite some time.
- 11:21What margin of error actually means.
- 11:23When news segments talk about margin of error or any sort of commentary talks about margin of
- 11:30error, it's usually brought up with little, if any, actual explanation of what it is.
- 11:36So the very simple version, so we don't get bogged out of the very technical stuff.
- 11:41Margins of error are based on confidence intervals that are calculated based on how
- 11:45large the sample is.
- 11:47The larger the sample, the smaller the margin of error because you came closer to matching
- 11:51the population's opinion, you've got more of the population and so you are more confident in
- 11:57what the sample says.
- 11:59But because a sample inherently has some uncertainty as to how much it reflects the
- 12:04population, there was still going to be a margin of error as to what the actual public
- 12:09opinion is.
- 12:10So the margin of error basically says, you have a lot of confidence that the public opinion on
- 12:16X candidate or X issue is between X percent and Y percent.
- 12:22However, because we cannot be a 100% confident on what the population thinks, you can't ask
- 12:29the whole population, there is still a very slight chance that the real population's
- 12:34opinion falls just outside that margin of error.
- 12:37It's very slight chance, but it's still possible.
- 12:40So let's take candidates A and B again.
- 12:43So candidate a has 48% of of the of the samples vote, and candidate b has 43% of the samples
- 12:54vote.
- 12:54And the margin of error is five points plus or minus.
- 12:57It's always plus or minus because it's a range.
- 12:59So candidate a has 48% of the vote.
- 13:03If it's plus or minus, that means we have a very we're very confident that the true support
- 13:11for candidate A is between 4353% because 48 minuteus five is 43, 48 plus five is 53.
- 13:21But there is still a very slight chance that candidate A's public support actually falls
- 13:29outside of that range.
- 13:31So there might be a chance that candidate A's support is actually 54% or 55%, or on the flip
- 13:40side, maybe 42% or 41%.
- 13:44Statistically, it's very unlikely that that's the case, but there is still a little bit of a
- 13:51chance.
- 13:51So now you might ask, if we can't be a 100% confident, why even bother measuring public
- 13:58opinion?
- 13:58Why why would we do anything if we don't know for certain how things are?
- 14:03We need to be a little bit more uncomfortable with uncertainty when it comes to politics.
- 14:08And it's look.
- 14:09It's not a comfortable thing for anybody to have.
- 14:11We naturally want things to be clear to us like this is how things are.
- 14:16So a lot of times we get frustrated with nuance in politics, especially when we debate issues
- 14:22and candidates.
- 14:23But even in polling, there's a little bit of nuance here.
- 14:28But the reason why we do public opinion research, why we do polls and surveys, even
- 14:34though we can't be a 100% confident is because it's the best method we have for gauging the
- 14:39wider public's opinion on something.
- 14:42Despite all the issues that the industry of polling has faced, there's not really another
- 14:48method we have to get a wide scale approach to what people's opinion is or what the whole
- 14:56population's opinion is.
- 14:58Whether that population is a whole state, like you're measuring for a governor's race, or if
- 15:04it's for president, you're measuring the whole country.
- 15:06Or if it's a county commission race, you're measuring for the county.
- 15:10But campaigns also need this information to tailor their campaign messages.
- 15:14They don't just tailor their message just on a whim of what they think.
- 15:19Well, probably some candidates do, but they pretty much never win.
- 15:24But campaigns want this public opinion information so they can say, oh, wait a minute.
- 15:28People really care about this issue.
- 15:30I need to speak on this issue to shore up support.
- 15:33And then civic minded individuals who are not trying to win a race, but they're just trying
- 15:38to address issues that the public cares about.
- 15:41They want to use this information too to say, oh, okay, this is what this part of the
- 15:46community really cares about.
- 15:48Let's talk about this.
- 15:50Maybe they're just trying to bring people together to try to solve an issue or they have
- 15:55or maybe they're an interest group that has some sort of stake in the matter, and they want
- 16:01to know what people's opinion about it is.
- 16:03So polls have great use for a lot of people.
- 16:08Unfortunately, a lot of people poo poo them and think that they're useless.
- 16:11They're not useless.
- 16:13It's just again, it's a matter of knowing how to use them and how to interpret them because
- 16:18the interpretation of polls is what's really the problem.
- 16:22Another misconception about public opinion polling is and this maybe is not necessarily
- 16:28widespread, but some people do kind of make this assumption, not every pollster does their
- 16:34polls the same way.
- 16:34A lot of people just assume that it's all done the exact same way, and it's not.
- 16:39Though every worthwhile pollster does do random sampling because that's how you statistically
- 16:44get something as close to the population as you can.
- 16:47The exact methods and calculation and such may be proprietary.
- 16:51They might have their own special little formula that is super top secret and nobody
- 16:54else outside the organization can know.
- 16:56And that's how they come up with their sampling and their waiting and stuff.
- 17:02We'll talk more about what that is in a minute.
- 17:05But also one last misconception about polls.
- 17:09When we talk about dead heats, they're not really actually a thing.
- 17:14They're often not really dead heats.
- 17:16People look at a poll and say, oh, well, this candidate has 45% of support, and then this
- 17:22candidate has 45% of the vote.
- 17:25They're tied.
- 17:25No.
- 17:26Again, margin of error.
- 17:28Their support is somewhere likely within a certain range, but their support for the
- 17:35support for both of them is almost certainly not exactly 45%.
- 17:39It's it's a gauge.
- 17:41It's an estimate.
- 17:43There's an inherent uncertainty of sampling.
- 17:45Can't stress that enough.
- 17:47That makes these so called statistical ties unlikely to be really ties.
- 17:52We just don't fully know which way the lean is, and the lean might be ever so slight, ever so
- 17:58slight, but it's there.
- 18:01We just don't know what it is right now because we don't know with 100% certainty where the
- 18:09population's public opinion is.
- 18:12And so also, when you look at election ratings, don't mistake toss ups in election ratings as
- 18:18dead heats either.
- 18:19It's just basically saying that, look.
- 18:21This is this race is too close to make a strong assertion that this person is in the lead.
- 18:30And, of course, those election ratings use polling as part of their calculations.
- 18:35Now how much they use the polling as part of their calculations will differ based on whether
- 18:40you're talking about inside elections or Cook political reports or any other election rating
- 18:46system.
- 18:46Larry Sabato's crystal ball elections daily.
- 18:49So see analysis.
- 18:51The polls are gonna be part of those election ratings, but the toss ups don't mean, like,
- 18:54they're actually legitimately tied.
- 18:57It's just that it's really too close to call, which I guess for some people basically means
- 19:02tied, but it it dead heat's not really an accurate term whenever you see two candidates
- 19:10being neck and neck.
- 19:11Now those are misconceptions about polling.
- 19:15Let's talk about what polls actually matter because indicated earlier on that, yes, some
- 19:21polls suck and some polls are flat out fake, but there are still good polls and there are
- 19:27sometimes great polls.
- 19:29But not every poll is worthwhile.
- 19:31And some may be interesting, but their ability to tell us what could happen is limited or they
- 19:37don't actually tell us what we think they're telling us.
- 19:40Now you can look at there are a bunch of respected pollsters who have a good body of
- 19:45work even though sometimes people who are uninformed will still land base them or people
- 19:51who just have a major misconception about how polling works.
- 19:55They might still get land based just because they might have one high profile miss.
- 19:59Some some polling oriented pundits like Nate Silver, formerly of five thirty eight, he's
- 20:06somebody who ranks pollsters based on a variety of measures.
- 20:10You can find other people that do that same kind of thing or just like a general, like,
- 20:15hey, who's a respected pollster?
- 20:17And you'll usually find a pretty good list.
- 20:20Now, obviously, you gotta be careful because some people will still highlight the pollsters
- 20:25that they conveniently like.
- 20:26But usually, there's a when you look at people who are in the industry, there's usually, like,
- 20:32a consensus of, okay.
- 20:34These these pollsters are generally pretty good.
- 20:36Some colleges and universities have departments that are dedicated to polling, and those are
- 20:40usually pretty good.
- 20:42Even a couple news organizations with noticeable partisan or ideological biases like
- 20:48the New York Times for the left or Fox News for the right, they also generally have pretty good
- 20:53polling too.
- 20:54It doesn't really behoove them to have a bad poll.
- 20:58Now which polls that these organizations like Fox News, MSNBC, CNN, Newsmax, One American
- 21:06News, whatever ones that they actually highlight on the reporting segments, those you
- 21:11might wanna take a little bit with a grain of salt because they're generally going to
- 21:14highlight polls that are benefiting their side of the aisle, but they're not necessarily
- 21:20showcasing bad polls.
- 21:22So you might have a good poll, but because it conveniently says what that organization wants
- 21:29it to say, they might highlight that.
- 21:30And campaigns do that too, which we'll bring up in just a a minute.
- 21:35Now there are some kinds of polls as in types of polls that you should be a little wary of as
- 21:41well for various reasons.
- 21:43And a couple of them to highlight here.
- 21:45One type of poll to take with a grain of salt is what we call the generic congressional
- 21:51ballot.
- 21:51What a generic congressional ballot does is it measures what party respondents would vote for
- 21:58without naming any candidates for congressional seats.
- 22:00So as if you're gonna vote for a US house rep and you don't bring up a specific name, would
- 22:06you vote for the republican or the democrat?
- 22:08And they say republican or democrat or they say neither, they say independent, whatever.
- 22:12That's a generic congressional ballot.
- 22:14Those are good for gauging general sentiment toward the parties, but it doesn't really
- 22:21necessarily translate to how the seats for congress split.
- 22:24So if I if if right now, because it's a midterm and a Republican president, in this case,
- 22:30Donald Trump is in office, typically, the party that is not the president's party does worse in
- 22:37midterms.
- 22:38So Democrats are going to are generally looking better right now for 2026, and that might be
- 22:46different in 2030.
- 22:47But for 2026, Democrats are generally doing better on generic congressional balloting.
- 22:53So if you have one that says the generic Democrat would win 54% of the time to 46% of
- 23:01the time for Republicans, That doesn't necessarily mean that 54% of US house seats
- 23:07will go to the Democrats, and then 46% will go to the Republicans.
- 23:11It depends on where those votes come from.
- 23:14So even though you're randomly sampling, you may have just happened to pull from a bunch of
- 23:19districts or a bunch of communities that tend to lean much more democratic, or you just
- 23:23happen to get a few more democrats in your sample than you did republicans.
- 23:28So that can skew things a little bit and not necessarily bias your sample, but it won't give
- 23:36you as accurate of a picture.
- 23:40That doesn't necessarily mean that that it is that that Democrats aren't actually gonna win
- 23:44either.
- 23:45They might actually win more seats than 54%.
- 23:48They might win, like, 58% of seats.
- 23:50But because people can only vote on their specific district's congressional seat, a
- 23:57generic congressional ballot's not necessarily going to translate into how many of the seats
- 24:02that party is going to win in Congress.
- 24:04Because again, there is still the factor of, well, what if you take specific Republicans and
- 24:09Democrats, and that will inherently skew things a little bit.
- 24:14Now, generally speaking, most people are gonna vote for a candidate based on whether they're a
- 24:19Republican or a Democrat, but still there will be a little bit of difference compared to a
- 24:24generic congressional ballot.
- 24:27And you also have to account for the fact that the vast majority of incumbents win their
- 24:32reelection.
- 24:33Although a lot of Republicans are not running for reelection this year.
- 24:37Just FYI about generic congressional ballots.
- 24:41Be cognizant of those.
- 24:43Be a little wary of those.
- 24:45But beyond that, one that you really have to watch out for is these online polls because
- 24:52these are not randomly sampled.
- 24:53So whenever you're on the Internet and you're just browsing social media or doing going on
- 25:00whatever website and you see an ad that says, so and so wants you to take this quiz, and it's
- 25:04kind of this kind of or this at this survey, and it's conveniently toward one party, it's
- 25:08not always going to be like that.
- 25:09Sometimes it is not a specific party or aligned with a party and they and they want to know
- 25:15what what you're thinking.
- 25:17It's still going to be biased because it's not randomly sampled.
- 25:21Because people who feel strongly enough are going to click on that ad.
- 25:25Whereas even though a lot of people aren't answering the phone on a survey, more and more
- 25:30people are not answering phone surveys.
- 25:34Sometimes when they get they get on the phone, they'll still be like, okay, fine.
- 25:37I'll I'll take a survey.
- 25:39But on the Internet, you're probably not gonna click on or or you're probably not gonna click
- 25:43on it if if unless it's something that you really feel strongly about.
- 25:48So you're going to skew the sample towards people who feel strong enough about what's
- 25:53going on right now.
- 25:55And it's also biased towards people who have Internet or at least good Internet.
- 25:59Now, yes, most people have Internet these days, but there are still a lot of people like out in
- 26:05a lot of rural areas who have little, if any, access to broadband even in the year 2026,
- 26:12they're inherently going to be out of the side of the range of the sample because they don't
- 26:18have Internet, so they can't take an online poll.
- 26:21And if it's an ad for a poll, that ad is probably already biased by an algorithm showing
- 26:27that ad for certain people.
- 26:29And who knows what that algorithm is necessarily taking into account.
- 26:34So you might be getting only a certain segment of the population that would ever reach that
- 26:41would ever be reached by that online poll.
- 26:43Whereas in a random survey through phones, almost pretty much everybody has a phone.
- 26:48But even of course, now, fewer people have landlines, so there's still a it's there's
- 26:54still a certain bias to that, but it's not the same kind of bias as you have with an online
- 26:59poll.
- 27:00Online polls arguably have a worse sampling bias just because they're self selection as
- 27:06opposed to random sampling.
- 27:08Now let's put aside what poll whether a poll actually matters or not.
- 27:14Let's just assume we're talking about good polls now.
- 27:17What are the most important parts of a poll that you should know?
- 27:22Because a big problem for discussions about polling is that it's either boring or too
- 27:27complicated for most people to listen to.
- 27:30Even if they could actually understand it, they just don't.
- 27:33They just hear numbers, you know, lots of memes about how much math sucks, and they just say,
- 27:39I'm not dealing with that.
- 27:40Just tell me who's winning because people wanna know who's winning.
- 27:43Again, we there's there's a there's a little bit there's a little part in all of us that
- 27:49wants to know who's winning at something.
- 27:52It's a very human thing to do.
- 27:54You just have to be aware of it.
- 27:56But the media provides that fodder because the media also wants to know who's winning, and so
- 28:00they tell us who is supposedly winning in an election even if it's not really a full picture
- 28:07and usually is not.
- 28:09But most people will consider the very nitty gritty details of polls boring or too
- 28:15complicated.
- 28:16And in fairness, a lot of it can be complicated partly because we overcomplicate things when
- 28:21we're talking about polling and its intricacies.
- 28:24But that being said, here are some of the important things for you to know about so that
- 28:30if you do decide you wanna dig into polling a little bit more, here are the some of the
- 28:36biggest things you want to look out for so that you can assess whether it's a worthwhile poll
- 28:42or how much stock you should put in a poll.
- 28:45So one of the biggest things to think about is who is behind the poll.
- 28:51So some pollsters like colleges and universities that I mentioned earlier don't
- 28:56have specific candidates that they want to win.
- 28:58So they're usually pretty they're not necessarily biased as to who they want to win,
- 29:04so you can say, oh, okay.
- 29:05This is just what they came up with.
- 29:08However, many pollsters that are private typically align with either the Republican or
- 29:16Democratic parties and will typically only work with Republican candidates or only with
- 29:22Democratic candidates.
- 29:23And so they have an incentive to promote polls that prop up their candidate.
- 29:27Now that does not mean that the polls themselves are a lie because it is in that
- 29:35pollster's best interest to make a good poll for their internal strategy because if they
- 29:39don't have a good poll, they can't make a good strategy and that might lose them an election.
- 29:45And then so they won't get hired again.
- 29:48So they want to make a good poll, but they do have an incentive to keep polls that make the
- 29:54candidates seem weak under reps.
- 29:57And to refer back to my guest from a few weeks ago, Alex Patton, said a lot of the juiciest
- 30:03polls are ones that don't actually get released by these organizations.
- 30:07They don't release these polls because it's going to make their candidate look bad or it's
- 30:11gonna make these pollsters look bad.
- 30:14And, again, we talk about these candidates not liking when a poll makes them look bad.
- 30:20And so a lot of times, these pollsters will keep those polls under wraps.
- 30:25Now they might talk to the the candidate about the poll and say, hey.
- 30:28Look.
- 30:28This this x, y, and z things are a problem for you.
- 30:33But, again, they're not gonna put it out in public.
- 30:37But, again, does not mean you shouldn't actually listen to those polls.
- 30:40You just have to understand that they're only showing you curated side of the story that they
- 30:48want you to see.
- 30:50So there's a big difference there.
- 30:52Other things to look out for in polls, and I'm gonna group these three things together.
- 30:57Margin of error, sample sizes, and random sampling.
- 31:00Mentioned all three of those things earlier, but to go a little bit more into them, any poll
- 31:06that is worth looking into will tell you these things pretty easily.
- 31:10They will flat out say in a sentence or two, sample size was this.
- 31:15This was randomly sampled.
- 31:17Margin of error is this.
- 31:18Okay.
- 31:19Good.
- 31:19If if they're going out of their way to hide these things from you and it's too hard to find
- 31:24these statistics, that then you might want to take a step back and think about whether you
- 31:30actually wanna see this poll because they should make those things pretty obvious for you
- 31:35to see.
- 31:36Now the margin of error, once again, is going to be based on the sample of or the size of the
- 31:42sample.
- 31:42Excuse me.
- 31:43Larger the sample, the more accurate the poll will be, and so the smaller the margin of error
- 31:48will be.
- 31:49But if you don't randomly sample, you're going to bias the results because you're cherry
- 31:53picking people for the survey.
- 31:56Randomness is much more likely to come to the population's views as opposed to, oh, if I, you
- 32:02know what?
- 32:03I like this one and I'm gonna pick this one.
- 32:05No, no.
- 32:05You wanna randomly select them.
- 32:07And the ways that people do that, they usually have like a random number generator that will
- 32:11go.
- 32:12A computer will put all of these phone numbers in and select it at random as opposed to people
- 32:18manually picking the phone number.
- 32:21Another thing to look out for in polls is the representativeness of the sample and the
- 32:28weighting.
- 32:29It's not just about being randomly sampled, you also want it to reflect the population.
- 32:33Now, sampling might, because it's random, you might not get quite representative of the
- 32:42representative sample or sample that is representative of the population.
- 32:47So if I have a population, if I'm looking at a state that has 35% Democrats, 40% Republican,
- 32:58and then, let's see, 70 25% that is independents or third party, but my sample
- 33:08actually is like 35% Republican and 40% Democrat.
- 33:12I've oversampled Democrats and I've undersampled Republicans.
- 33:16Not intentionally, it's just how it happened.
- 33:19So ideally, you want your sample as demographically close to population you are
- 33:23gauging or trying to gauge as possible by party ID, by race, by gender, by age, income, if you
- 33:31can, although you don't necessarily have that information as easily as these other things.
- 33:36And so and the reason why you want it to be demographically representative is that
- 33:41demographics tend to have a certain lean.
- 33:44Some lean more Democrats, some lean more Republican.
- 33:48Younger voters, even though a lot of them aren't independents, they still tend to be a
- 33:52bit more Democratic versus older voters that tend to be a bit more Republican.
- 33:56That's just one example.
- 33:58And so if the representativeness of the sample is off off, excuse me, pollsters will tend to
- 34:04make up for it through a process called waiting for specific demographic groups waiting as in
- 34:10like the weight of somebody.
- 34:13So you will wait a sample if you underrepresent a group or if you overrepresent a group.
- 34:20If you underrepresent a group, it's because the percentage of your sample for that demographic
- 34:27group is smaller than the percentage for the population.
- 34:29So if the population had 20% black voters and my sample only had 15% black voters, that's an
- 34:39under representation.
- 34:41And so you might put more weight on that group to make up for that difference saying, well, I
- 34:47had fewer black voters in this sample compared to the population, so I'm actually going to
- 34:52beef up that opinion a little bit, not because of any biases, but because you want it to
- 34:58you're trying to make it more representative of the overall population, and black voters
- 35:04overwhelmingly vote Democratic.
- 35:06So that could the fact that you had fewer black voters could skew the results in favor of the
- 35:12Republican candidate, for example.
- 35:14Not necessarily the case, and you might have a district that's where the black voters tend to
- 35:18vote more Republican than other districts, but you still want it to be as representative as
- 35:24possible because you're trying to gauge the overall population of a district or a state or
- 35:30the country as much as you possibly can.
- 35:34But, again, you can't gauge the entire population, so you have to have a sample.
- 35:38But then if you overrepresent a group, that means you put less weight on them.
- 35:42So if I had a population where the were 65 and older voters were 45% of the population, but my
- 35:54sample found or took 50% of was fifty percent 65 years or older, then I might put less weight
- 36:04on them because I have pulled more elderly voters than I intended to or that more elderly
- 36:12voters as a percentage of the sample compared to the population.
- 36:17Speaking of which, the opinions of certain demographic subsets of the population is
- 36:22something that you want to account for as well because of that tendency for certain
- 36:30demographics to vote a certain way.
- 36:33Now, this requires more thorough digging and coverage on these polls, so it's not often
- 36:39talked about, but it is something that you want to look out for.
- 36:43So we'll use black voters again.
- 36:46Generally speaking, just as a rule of thumb, voters tend to be about 88, 90% Democratic, or
- 36:55put a different way, about 10 to 12% Republican.
- 36:59But if you find in your poll that there's 15 to 20% of black voters that are going to vote
- 37:08Republican, that should raise alarm bells if you're a Democrat because that means you are
- 37:14losing even though you have an overwhelming majority of that demographic because you are
- 37:21not winning as many of them as you expect to, that could actually lose you the election.
- 37:27That can make all the difference in whether you win this race that you're talking about because
- 37:34you're not winning as much of this demographic's vote as you should be
- 37:38theoretically.
- 37:40So if one demographic feels more strongly or weakly about a candidate or issue than you
- 37:46would expect, that is very noteworthy, and that means campaigns need to tailor their messages
- 37:51accordingly.
- 37:52So if they're trying to shore up votes amongst young voters or black voters or church going
- 37:59voters or whatever it is that they're trying to shore up votes and really trying to stabilize,
- 38:07that poll might give them that information they need to say, okay, I really need to reach out
- 38:13more to this demographic.
- 38:15And one last thing about polls to look out for, and I'm gonna consider it its own section, It's
- 38:21the timing of polls and why the timing of polls matters.
- 38:25Because if a poll is many months in advance of an election, there is a lot of time for a lot
- 38:31of different things to happen.
- 38:33If you see a lot of enthusiasm for voting nine months out, for example, is that going to keep
- 38:39up until election day?
- 38:41It's gonna be very hard for a lot of people to sustain that.
- 38:44Now some people who are very hardcore voters, they're gonna be able to sustain that
- 38:50enthusiasm or that anger or whatever it is, but you're already expecting them to go vote
- 38:56anyways.
- 38:57You're talking you're you're you're looking more at people who are not as regular voters.
- 39:02They might be fairly regular or they might be very irregular voters.
- 39:07And right now they're telling you, oh, yeah.
- 39:09I'm gonna go vote.
- 39:10They might be saying that right now, but are they necessarily gonna be doing that nine
- 39:15months from now, eight months from now, seven?
- 39:17Are they even gonna do it two weeks from now?
- 39:20It's very easy for people to say that they're going to do it, but ultimately then they don't
- 39:25do it.
- 39:25Or they might overemphasize their enthusiasm because they think that they should come across
- 39:33as more enthusiastic to vote.
- 39:36Now, I'm not saying a lot of people do that, but there is a little bit of that social
- 39:39desirability bias, excuse me.
- 39:41So that is one aspect of how the timing of polls can matter.
- 39:48Also, when something big in politics happens, there tends to be a short term fluctuation and
- 39:54then things steady back out.
- 39:56So if you see like a debate and, you know, we talk about who won a debate and when the
- 40:02consensus is, let's just say candidate A won a debate versus candidate B, there might be a
- 40:10short term boost to the support of candidate A after that debate.
- 40:17But then after a week or two, it'll level out and maybe candidate a says something stupid
- 40:22later on.
- 40:23Now it is true that a lot of voters have already decided well in advance of a general
- 40:29election who they will vote for because of the party ID.
- 40:31All else equal, most Democrats are gonna vote Democrat.
- 40:35Most Republicans are gonna vote Republican, and a lot of independents who lean toward one party
- 40:41or the other are going to ultimately vote for that party.
- 40:45However, you will still have a few people that will sort out who to vote for nearer to the
- 40:50election or closer to election time or if they even vote at all.
- 40:55You might have somebody who says, oh, yeah.
- 40:57I'm totally gonna vote for a Republican.
- 40:58Oh, yeah.
- 40:58I'm gonna totally vote for the Democrat, but they don't actually even go out to vote.
- 41:03And if they now if they were gonna go out to vote, they would have done what they said they
- 41:07were gonna do, but that doesn't really matter if you don't actually go out to vote now, does
- 41:12it?
- 41:13So that's another way that the timing of polls matters.
- 41:16Or also, there could be a major scandal in the lead up to an election that completely changes
- 41:22public opinion.
- 41:23Now some people are probably gonna hear that and say, well, you know, based on recent
- 41:28events, people can say what or do whatever they want and they won't get punished.
- 41:32That is not true.
- 41:33There's there's very few people that can make it through scandals.
- 41:37Now, however culpable they are, I'm not talking about that.
- 41:41But there are, yes, there are a few people that can make it through scandals.
- 41:45But by and large, scandals will tank somebody's prospects or at least members of their party
- 41:52might call on them to exit the race so that it doesn't rub off on everybody else.
- 41:58So, like, if if we have a republican that has a major scandal going on, the rest of the
- 42:06republican party might distance themselves and say, hey, you need to get out of there.
- 42:10And the same same thing for a Democrat just so it doesn't reflect on the rest of the party.
- 42:15And also early enough in election cycle, like, really early on, a poll could actually
- 42:21influence who even jumps into the race.
- 42:23So if if Joe Schmo has a really strong showing in a poll and he jumps in really early into the
- 42:30race and says, look at me.
- 42:31I've got 75% of the the the primary voters who that are gonna vote in primaries, they are
- 42:41going to support me.
- 42:42People might as well not even join or jump into the race.
- 42:46That could very seriously dissuade people from entering the race.
- 42:50I'll use actually an example from my state, Florida.
- 42:54So the consensus front runner right now is Byron Donald, who is currently a Republican
- 43:00member of the US house.
- 43:02He is running to succeed Ron DeSantis here in the state of Florida.
- 43:06He has the backing of Donald Trump.
- 43:08He has pulled pretty well for the for the most part, and that has possibly dissuaded some
- 43:16candidates from ultimately jumping into the race, namely Casey DeSantis, who is Ron
- 43:21DeSantis' wife, and Jay Collins, who is the current lieutenant governor of Florida.
- 43:26I'm not saying that that's definitely why they haven't said they're jumping into the race.
- 43:30They haven't said that they're not, but it could be part of the calculus.
- 43:35Now there are other candidates who have jumped into the Republican primary for governor, like
- 43:41Paul Renner, who used to be the speaker of the state house, and James Fishback, who has some
- 43:48controversies going on right now.
- 43:50He is another candidate that is running for the Republican primary for governor in Florida.
- 43:58But all that to say, Byron Donald's strong showing and polling may have at least convinced
- 44:04a few Republicans who might have otherwise jumped in readily to at least hem and haw about
- 44:09whether they're going to jump in.
- 44:11So that's another way that the timing of polls very much matters.
- 44:15And, ideally, you want multiple polls across time to showcase a trend because that's more
- 44:20information than just having one election.
- 44:22So if you're seeing one candidate's numbers trend up, up, up, up, up every so ever so
- 44:29slightly, that'll look very good for that candidate as opposed to if you just had one
- 44:34poll for them and you couldn't really tell how much that was fluctuating before and after.
- 44:40So all sorts of ways that the timing of polls can matter as well.
- 44:45But you should always take them with a little bit of a grain of salt if they're really early
- 44:49on as a in in terms of who is going to win a race.
- 44:56Because again, once again, we get too caught up in the, oh, who's winning this race?
- 45:01Polls are not meant to be predictions.
- 45:02They're meant to be snapshots in time of what public opinion is as best as we can estimate
- 45:07public opinion.
- 45:09Now one last thing before we get to the end here is a term you may have heard that is very
- 45:16nebulous, and it's called a likely voter.
- 45:18What is a likely voter?
- 45:20Lots of polls use the likely voter metric to gauge who is going to actually turn out to vote
- 45:29in election.
- 45:30Because if they're not gonna turn out to vote in election, that's it's you can't really rely
- 45:34on their opinions to affect who actually wins the election.
- 45:38If you don't vote, you can't have any influence on the election.
- 45:42So some some pollsters will use registered voters instead or voting age population.
- 45:48But, generally, if you're trying to really figure out who's going to win an election,
- 45:54you're probably going to use likely voters.
- 45:56Now, likely voter is probably going to be self explanatory, but it's just someone who is
- 46:01expected to vote.
- 46:03And the way you calculate that is you base it on past voting history primarily because that
- 46:10makes whether you vote this time or not fairly predictable because the best indication of
- 46:17whether somebody is going to vote is if they voted previously.
- 46:20Now, obviously, there's new voters who have only just gotten old enough to vote that you
- 46:25can't necessarily gauge like that.
- 46:27But people who are older voters who have at least had several elections that they could
- 46:31have voted in, if they voted before, it's very likely they're going to vote again unless
- 46:37there's some sort of unforeseen circumstance.
- 46:39And presidential elections will have the highest turnout rate of the major types of
- 46:45elections, and that is midterm elections, odd year elections, special elections.
- 46:50Presidential election is gonna be the highest, and then midterm elections are gonna be the
- 46:53second highest.
- 46:54There will be some fluctuation in the percentages like you might have depending on
- 47:00your your metric, you might have 65, 70 for presidential elections, but then you might have
- 47:09only, like, fifty, fifty five, 60% for midterm elections.
- 47:14Just as a just as a general rule of thumb to compare the two.
- 47:17You won't necessarily see those specific numbers, but there'll be a little bit of
- 47:22fluctuations between presidential elections.
- 47:24There'll be a little bit of fluctuation between midterm elections, but generally speaking or
- 47:30not generally speaking, you'll always see higher turnout in presidential elections versus
- 47:35midterm elections.
- 47:36And so if somebody votes in midterm elections all the time, they're almost guaranteed to vote
- 47:43in the midterm election this coming time because 2026 is a midterm election.
- 47:47If they vote in presidential elections, but they don't vote in midterm elections, it's
- 47:52gonna be hard to rely on them to turn out for this coming midterm election.
- 47:56So those are a couple of ways that you can gauge likely voters, but maybe you want a more
- 48:02specific formula.
- 48:04What is the specific formula for telling who a likely voter is?
- 48:08There's not an exact formula.
- 48:10I am sorry to say.
- 48:12It's there's a little bit of nuance to it just like there is for most things in politics.
- 48:16Every pollster though has their own super secret calculation for it that they don't
- 48:21release.
- 48:22It's under wraps.
- 48:23It's proprietary.
- 48:24But the best indication of whether you will vote is your past history of voting.
- 48:29But what if that voting history is murky and inconsistent?
- 48:35Well, again, that depends on the pollster's internal formula, but they may consider
- 48:40likelihood of voting based on other opinions they gave in the poll.
- 48:43So if there was a question that explicitly asked how likely are you to vote?
- 48:48They might use that to say, oh, okay, this person is a likely voter.
- 48:51Now, again, that's pretty tricky to use because somebody can say that they're very enthusiastic
- 48:56about voting now, but then ultimately, they don't actually turn out to vote in the end,
- 49:01especially if this is months from now that this election is happening.
- 49:06So anybody can tell you, oh, yeah.
- 49:07I'm enthusiastic about voting, but that doesn't necessarily mean they're gonna vote.
- 49:10They might be enthusiastic right now, or they might think, oh, I should say I'm enthusiastic
- 49:15about voting.
- 49:16Or what if you tweak the question there?
- 49:20Because tweaking the the wording of questions can make all the difference in the opinion.
- 49:25If you ask how enthusiastic somebody is to vote versus how likely they are to vote or are you
- 49:32looking forward to voting, they might not sound like that different of a question to you, but
- 49:37it really can make all the difference in how people respond.
- 49:41Other examples of public opinion or or other answers they give in these public opinion
- 49:48surveys that people could use to measure likelihood or a likely voter is they might
- 49:55indicate a strong opinion on a political issue that pollster expects to be a critical
- 50:01flashpoint in an election.
- 50:03So if they expect abortion to be a key issue for the election and a voter who is otherwise
- 50:11not that consistent of a voter, but they signaled a strong, I am a very firm supporter
- 50:17of abortion, I'm a firm opponent of abortion, they might say, Okay, that person's actually
- 50:24probably going to turn out to vote this time because that's expected to be a very key issue.
- 50:29And they also might use demographic info that they think will play a role for various
- 50:33reasons.
- 50:34So if there's younger candidates in election that are 35, 40 years old, then the pollster
- 50:42might expect more younger voters to turn out to vote even if they don't normally turn out to
- 50:46vote or they've they've just become a voter for the first time.
- 50:51Again, there's not an exact formula, and these organizations are not gonna tell you their
- 50:55exact formula.
- 50:56They're just gonna say, oh, these are how many likely voters we polled, but you can't get the
- 51:01exact way that they got to likely voters.
- 51:05And then to wrap things up with the likely voters, when should we consider unlikely
- 51:10voters' opinions?
- 51:11And that's a very tricky question to answer because it depends on what a pollster's
- 51:15intention is, not just because of the past voting history of these unlikely voters, but
- 51:22when do you even want to know these unlikely voters' opinions?
- 51:26If a pollster simply wants to know the general public opinion or they want to win an election,
- 51:32but they think he can get irregular voters to support their candidate, then they might start
- 51:36looking at registered voters in general or voting age population to say, okay.
- 51:42I think these people who are not registered to vote or people who are registered to vote, but
- 51:47they don't vote very often, I think we can get these people.
- 51:50And every once in a while, you do have a candidate who will do that.
- 51:54Donald Trump was adept at getting a lot of first time voters.
- 51:57So was Barack Obama when he ran for office.
- 52:00Two key examples there.
- 52:01Now those are exceptions to the rule.
- 52:03If people don't vote, they're likely to continue to not vote.
- 52:07But you every once in a while will get a candidate who sparks something in these people
- 52:13and they go, you know what?
- 52:14I'm actually gonna turn out to the polls.
- 52:16But, that depends on what the pollster's aiming for, what they think is important, what their
- 52:23formula is.
- 52:24So there's really no clear cut answer there.
- 52:27So to wrap things up, key message here is always have a little bit of skepticism about
- 52:33polls, but not too much because like most things in politics, it's always good to have
- 52:39skepticism, just a little skepticism about polls.
- 52:43Problem is people become too distrusting of polls because they don't understand them, and a
- 52:51lot of times when we don't understand something, we don't trust it.
- 52:54Or politicians that we support were mad about a poll that made them look bad, and so we say,
- 52:58Oh, yeah, that poll sucks.
- 52:59Oh, all polls suck unless they conveniently support or make the candidate I support look
- 53:05good.
- 53:05But that's not the way we should be looking at them.
- 53:09And I know polls are not fun to read into for most people.
- 53:13I mean, I don't even always like reading them.
- 53:16I mean, as much as I thoroughly enjoy learning about and discussing about politics and and
- 53:22bringing that information to people, I don't necessarily like getting into the very nitty
- 53:25gritty of polls either.
- 53:28But you should try finding somebody who tries to go a little deeper into polls and tries to
- 53:34be balanced in our analysis and tries to break it down as easily as they possibly can because
- 53:39it it is something worthwhile for you to to at least learn a little bit about so that you
- 53:46don't just get caught up in whatever media tells you about these polls.
- 53:51Some polls are are not that important, and some polls get overblown, and then some polls get
- 53:58criticized way too much.
- 54:00Just remember, polls have an inherent uncertainty about them because you can't get
- 54:05the entire population's opinion.
- 54:06You have to sample them.
- 54:08But it does not mean they are inherently unreliable.
- 54:12You just have to know what you are doing with them, how to use them, how to interpret them so
- 54:18you don't get taken for a ride by media who have a either an axe to grind with polls or
- 54:25they just talk about polls as if all of them are interesting or matter just so you can equip
- 54:33yourself better to have better discussions in political discourse.
- 54:38That's gonna wrap things up for today's episode of the Politics with Paul Podcast.
- 54:42Thank you all so much.
- 54:43Please like, comment, share, and subscribe on YouTube, Spotify, and Apple Podcasts.
- 54:48And in the future, if this expands out to other platforms, Please like, share, comment,
- 54:55subscribe, rate, review.
- 54:56My links in the show notes, my five day educational email course about how we can all
- 55:01better do better in depolarizing politics in America because sometimes we unintentionally
- 55:08inflame that polarization.
- 55:09This EEC educational email course talks about ways that you can be better about doing that,
- 55:16how to correct those mistakes.
- 55:17My LinkedIn profile that I write on very frequently, my facebook.com profile, Paul
- 55:24Raider author and speaker, medium.com profile, email PaulRaiderWritesgmail dot com, my website
- 55:30paulraider.org, and my book on Amazon about political independence and why they struggle so
- 55:37much in elections and how that could possibly change in the future.
- 55:41And that is going to end things here.
- 55:43So thank you all so much for listening, and we'll see you next time.