Latest / Psychology In Seattle Podcast / Personality Tests for Hiring (2017 Rerun)
Transcript
- 0:00So Berto, have you ever taken a personality test or some other kind of
- 0:05test in order to get hired or at your job? You know, you're
- 0:10you're applying for a job, and they they in addition to interviewing you,
- 0:14they make you, you know, complete this personality test to see like how
- 0:19screwed up you are? Have you ever done that before? You know,
- 0:21not as part of a job interview. I've certainly done personality tests before with
- 0:25you. I've submitted you to a few, subjected you to submitted me.
- 0:32But you so you've but you've done them at work as a part of like,
- 0:37oh yeah, I've done that as part of training and things like that,
- 0:40but not as part of a job interview. I've training what do you
- 0:43mean training? There were classes that I took where it was how to communicate
- 0:47better, things like that, and then so part of the class was like,
- 0:50Okay, you're going to take this personality test and we're going to talk
- 0:53about how to work with different kinds of personalities. But you've never been tested
- 0:57as a part of being hired, not that I can run. Okay,
- 1:00Well, that's what I want to talk about today, because you actually asked
- 1:03that we talk about this Yeah, but I've had a lot of jobs,
- 1:06so I might have forgotten. Yeah, that's true. I'm surprised you haven't
- 1:08had a job as a tester of personalities for hiring. Actually, well in
- 1:14the future. Yeah, well, that's what we're going to talk about today.
- 1:15We're going to talk about the widespread use of psychological testing for hiring and
- 1:23the debate about it, because there's a lot we can say and there's a
- 1:26lot of research on it. This is the Psychology in Seattle podcast. I'm
- 1:30your host, doctor Kirk Honda. I'm a therapist and a professor. Who
- 1:34are you, Berta. My name is Sumberto. I am in a Bare
- 1:38Naked Lady's tribute band. And could you give us a little taste of your
- 1:46your stylings. Chicken, the Chinese Chicken. You have a drum stick and
- 1:49your brain stops sticking. So I heard that you used to think that was
- 1:53like legit hip hop back in the day. Yeah, you're outing me.
- 1:57There was a time. I mean, keep in mind, it's this from
- 2:00the seventies, sixties. Yeah, way back. Wait. Wait, there
- 2:04was a time where I wasn't as exposed to a good hip hop, good
- 2:07rap. So I grouped that together with like, oh, yeah, have
- 2:12you heard of NWOI sure, have you heard of bare naked ladies? Oh
- 2:19my goodness. Okay, So I have actually taken some tests too at work.
- 2:27This was long ago. I remember taking a Myers Briggs test in the
- 2:32mid nineties when I was before I was a therapist. I was working at
- 2:37a group home for troubled youth and we all took a Myers Briggs and I
- 2:44remember we all sat around as staff trying to learn how what the results meant
- 2:51regarding our style of work and what our strengths and weaknesses were and whatnot.
- 2:55Is the Myers Briggs the one that does like NTJI and yeah, that's yeah.
- 3:00So I did that one for work again, not to get hired,
- 3:04but as part of a training, and we were doing it in order to
- 3:07learn about different personalities and how you might relate differently to them, and yeah,
- 3:12stuff like that. And I remember also taking another test when I before
- 3:16I even wanted to be in psychology, I was in marketing and business for
- 3:23a very short amount of time. That was my bachelor's degree was in business
- 3:25and marketing, and I had a job as a as a researcher, researching
- 3:31assistant really at a hospital in Kirkland actually kind of by Whord, just across
- 3:37the freeway from where you're ever Evergreen, Yeah, Evergreen Medical Center, and
- 3:44they had all the employees do a very extensive personality test and I still have
- 3:50it somewhere in my closet, and it it was it had like several different
- 3:54domains that it measured you on, and I remember having really no idea why
- 4:00I was doing it or how to interpret the results. I just remember thinking
- 4:04like, what is I just remember being very boggled. My twenty three year
- 4:10old mind was just kind of boggled as to why are we doing this and
- 4:13what's the purpose? But I kept it. I still have it, and
- 4:16I should I should bust it out. How many workers in the US are
- 4:20are being assessed currently? Do you think you know? When I ask tests
- 4:24or any tests, whether for hiring or Oh wow, that's a great question.
- 4:30I would say ten million percentage? Oh so twenty percent, sixty percent,
- 4:38sixty percent? What percentage of new hires at Fortune five hundred companies have
- 4:43been given the MBTI in the past decade? This's the Meyers Bridge. Yeah,
- 4:48okay, well, according to that, I'll say fifty percent, eighty
- 4:51percent, eighty yeah percent. Yeah, so that's new hires. So those
- 4:58are I mean from the language that I was reading, it's after you have
- 5:02been hired, they give you the Myers Bridge as a way of trying again
- 5:08to help you fit in better or learn your strengths of weekends. So that's
- 5:12shocking. How much money per year does this industry make? What you know,
- 5:17there's Myers Briggs, and there's like a ton of other kinds of assessments,
- 5:20and and there's firms that specialize in providing these assessments for people. How
- 5:28much money in the United States? Do you think a billion dollars? Half
- 5:31that? Half a billion a year? And how fast is it growing each
- 5:36year in terms of the revenue. It's growing per fifteen percent? Oh awesome,
- 5:44between ten and twenty percent. Wow, I think you just nibbled there.
- 5:47Do you know about any laws that pertain to the use of tests in
- 5:50the workplace? Laws? Oh? Well, yeah, you probably can't.
- 5:56It probably has to be anonymized. And if you probably can't use results,
- 6:00oh you know, okay, it's not true. Well you probably can't use
- 6:03how it work if it was anonymized. Well, I guess what I mean
- 6:06is other workers probably can't just access someone's results. They can They can't.
- 6:13They can't. Yeah, I mean it's not it's not a medical it's not
- 6:15medically protected information. It's it's like your resume or when you get interviewed,
- 6:23when the interviewer jots notes down in terms of your responses, that's that's total.
- 6:28That's not private information. I guess you're right. From a legal standpoint,
- 6:31I was thinking, I mean, if you're harmed by if you know,
- 6:34if Microsoft does some test on someone and releases it publicly and that person
- 6:40is harmed by that, then then you can sue them. But but there's
- 6:44no, it's not medical. It's not patient health information like the like,
- 6:47like the way it probably should be controlled. Okay, well, for one
- 6:50thing, you probably cannot discriminate against people based on the results of the test.
- 6:55Well, we're going to get into that. Actually in terms of well,
- 6:58what can't they discriminate? Isn't that the whole point. You're trying to
- 7:00discriminate between a good hire and a bad hire. You're trying to discriminate between
- 7:05someone who's going to be good for the job and someone who's not going to
- 7:08be good for the job. That's the whole point of the test. Ouch.
- 7:11Okay, okay, okay, wow, so okay, can you definitely
- 7:15not segment it by race or well gender? Yeah, but the well,
- 7:21so the tests don't ask for that. The tests don't ask what is your
- 7:26gender and what is your race? But I could see that I could see
- 7:29a non ethical company asking those additional questions and then sorting, well, they'll
- 7:33know based on other kinds of things, either by face to face or other
- 7:40kinds of demographics that they ask for or just yeah, but what if they
- 7:44were doing things like, Okay, we're going to track how many women are
- 7:46different personality types compared to how many men and how compared to by race?
- 7:50Yeah? So yeah, but no, you know, that's not it's not
- 7:56against the law, and we'll get more into the specifics on that because it's
- 7:59a little But is anything illegal. Well, so, there's two main laws
- 8:03that pertain. One is that you can't discriminate against people who have disabilities.
- 8:09And so if someone has major depression and the test reveals that, and you
- 8:15don't want to hire someone who's depressed because you're worried about their job performance,
- 8:20then you have discriminated against based based on mental illness. Does that Does that
- 8:26make sense? Like, you can't you can totally discriminate based on subtle differences,
- 8:31but large differences are out. Well. Yeah, Another way of putting
- 8:35it is, there are symptoms of depression that a lot of people, a
- 8:39lot of employers will use as indications as to whether or not someone is someone
- 8:46they should hire, for instance, how motivated they are, how much energy
- 8:52they have, how productive they are. Well, if if you're depressed,
- 8:56you know you're you're you're gonna you're not You're gonna have less motivation, you're
- 9:00gonna have less self esteem, you're gonna have less energy, you're going to
- 9:05be tired a lot, you're going to miss work, maybe more often than
- 9:11other people. And so but and they say, but it's considered a disability
- 9:16in the same way that you can't discriminate against someone because they can't walk or
- 9:20they have trouble with their hands. Well, the analogy would be if somehow
- 9:28you could if someone walks in with a limp, you could discriminate against them,
- 9:31But if they walk in missing a leg, you have to hire them.
- 9:35Yeah, Well, I think it's more complicating that, of course,
- 9:39of course. But but seriously, It's interesting because a lot of times they
- 9:43might say, like, aw, they show some symptoms of maybe lacking motivation.
- 9:46I don't think I want to hire them. But then they might say
- 9:48like, oh, no, this person's fully clinically depressed. It's right,
- 9:52Oh okay, we have to hire them, right right, right, So
- 9:56now it gets into proving that. So someone would have to sue, and
- 10:01then the court would have to determine if the employer actually discriminated purely based or
- 10:09mainly based on, or at least partially based on the fact that you have
- 10:11this quote unquote disability instead of general terms like well, we determined that this
- 10:18person wasn't really fit for the job as well as other people because they seem
- 10:22to be not a go getter, they didn't have self initiation or what do
- 10:26they call what do they call those? I love a lot of the business
- 10:28terms. Another law that pertains it was an act, a federal act passed
- 10:35in nineteen eighty eight. That's the Employee Polygraph Protection Act that basically prevents employers
- 10:41from using the polygraphy because they were most polygraphed. This is something I'd learned
- 10:48in prep for this episode, was most polygraphs in the seventies, sixty seventies
- 10:52and eighties were not for criminal proceedings or criminal purposes trying to determine if someone
- 10:58had committed a crime or something. It was to determine if what sort of
- 11:03person someone was in terms of hiring them. They would use them in jobs
- 11:07interviews. Yeah, they would say, you know, have you ever embezzled
- 11:11money from your other jobs? Have you ever cut corners at work or something?
- 11:20And actually, now that I think about it, my friends who became
- 11:24police officers, they have. They I don't know if they still do,
- 11:28but in the past they had to pass a polygraph themselves. Are polygraphs reliable?
- 11:33No, absolutely not. They're well, I think what you mean is
- 11:37valid. No, they're not valid. Measures there They've been debunked a billion
- 11:43times over. You can one trick them because it's all based on it's trying
- 11:48to guess if you're lying based on your physiological what do you call it reaction?
- 11:56I suppose so like a psychopath might not have an issue with right,
- 12:01or you might just be really good at remaining calm as you lie, especially
- 12:07if you learn how to do that, because there are techniques that you can
- 12:11follow that that make it, so you don't do that. Plus, false
- 12:15positive lies are when you get asked a question even though you're not lying,
- 12:20but you're but you're kind of worried that you're gonna be seen as lying.
- 12:24Then your body might have a reaction, especially if you're strapped up to a
- 12:26device. Yeah, and you're just like, oh God, I hope my
- 12:30body doesn't freak out because that will indicate I'm lying in it. And science
- 12:37has debunked polygraph. Now, what we've talked about in other episodes is the
- 12:43general public doesn't know that, and so I police and lawyers will sometimes use
- 12:48polygraph basically to trick people into telling you the truth. So they'll say,
- 12:56well, so you're saying you weren't there on the night of blah blah blah.
- 13:01Care to do a polygraph on that, you know? And if the
- 13:03person's like, fuck you, I did it, you know what I mean?
- 13:07Or or they do the polygraph and you tell the the person administering it
- 13:13to lie and say they didn't pass it. And then and then this,
- 13:18you know, the subject in question is now sort of pressured into settling or
- 13:22something, you know, a plea deal or something. It's like, look,
- 13:24we got a polygraph that you failed it. So I don't know what
- 13:28to tell you. And the guy's like, crap, they caught me,
- 13:31you know. Whereas if you're like, what, how did that happen?
- 13:35I wasn't lit you know what I mean? That's sort of a litmust.
- 13:37Anyway, What are assessments used for percentage wise? Between post in, post
- 13:46hiring and pre hiring? What are assessments used for? So like, how
- 13:50of the assessments being used in the workplace? What percentage are used to hire
- 13:56someone as opposed to helping you at Oh okay, okay, oh okay,
- 14:01that's a good one. I'd say so it was sixty percent eighty percent of
- 14:05the work I would say fifty to fifty not bad. It's it's about twenty
- 14:11percent are used for hiring and rest, so the vast majority are used for
- 14:16after. That's actually more encouraging. Yeah, okay, So the basic method
- 14:22that this follows that I read, which makes sense, But because when I
- 14:26hear about testing, what popped in my head was all they do is they
- 14:31just give this personality test and they just hire based on that. And that's
- 14:33not how it goes. It just works it they work it into all the
- 14:37other normal ways. So you get the resumes, you whittle it down.
- 14:41You interview, you whittle it down. You you administer the assessments, you
- 14:46whittle it down. You have another interview, you whittle it down. Maybe
- 14:50even there's an observation like, you know, show me your work or do
- 14:56your thing, or you know, perform mikey, build a build a house
- 15:01for me, you know, and the guys like, I'm a programmer,
- 15:03Why am I asking to just do? And then once all those things are
- 15:09done, you consider everything. So the assessments aren't like a do or die
- 15:13situation, right, you know, it's like it's part of the bigger picture.
- 15:18All right. So here are some of the claims and services that I
- 15:20read online. Uh and I love all the all the business speech that they
- 15:26give. But here's a quote the Hogan. It's a Hogan organization. The
- 15:30Hogan Archive contains case studies demonstrating ROI or return on investment, across virtually every
- 15:37industry for nearly all job titles. Listen in the US Department of Labor's Occupational
- 15:43Information Network unquote what's wrong with this claim? Were you listening closely? Who?
- 15:50It seems biased? Yeah, Well, it's so there, it's on
- 15:54their website, so they're obviously saying they're basically saying that there's there's proof of
- 15:58return on investment, you know, because that's the that's the big thing for
- 16:02business, right, that's how they sell their If you're going to pay for
- 16:04a service, is there a return on investment? So you know, because
- 16:08the whole thing is all dollars and cents, right, It's like, Okay,
- 16:11if I'm Microsoft and I'm going to hire Hogan to test all of our
- 16:15applicants and it's going to cost a million dollars, are we going to make
- 16:18two million dollars or save two million dollars as a result of that? And
- 16:22they're saying, so I'll read it again, and when you hear it,
- 16:26it'll it'll it should pop out to you. The Hogan archive contains case studies
- 16:30demonstrating ROI across. Did you hear it? Yeah? What is it?
- 16:36Well, the Hogan archive there archive there are chives contained studies. Well,
- 16:41it's I guess it's case So maybe you're not familiar with research terms, but
- 16:48case studies are not they're they're not necessarily valid because they are one or two
- 16:55cases. Yeah, essentially they could be cherry pick. It's the thing,
- 16:59and they're not in order to like, hey, this guy right, essentially
- 17:04an anecdote right of one person. Now, research case studies are a valid
- 17:08way of researching things, especially when it's a complex thing, like like you
- 17:15want qualitative data about a sequence of things. Yeah, but of course if
- 17:21you're a business, you're probably gonna choose the case studies that we do that
- 17:23in in my in my job because you know, when we go perform our
- 17:26bare naked covers, we do case studies with the audience members, Yeah,
- 17:32to see how they react throughout the set. Right, we have case studies
- 17:33that prove that we have one hundred percent likability. It just so happens that
- 17:40we ask people who who liked us, and we go up to them and
- 17:42we we and we have to ask them to fill out a survey and with
- 17:45there it's a one percent ability. The other thing is is I don't know
- 17:49how you would measure return on investment on a service like this. I mean
- 17:53imagine the factors involved, right, Like you have Microsoft one year not doing
- 18:00any personality assessment, and then the next year you have them doing personality assessment.
- 18:07Well, are across all departments, right, and then you track the
- 18:11individual contributions for that year from those people compared to the ones that were already
- 18:17there. Yeah, and not counting for cross pollination somehow, yeah, or
- 18:21the economy, you know what I mean, Like, there's too many factors,
- 18:26so there's there's there's no way to but you could, supposedly or not
- 18:30supposed to. I could imagine you could follow a number of people randomized over
- 18:33an amount of time and see if over time they perform better or worse,
- 18:38or if they how do you define perform better? I mean only based on
- 18:42the companies definitions themselves, right, But that's a hard thing to measure,
- 18:47right. It's usually based on managers rating their employees totally. I'm not saying
- 18:52that it would. It might not mean anything in the real world. But
- 18:55if you could tell, hey, Microsoft, we ran a Microsoft specific study
- 19:00with you know, tracking one hundred individuals over the last three years blah blah
- 19:03blah blah blah, and using your ratings, these performed better on your terms,
- 19:08yeah, they then Microsoft might be like, oh, that's interesting,
- 19:11right. Yeah, here's another quote. Our assessments have never been legally challenged
- 19:15in court. That's the scary quote. Here, imagine you're advertising your services,
- 19:23right, Hey, come to eat my hamburgers. I have never been
- 19:26sued for killing anybody. Yeah, yeah, I've never been successfully sued for
- 19:36killing anyone with my hamburgers. Here, here's another one. Get a clear
- 19:42blueprint of a candidate's key natural behaviors and talents. So, get a clear
- 19:48blueprint of a candidate's key natural behaviors and talents. Natural behaviors, that's interesting.
- 19:56Determine exactly how these traits fit with your open position exactly. Yeah.
- 20:02Zero in on areas where there's a mismatch, where the candidate will likely face
- 20:06challenges and maybe even failure. Determine realistically if weaknesses will respond to training or
- 20:12coaching, or if they simply must be accepted as is. Predict job performance,
- 20:19evaluate career career derailers like career careers. Identify and mitigate performance risks that
- 20:29can degrade leadership success erode relationships, and damage professional reputation. Identify potential,
- 20:36find and develop your organization's next generation of top talent. So there's all that,
- 20:41you know, kind of business speak, I guess, you know,
- 20:44like if you can imagine if they embed themselves pretty deeply in a vertical,
- 20:48and they really know what that vertical is all about, what historically is successful,
- 20:53what kind of people bubble, and then they follow that for a while.
- 20:57You could imagine them having some good data, but broadly speaking, it
- 21:02seems intractable. Well, right, So that's the science is if, for
- 21:07instance, Microsoft, you identify exemplary employees and not even and you'd have to
- 21:14go even deeper, like we're going to be looking at developers and maybe even
- 21:18a specific type of developer, right right, So, because every job requires
- 21:22a different set of skills, maybe, but you take all of your employees
- 21:30and you identify the best ones, which is an arbitrary thing. It's like
- 21:33who evaluates that Again, it's probably usually managers, and it's probably people that
- 21:38they just sort of like better, you know, And then you test them
- 21:42and you identify their personality type and you average that out, and then you
- 21:48look for employees that you look for applicants who match that, and of course
- 21:52that could lead to a self fulfilling culture, which could be toxic. It
- 21:56could not be the thing that you need to survive in the next decade.
- 22:00And totally Now, of course, people who hire will say, we think
- 22:04about all that stuff. We try to We don't just blanketly hire someone if
- 22:10their personality thing and to me it again. At first, when I thought
- 22:15about this, I was like, this seems kind of bullshit. It's like
- 22:18using psychology tests from people who don't really know how to use them to hire
- 22:25people. It seems really stupid. But what alternative do we have? You
- 22:27know? You right now the state of affairs is. Isn't better than that
- 22:33you ask a few random questions and then you make some gut field decision.
- 22:38Yeah, you look at a resume, you have some interviews, and then
- 22:44so that you know, and that's based on them, and they're they could
- 22:48fake it, you know, and they provide references to you that they want
- 22:52you to call, and you, as the observer, your team has to
- 22:57figure it out and as a per person who you know, hires people At
- 23:02Antioch, I've hired many professors and I've also interviewed people for the program.
- 23:07So so I've interviewed hundreds of students to get into the program, and I've
- 23:12probably interviewed I don't know, dozens of professors who are applying to Antioch to
- 23:17work there. And I can tell you that it is it is so hard
- 23:22to figure this stuff out. I have hired this is long ago, fifteen
- 23:27twenty years ago or something. I hired someone I was on a committee that
- 23:32ended up hiring someone that was awful, that was like one of the worst
- 23:37worst coworkers I've ever worked with, and everyone agreed. And to this day
- 23:41there are people who like hate me because or not hate me, but they're
- 23:45like, Kirk, weren't you on that person's hiring committee? And I'm like,
- 23:49God, damn it. And but that person seemed perfect, their resume
- 23:56was stellar, they interviewed so well, they said, everything just right,
- 24:00but their real personality it doesn't come out. And what if we had a
- 24:06personality test. I wonder if that would have helped. You know, I
- 24:10don't know. I mean it might, but there's still so much. I
- 24:15look, I have worked with people in different jobs. I've worked with people
- 24:18that have severe vertical like personality weirdnesses. When you say vertical, what do
- 24:26you mean, but I mean like pick one category and go deep on that
- 24:30and so, like you know, examples would be someone who really does not
- 24:34do well in groups, someone who cannot speak up, cannot speak their mind,
- 24:41stuff like that, right, or the other extremes. Someone who cannot
- 24:45be quiet or cannot like, you know, sort of self regulate, right,
- 24:49but the output has sometimes been so valuable, right that you you know,
- 24:56right, So different jobs require different skills, and no one's perfect,
- 25:00and so we're the sacrifices. Of course, everyone would want everyone to be
- 25:04perfect in all areas, but of course no one's liked that. And actually,
- 25:11what I ended up resorting to was something that Paul David, my predecessor,
- 25:17did, and I followed his lead, was that I would always hire
- 25:22people that I knew or that I knew who knew them. Of the instructors
- 25:29we hired in the CFT program in the last year, something like five or
- 25:33six people, and all of them I know either personally very well or I
- 25:41know someone who knows them very well, and I grilled them. I was
- 25:45just like, so, you know, do you recommend that person? Oh?
- 25:48Yeah, she is the best. Need I really need you to tell
- 25:52me honestly, because I don't want to make a mistake here. Oh yeah,
- 25:56she's the best. If you had one bad thing to say about her,
- 26:00what would it be? And you know, they're well, I don't
- 26:03know, maybe this or that you know, Tell me more, tell me
- 26:06more. I need to know this, you know, because if this is
- 26:10a bad hire, I'm gonna come after you. You know. And the
- 26:14people that we hired are and my At my university, we have several programs,
- 26:19we have, you know, six or seven programs, and to my
- 26:22observation, my program is the only program that hires like that. We're the
- 26:27only program that, at least to the extent that we do. Everyone we've
- 26:33hired has been has been people that along those lines, you know, or
- 26:38students who graduate. I mean, I'm a student from the program and Paul
- 26:42hired me right after I graduated, So I'm I'm a typical example of that.
- 26:48And whereas other programs they do it the normal way. Yeah, they
- 26:52put out a national search, because that's the typical university model. Is not
- 26:56international searches, especially in psychology programs, you know, because you got to
- 27:00pull from talent all over the country, all over the world. And what
- 27:03ends up happening. I've just seen these processes fail. Oh. Either one
- 27:10they hire the totally wrong person, or they hire someone who's great but doesn't
- 27:15have any loyalty and quits after a year after you've invested. The thing about
- 27:21university hires is these are long term jobs, right you are. I was
- 27:26considered the new guy, even though I had been there fifteen years. Oh
- 27:30wow, you know, especially back in the day. Now there's a lot
- 27:33of new people at Antioch. But how many years have you been there?
- 27:37I've been there since I've been teaching since ninety seven, so it's twenty years.
- 27:41Wow. In fact, it is exactly twenty years this month, like
- 27:48this week, this week, it is exactly twenty years. Oh my gosh.
- 27:52When I met you, you'd already been there almost a decade. Yeah.
- 27:55Wow, yeah, yeah, yeah, I've been there a long as
- 27:57time. I mean, Paul hired me when I was twenty six and knew
- 28:03nothing, you know, I was such a green I felt like I knew
- 28:08less than my classmates, did you know. And I don't know why he
- 28:14hired me, honestly, but and it's just been a slow climb since then.
- 28:18But the point is is what I'm saying here is when I know someone
- 28:26very well, like I last year, I hired a student who was in
- 28:33my class for like two or three years. I knew her extremely well,
- 28:37and then she applied and I was like, I know this person so well,
- 28:44we don't need to interview this person I know that, you know,
- 28:47that's I. And then there are other people that actually will apply who I
- 28:51know very well, and I won't hire them, you know, because like
- 28:53I don't think that's because you know, right, and so, so I,
- 28:59as a personality assessor, will work that into my evaluation process. But
- 29:03it's based on personal experience, you know. I've always felt that if you
- 29:08can do it a program where you can let people do the job for a
- 29:14bit and then decide, well, they call that probation, yeah, which
- 29:18is never really followed. Do you know what I mean? Well, it
- 29:23does work in some industries where you have things like contract work in the full
- 29:27time contract yeah, yeah, because then what you do I mean, this
- 29:32used to be the case in one of my old jobs, is you would
- 29:33basically just have a low barrier to entry for a contract job. You'd still
- 29:37interview and stuff like that, but it wouldn't feel so final, you know,
- 29:41It's less of a commitment. Yeah. And then and then if they
- 29:44weren't working out, there was no agreement, like you could let them go
- 29:47in two weeks, right, and granted that would sucket, but it was
- 29:49still way better. And then at some point you're like, you know what,
- 29:52we have an opening for a full time position, and then this person
- 29:56has been proving themselves, right, so there's pro to that that. The
- 29:59con with that is it creates this massively oppressive system for the contract worker in
- 30:04which they are basically required to do better than their peers by working eighty hours
- 30:14a week and sacrificing their family for the job. Right, And you know
- 30:19it's it's it's unfair, and it's it's basically anti labor. Do you know
- 30:25what I mean it? Right? Okay, so let's talk about the measures,
- 30:30the different tests that are used in employment. After the break, what
- 30:34do you say? Let's do it all right, we're back from the break.
- 30:41If you haven't become a patron of the podcast, do so now by
- 30:45going to patreon dot com. We always love it when people become patrons of
- 30:48the podcast. When you become a Patreon, you get access to all of
- 30:52our deep dives into various different things, our secret episodes, of which probably
- 30:57we do about every week. There's probably a patron only episode, maybe every
- 31:03other week. Okay, let's get into the measures. So there are four
- 31:07different kinds of measures that are used. Can you identify those those different categories
- 31:12of psychological tests that are use emotional intelligence. Yeah, I mean that's well,
- 31:22well, is it more manular than that? Or no, it's bigger
- 31:25than that. Oh it's bigger than that. Okay, well maybe in a
- 31:29sense I don't know. Okay, So interpersonal relationships or like how you get
- 31:33along with others. Yeah. Yeah. And then so those two that you
- 31:38just said, we're gonna put under what we call personality tests. Oh so
- 31:42those are all under the umbrella of personality testing. Oh okay, so intelligence
- 31:47testing. Yeah, so cognitivebility is number two. Okay, So there's personalities,
- 31:52there's cognitive there is maybe an adjustment or like, uh, that's personality.
- 31:57Is this still personality? Oh? Maybe how you deal with stress?
- 32:04Is that still personality? Yes? Still personality is the left. Well,
- 32:08there's components of personality that maybe you're thinking are not categories among themselves. But
- 32:15the other two categories are, and they call them integrity tests, which are
- 32:21to see how honest you are and how how likely you are to embezzle from
- 32:25the company, essentially I see. And the other one are clinical measures of
- 32:29psychopathology, which are sometimes which are sometimes I could see that under the site
- 32:34of the personality umbrella. But we're going to bust those out kind of their
- 32:37own category. So let's talk about personality measures first. There are many different
- 32:43ones that are used the Caliber profile. There's a California measure, the PAI
- 32:50Gallop Strengths Finder that that one is trying to find your strengths instead of deficits
- 32:55emotional intelligence tests as you indicated Myers Briggs. Incidentally, the people who make
- 33:02Myers Briggs publicly state it should not be used in the workplace as a valid
- 33:07measure because they say that's more subtle than that. There's it's not like you
- 33:15can look at a particular you know, Myers Brigg type indicator and say,
- 33:20oh, that person is blink blank. You know. It's it's not that
- 33:22simple as what they're saying. Well, I'm an e NTJ, aren't I
- 33:28are you? I think I was an e NTJ. I'm whatever the teacher
- 33:30is. I just remember when you when you look at the different labels,
- 33:35I'm I'm the teacher. But anyway, which I don't know is like narcissistic
- 33:42and know it all, I don't know. And the sixteen Personality Factor Questionnaire
- 33:47Big five sort of things, so things like questions on tests like this are
- 33:55simple things like when I find myself in a boring situation, I usually tune
- 34:00out in daydream what true, true or ful? When when a big uh
- 34:06oh sorry, when a bit of tact or convincing is needed to get people
- 34:09moving, I'm usually the one who does it that kind of thing. So
- 34:14so there are uh It's usually very simple questions like that, like I am
- 34:19frequently upset at other people, or I sometimes have trouble managing my anger,
- 34:25or I deal with stress by drinking, or I I like people, or
- 34:32I have good self esteem. Like these are the kinds of questions that are
- 34:36on these things. It must go with my personality type that as you're naming
- 34:39these questions, I'm like, I want to take these tests again. Well,
- 34:45if you want to. I mean, I I have access to hundreds
- 34:47of measures if you want to take them, So we I mean, we
- 34:52could redo some of them because I think as a kid, I learned obviously
- 34:57not not truthfully, but my impress was if I do good on tests,
- 35:00it means I'm really smart. So then I always feel like, oh,
- 35:05ask me questions that I can answer. Well. Incidentally, we did do
- 35:08an IQ test on you and you scored like in the ninety nine point nine
- 35:12percentile. But that was the one I didn't care for as much. I
- 35:15want the ones that are easier that I can just answer with my gut.
- 35:21So these are personality tests, and right away you can tell, well,
- 35:24there's something kind of funny here because it's all based on self report. You're
- 35:30not objectively testing someone's personality. Right, You're asking them to answer questions.
- 35:37You're not observing them for twenty years, right, You're not analyzing them.
- 35:39You're just asking them questions in terms. And so if, for instance,
- 35:45you're at Microsoft and you're hiring someone and you give them a test that one
- 35:50of these, like the sixteen Personality Factor questionnaire, and one of the questions
- 35:53is I don't deal well with authority. How do you think the the applicant
- 36:00is going to answer that question? Yeah, it's like screw the man.
- 36:04Yeah yeah, yeah, you know I frequently disobey my superiors. You know,
- 36:10it's like police. Yeah. I wonder what they're looking for at this
- 36:15job. Okay, So number two, the integrity tests. This is the
- 36:19second category we're going to talk about. It's used to figure out if someone
- 36:22is how honest they are how devious they are, how psychopathic they are?
- 36:29Basically, are they going to steal from the employer in some way or another?
- 36:35How much money annually do American businesses lose from employee theft each year?
- 36:43Woo? All American businesses from theft from from employees only, not employee theft,
- 36:49not like Wenona Ryder theft, but ten dollars twenty billion? No,
- 36:54come on, get real, Well, our economy is you know what in
- 36:59the trip twenty billion dollars? Yeah, that must include some Wall Street shenanigans.
- 37:05Yeah, well I can tell you at least two of those dollars are
- 37:07from me, like I take a pen from work every now and then or
- 37:10something. Twenty billion? Percentage of business failures? What percentage of business fail
- 37:17each year? Or no? What what percentage of businesses? So of all
- 37:22the businesses that fail, what percentage are due at least in part to employee
- 37:29theft? Oh? Come on, five thirty percent? No? No,
- 37:35how can this be? It's a major problem, like thirty percent. I
- 37:40actually actually have a friend, a friend of a friend, let's call her
- 37:45a friend or friend who is still paying off her debt to society as a
- 37:52result of embezzling tens of thousands of dollars from her workplace. Oh my god.
- 37:57I actually had a client in the beginning of my career who was mandated
- 38:02to therapy because he had embezzled a bunch of money from his place of business.
- 38:07Do you realize that what we need to do to make money then is
- 38:09go into business where I'll infiltrate companies and steal as much as I can.
- 38:15Clearly there's like twenty billion dollars there for the taking. And you consult companies
- 38:20on how to reduce employee crime, and between the two of us, we'll
- 38:25just I'll say, well, first off, do not hire Well, no,
- 38:30first off, don't. Well, but we'll be in cahoots. So
- 38:32I'll say, first off, Colombians are are spotless, man, you don't
- 38:37worry about don't worry about them. Yeah. Yeah, So this is why
- 38:43the polygraph was. Its primary use was to try to figure out who these
- 38:46people were. Common tests are the London House PSI, the Employee Attitude Inventory
- 38:52EAI, the Reed Report, the Stanley Survey, and I like this one,
- 38:58the Trustworthiness Attitudes very examples. Again, this is all self report of
- 39:05questions. Will will everyone steal at work if the conditions are right? Oh?
- 39:09Interesting? What what what would you say to that? Yes or no?
- 39:13Well I would say no, but I could see why someone would say
- 39:16yes because they think it's just a matter of the conditions, right, yeah,
- 39:22I mean yeah. Another question, do you believe you are too honest
- 39:27to steal at work? Right? I could again, Well, that one's
- 39:31interesting. I think if I were thinking that I might steal from work,
- 39:35I might still say I am too honest? Right? Another question? Do
- 39:40you think it is humanly possible for the average person to be completely honest on
- 39:45the job? Right? Okay, these are the I can now see how
- 39:47they do this because I was sitting here thinking like, what questions are they
- 39:51going to ask? But these general ones they'll say, Oh well, I
- 39:54mean if you generalize, so sure, no one's really honest, and then
- 40:00they can get you there. Right aha, right, all right, So
- 40:04the research, what do you think do they work? Do these integrity tests
- 40:07actually identify people who are likely to in less less than fifty percent success?
- 40:14I'm gonna think, well, so you're saying they do work to some extent,
- 40:19but not I'm gonna give it like a forty percent success, right,
- 40:22Okay, it's hard to put it in a percentile, but but yeah,
- 40:27you're you're right, that's the way I would put it. Not the forty
- 40:29percent, but the first bit. They basically work sort of in some situations,
- 40:32and some research has actually found that they work. They work pretty well.
- 40:37For example, one study looked at a group of convenience stores. So
- 40:40they're hiring cashiers and stuff to work at a communience store, and they use
- 40:45the ps PSI Integrity test to select employees and guess what reduction in inventory shrinkage
- 40:54due to theft. So so they so they know exactly and someone a lot
- 40:59of and they know generally every month how much inventory they've lost due to shrinkage.
- 41:06They don't know if it's from the employee or from customers. So how
- 41:12much did when they when they actually started using this test to hire people,
- 41:16what reduction in invest a percentage wise did they experience at this convenience store?
- 41:23All right, twenty percent reduction fifty percent? Fifty Wow. Yeah, see
- 41:28that's that's not bad. No, that's a survey you want to implement right
- 41:31now. Now. Other other now that's you know, maybe a place where
- 41:37there's a fair amount of theft right, because I'm trying to think of Antioch
- 41:43with my job. I'm trying to figure out like how or what I would
- 41:46stee paper pens, right, Yeah, Like there's nothing, there's nothing that
- 41:52they have that I want, you know what I mean, or that anyone
- 41:54wants other than like write papers and pens, which you know can't be that
- 41:59expense. And at other places, like if you work in a in an
- 42:02it or like a computer place, you literally have to steal the computers,
- 42:07like extra monitors, extra you know, because it's not like you have a
- 42:12whole bunch of unless you have maybe if it's a place that has free drinks
- 42:15and free food, I suppose you could be loading your car right with that.
- 42:19Yeah. Other studies show similar results, maybe not quite as dramatic,
- 42:23but similar results, and so there is some utility to using integrity tests.
- 42:31Number three. We have clinical measures that identify psychopathology, like the MMPI two,
- 42:37the Minnesota and Multi Phasic Personality Inventory second edition that I had. Oh
- 42:40yeah, yeah, did that come out like borderline psychopathic psychopathy? No,
- 42:45you can't. It revealed I can't remember the exact personality type. It revealed
- 42:52you had a couple, you had a couple of peaks, but none of
- 42:55them. I don't think any of them were in the pathology range. And
- 43:01I'd have to look that up again. And I always still have it.
- 43:04I actually have it in the garage. I know where it is. But
- 43:07anyway, questions like I certainly feel worthless sometimes, or my sex life is
- 43:13satisfactory, or I am very seldom troubled by constipation. That's a great one.
- 43:22Once in a while, I think of things too bad to talk about.
- 43:25Yeah, that's a subtle, good question. So we're getting so you
- 43:30can tell by these questions that they're much more personal than some of the questions
- 43:34we've talked about so far. And these are you know, the MMPI are
- 43:39used by psychologists to diagnose people, and that's its primary usage, and the
- 43:46MPI is being used right now in hiring procedures. That seems a little sketch
- 43:52here, Yeah, it's pretty Yeah. So again, we had personality measures,
- 43:59integrity measures, we had clinical measures, and number four we have cognitive
- 44:02measures IQ tests. This sort of thing. To me, this is the
- 44:07most aside from the integrity measures, which I think makes sense that the IQ
- 44:15tests make total sense. Sure, if you're hiring someone that and they need
- 44:21to be smart because IQ in general is associated with a lot of employment performance
- 44:29kinds of things. Even if you're working at the seven eleven, the smarter
- 44:32you are, the generally speaking, not everybody, the more likely you're going
- 44:38to perform better. You're going to be able to figure stuff out better.
- 44:42Your working memory is better, your your brain speed is faster, your logic
- 44:47ability is better, you keep track of things, your task you know what
- 44:53do you call it? Sequencing and following that task are more are enhanced.
- 44:58Even the military has a minimum that's pretty low, right, but they have
- 45:00a minimum IQ to qualify for a military. Interesting, so to me,
- 45:06this makes sense. Now, many jobs the IQ, what the general IQ
- 45:13test measures is what we call G and it might So if you're going to
- 45:19become like like your band, your tribute band, yeah, do you need
- 45:23someone to be a genius? Yeah, well pretty close to it, I
- 45:27mean, because you know, like people are ruthless out there and you need
- 45:30to be smart enough to be able to deal with the criticisms. Yeah,
- 45:34Like you're not hip hop. So if you're not at least the eighty eighty
- 45:37five IQ, yeah, you don't belong in right, So with your band,
- 45:43you're looking for a different aptitude, a different cognitive ability that doesn't have
- 45:46anything to do with necessarily with what IQ tests measure. What you're looking for
- 45:51is the ability. Well what would you what are the different things you'd be
- 45:53looking for. Well, for example, for a drummer, I don't care
- 45:57how dumb they are as long as they can hit that beat on time.
- 46:00Well, everyone else the drummers are dumb. Anyways, Paul's out there,
- 46:07calm down, Carlito's way, all right, But yeah, no, you
- 46:10know you want you know musicianship? Are they sensitive to the music, the
- 46:16pieces we're playing? Do they have that artistic you know? So that's a
- 46:22different thing that maybe there's a measure for, but might not be related to
- 46:27IQ. So what's the difference between these? One of these is not like
- 46:32the others, So I'll say him again. You got the personality measures,
- 46:36you got the integrity measures, you have the clinical measures, and you have
- 46:39the IQ measures or the cognitive ability measures. Which one of these is not
- 46:45like the others. I think the clinical one. How so, Well,
- 46:49I mean, for one thing, when you get diagnosed that can have medical
- 46:52implications, that could even have I suppose legal implications down the line if someone
- 46:58can absolutely, So we'll get into that in a second. What's another thing
- 47:04that's different about at least one of these the about a different one, not
- 47:09the one I mentioned. Well, it could be, but I'm I'm looking
- 47:13for a different distinguishing factor. Well, let's see IQ measures, ask you
- 47:17questions. Sorry, I see how smart it is more? Okay, So
- 47:21I'd say that the one that seems more subjective than the others to me is
- 47:25the the honesty one, even though it did seem like it had some good
- 47:30results. Yeah, well, actually, what if we extend what you're saying.
- 47:37The personality, integrity, and clinical measures are all subjective, and the
- 47:43cognitive is the most objective. So you know, you could be it could
- 47:49be a bad day and everything can get thrown off on the personality thing.
- 47:52I see what you're saying. You could lie on the integrity thing that the
- 47:57psychopathology tests, You could lie on that one. To you, I key,
- 48:00you can't fake that. So you might have a bad day, but
- 48:04you can't fake being good at it. Right. You might have a bad
- 48:07right exactly, so you might stress, low sleep, whatever, and then
- 48:10and your number might come down as a result of that. But you can't
- 48:15fake. You can't fake being a genius, yes, just for today.
- 48:20Yeah, so whereas the other ones. If you know how to do it,
- 48:23and I'm actually telling you as someone myself who has studied this, and
- 48:28I administer these tests, I could absolutely gain the system if I had to.
- 48:32If someone I could, I could. I know these tests forwards and
- 48:37backwards. I know exactly what to do. I know how to evade the
- 48:42validity tests. I would know exactly if so if if for instance, I
- 48:49wanted to fake having an illness, I would know what question was? What
- 48:52question? Now. What other people don't know necessarily in terms of faking is
- 48:57there are questions in their designed to trick you to revealing that you're faking.
- 49:02Yeah, questions like well, maybe I shouldn't even tell you what the questions.
- 49:07But the point is that there's some some that are meant to be that
- 49:09if you're trying to on purpose, that you don't know what you're doing,
- 49:15right, But I know what I'm doing and I actually know those questions and
- 49:17identify. Whereas with IQ, it's like, at most you could practice some
- 49:22of the classes of problems and you know, improve a couple points, but
- 49:27but not much. Yeah, you know that the kinds of things on an
- 49:30IQ test are the ability to remember a string of numbers. Wait what did
- 49:37you just say? Okay, So what's one of the problems that we haven't
- 49:42identified yet with these these tests with regards to hiring. By the way,
- 49:47the remembering one was one of my worst ones. I hate remembering things.
- 49:52Well, you still did amazingly well though you were still like in the ninety
- 49:57seven I think it's because I used the whole you know, that thing where
- 50:00you visualize and you put little pieces inside of a castle or well, so
- 50:06I want to be the reason why you remember that is because the test is
- 50:12designed to be smarter than the smartest human being. So at a certain point
- 50:17you got to a point where you're like, I can't do that. I
- 50:20can't do that yet. But the frustrated you did better than ninety seven percent
- 50:23of everyone else. So think how hard it was for other people. Okay,
- 50:28I give, I give, okay, So ask me the question again,
- 50:31what are What's a problem a major problem with these tests that we haven't
- 50:37discussed yet. Okay, Well, I know with IQ there's been a lot
- 50:42of controversy in the past about whether or not it would vary based on your
- 50:46background, like socio economic or cultural background. Yeah, exactly. That's that's
- 50:52the main problem that we haven't talked about yet. There are major cultural differences,
- 50:59one in the way people respond to these tests, and to with the
- 51:04way they were designed. All these tests were normed on white Americans, and
- 51:08a lot of them have been normed on certain regions of white Americans many years
- 51:15ago. Yeah, like the MMPI for instance, it's called the Minnesota multi
- 51:20and so it and when they study this sort of thing, for instance,
- 51:24the IQ test, even though you have say an African American person who is
- 51:30just as smart as someone else, they will score sometimes ten points on average
- 51:37lower than their counterpart because the questions are geared are they basically the questions assume
- 51:45that you understand certain things baseline, and different cultures, different different ethnicities,
- 51:52different backgrounds will give you different a different set of baseline knowledge, and that
- 51:58will interest be different and throw you off. Hispanic people tend to also score
- 52:05i think a five points lower on average. And and this that's a big
- 52:07differences. The difference between one hundred and ten IQ and one hundred IQ,
- 52:10that's that's a huge leap. That's almost that's almost a standard deviation and so
- 52:16so it's it's a big deal also with personality tests. It's probably even worse
- 52:22with those. Right, So, you know what, like you grow you
- 52:24grow up in the hood, and lots of people around you are struggling economically,
- 52:31and there's and in order to you know, in order to survive,
- 52:38you've got to survive. And if that means occasionally shoplifting, then that's what
- 52:44that means, right, right, And so you know the integrity questions that
- 52:50that we went over, will everyone steal at work if the conditions are right,
- 52:53Well, if you come from a different background, we're in a different
- 52:57set of more's, then there people are going to answer that question differently.
- 53:02And that's just one very crude example as to what sort of backgrounds could affect
- 53:08the way you would answer these questions. You know, did you see there
- 53:13was a thing at today or yesterday where a female reporter was asking a football
- 53:17player a question about how they run their lines or something like that, and
- 53:23the football player said, he just laughed. He's like, it's funny to
- 53:28hear a woman asking about you know, lines and how I run the lines.
- 53:34And that was his answer. And then later he clarified not in the
- 53:38same conference. Later he's like, well, I guess I should have said
- 53:42reporter, right, and that was this guy oifaication. I guess I should
- 53:45have said report. Yeah. It's like so so biased and and you know
- 53:51this is a person who's like a professional reporter for sports, right. Yeah.
- 53:59I hope there is something like this out there. But if there isn't,
- 54:01so much to make it is women reporters in men's sports and what their
- 54:07experience is like, because I just can't imagine the variety of stories. Of
- 54:13course, there are very respectful dudes in pro sports, for sure, but
- 54:20the you know, I'm sure these people have those sort okay. Yeah,
- 54:22by the way, one bias that I have noticed that I have is when
- 54:30I hear someone speaking in English with a thick accent from certain parts of the
- 54:36world but not all, my mind automatically feels like they're not as smart totally.
- 54:42That's why, like in Game of Thrones and stuff, whenever they want
- 54:45someone who's supposed to be sort of foolish, they have what I believe they
- 54:50call a Cockney accent, right, or a certain kind of English accent,
- 54:55or in America it's a it's a Georgian act. Yeah, it's it's the
- 55:01dumbest. We're stupid humans, like like, we hear an accent and we
- 55:07immediately have ideas as to their intelligence. I hear a certain refined British accent.
- 55:12I'm like, I'm listening to every word that person is saying. Yeah,
- 55:16all right, So effectiveness. What percentage of organizations actually have data to
- 55:22prove that there is a positive business impact on their assessment strategy? A percentage
- 55:30of businesses have have data that say, yep, our assessment strategy has a
- 55:34positive impact on our twenty five percent close, fourteen percent. So it's not
- 55:38many. Now, it's hard to measure, and maybe a lot of businesses
- 55:42don't actually bother with measuring it because it's not that big of a deal to
- 55:46them. But but but not that many. But you know, fourteen percent,
- 55:50it's not bad, all right, It's not nothing. Yeah right.
- 55:52Uh So what does the research say, the non business funded research, you
- 56:00know, what is the actual research? Well, compared to other hiring selection
- 56:04practices, personality assessments are the least effective among those four interesting yeah, whereas
- 56:12cognitive ability IQ tests and integrity tests are actually they're actually better at predicting someone's
- 56:20performance at a job interesting. So when you're hiring someone, the IQ test
- 56:25makes sense, and the integrity tests makes sense, but the personality assessment and
- 56:30the psychopathology assessments those are not as predictive of job performance but kind of And
- 56:38you know, if you have the time, you might you could throw that
- 56:40in there if you want. You that. The thing is is it's all
- 56:45about validity, right, are you measuring what you think you're measuring and is
- 56:52that thing measuring actually applicable to you? So, for instance, if you
- 56:57are hiring a salesperson, would you burdo think you would want someone who's extroverted
- 57:04or introverted just into extroverted, Yeah, it makes sense, you want someone
- 57:07who's extroverted. Salespeople they talk to people, blah blah. But actually data
- 57:12shows that extraversion doesn't have anything to do with sales ability. Have a you
- 57:16can have an introverted person who is actually very good at sales. Wow,
- 57:21Because it's more complicated than that, right, you know that you're and they're
- 57:24at work. When they go home, they might process things in one way,
- 57:30but when they're at work, it's a whole different thing. So so
- 57:35trying to figure that out because and you can see employers going like, well,
- 57:37I want extroverted people, and they don't have any data that they're basing
- 57:40it on. It's just sort of like their their thought process. You know.
- 57:44Actually, I know someone who's a teacher who is normally introverted. Well,
- 57:49the way I know them is introverted, but is a very good teacher,
- 57:53And that means standing daily in front of large groups of judge mental kids
- 58:00and being totally fine with it exactly. Also, personality doesn't when you measure
- 58:06personality. Even if you do create a valid measure and the person doesn't lie,
- 58:12that doesn't mean that these people don't have ways of adapting or coping.
- 58:15It doesn't mean you're not testing for do they have workarounds? Because you take
- 58:22a fifty year old person who who struggles with worry, well, they might
- 58:29have like elaborate coping mechanisms that really work that another person with only mild anxiety
- 58:35doesn't have, and so it's hard. It doesn't necessarily measure for that.
- 58:40So but overall, the gestalt that I have after reading the research is to
- 58:45answer the question is it effective and is it worth it? I would say
- 58:51it depends on your funds. And it depends, I think, also on
- 58:54your culture. For example, if you're hiring at Microsoft, you're hiring thousands
- 59:00of people every day, then I think it might be worth it to throw
- 59:05in an IQ test, a real, real fast IQ test, maybe a
- 59:10real fast integrity test, and maybe weed out a little bit. Yeah,
- 59:15I get, give you a little bit more data because you're you're dealing with
- 59:17thousands upon thousands of resumes and stuff, and it's just like and you have
- 59:22a big enough data set, even among your own employees to make some predictions,
- 59:27you know, based on those findings. However, like at Antioch,
- 59:30when I hire for professors or when I am letting people in the program or
- 59:38not as students, I think it's it's not as relevant, you know,
- 59:44I don't. I'm trying to think of if I would care what the results
- 59:47would be on a personality test. Because I'm much more I can tell pretty
- 59:54well one by the recommendation that I can get from someone else, and two
- 1:00:00when I interact with them, and three when I actually watched them teach,
- 1:00:02because we actually they actually do, you know, demonstrations, I can tell
- 1:00:07right away, Like we had a we had a guy who applied a couple
- 1:00:12of years ago, and he was way overqualified for the job. He had
- 1:00:17been in the he had been a professor for decades. He was a program
- 1:00:22director at a huge program in another part of the country, And when we
- 1:00:28looked at him on resume, we're just like, I think he's he's hiring
- 1:00:31down to this position, you know, like he should he should be running
- 1:00:36the program, not working for it, you know. But then we watched
- 1:00:38him actually teach, and my god, it was awful. Oh no,
- 1:00:43I mean I was like, what are you talking about? I mean I
- 1:00:46sat there for an hour and a half just sort of he was speaking English,
- 1:00:51but I had no idea what he was talking about. Wow, And
- 1:00:54I knew what he was trying to get at, but I was like,
- 1:00:58that is the most convoluted I don't even know if you understand what you're talking
- 1:01:00about, you know, and rightaways, like you know, probably like fifteen
- 1:01:06minutes in like this guy, no frickin way, like maybe he's a great
- 1:01:10administrator and a great program director, but based on the resume, but it's
- 1:01:15a terrible teacher. Yeah. So anyway, Okay, So, because as
- 1:01:22as we were saying earlier, what else do we have when we're hiring people
- 1:01:27like at Microsoft. Right, you have the resume, you have the interview,
- 1:01:30you got the references, you might have their diploma and their GPA,
- 1:01:34and you know their other kinds of things, and you're already kind of shooting
- 1:01:39in the dark, and so why not illuminate it a little bit more with
- 1:01:44a little bit more. What's funny is Microsoft and a lot of companies like
- 1:01:50that used to do sort of the equivalent of an ad hoc improv mini IQ
- 1:01:54test, because they would ask these kind of puzzle questions, these these mental
- 1:02:00challenges, right, yeah, yeah, But then they got away from that
- 1:02:04because well, I don't know the exact reasoning, but it seemed like what
- 1:02:07it was doing is it was finding them smart people, or at least smart
- 1:02:13people in some narrow sense, but not necessarily people that could do the work
- 1:02:16they wanted them to do. So it was too narrow, It was too
- 1:02:20narrow of a right. So well, or maybe what we could say is
- 1:02:24they were putting too much weight on that measure and not enough weight on observing
- 1:02:30their actual work. Right, all right, let's take a break and we
- 1:02:35get back. Let's talk about how to lie on these tests. All right,
- 1:02:42We're back from the break. If you haven't already gone to Facebook and
- 1:02:46liked our Facebook page and also become a member of the Facebook fan group,
- 1:02:53do so. Now. The Facebook fan group always has fun little conversations happening
- 1:02:59there. You can go there, share pictures and your experiences. And I
- 1:03:06don't do you ever go to that fan from time to time? Yes,
- 1:03:08or I see something that that was liked on that page and then I like
- 1:03:13check it out. Okay, I purposely avoid it because I don't want them
- 1:03:16to feel like they can't complain about me. So maybe I'll create a fake
- 1:03:21account and start like trolling. Yeah, but you can also patronize us.
- 1:03:27Yeah, what do you mean, like if you if you want to become
- 1:03:30a patron you can patronize us. I see, So, how how do
- 1:03:34you lie on these tests? Well, on the personality tests, you can
- 1:03:38lie on the psychopathology tests, you can lie in the tegery test. You
- 1:03:42lie on the IQ test. As we said, you can't lie. You
- 1:03:45can lie as in you can make it lower. Yeah, yeah, you
- 1:03:46could, you could vombit. Now what in psychology? This is a problem
- 1:03:55that I have with psychology people who do assessments who a living doing assessments when
- 1:04:02I ask them, well, are you how sure are you that the person
- 1:04:08doesn't know how to trick you? And they're like, oh, I can
- 1:04:11tell. I can always tell, you know. But to me, I'm
- 1:04:15like, well everyone can always tell. Like it's like the statement I've never
- 1:04:20seen the two pay that I couldn't identify, right, It's like, well,
- 1:04:26what about the two pays that were so good you couldn't identify? And
- 1:04:29so for a psychologist to say I've I've always caught people lying, it's like,
- 1:04:33well, what about the people who lied so well that you didn't catch
- 1:04:36them? And and it's what I'm saying is the of anecdotally, the psychologists
- 1:04:46who specialize in assessments that I've talked to, they are biased. They're either
- 1:04:53arrogant, in my opinion, about their abilities or and the the ability of
- 1:04:59their measures to detect lies, or they're so afraid of the notion that someone
- 1:05:06could lie to them that they'd go into denial about it because their entire business
- 1:05:13is based on the ability to objectively measure things and to objectively report on things,
- 1:05:20and to tell the courts Nope, I assessed him and he has schizophrenia,
- 1:05:26you know, I've assessed him and he was insane at the time of
- 1:05:30the crime. And there's no black, there's no gray, It's black and
- 1:05:33white. He was insane at the time of the crime. And here here
- 1:05:38are my data. You know, it's the world of forensics, and particularly
- 1:05:44forensics in courts, but also just general assessments, is such that it ends
- 1:05:49up breeding that kind of attitude. And as someone who chose not to go
- 1:05:54into that field because I don't particularly care for the day to day work of
- 1:05:58it, I don't have that need to delude myself. And I'm here to
- 1:06:03tell you that when you actually look at these tests, especially when you become
- 1:06:09educated on how to use them, you're like, if someone was smart enough,
- 1:06:13they could probably game it, you know, especially if they knew someone
- 1:06:17who like me. If they came to me and said, Kirk, how
- 1:06:20do I trick this, I'd be like, it's pretty easy. Here's how
- 1:06:23you do it. Yeah, you know I could. I could reveal the
- 1:06:26tips in probably two sentences right now that could ruin. That would give anyone
- 1:06:31a pretty good chance to actually trick a test. And because it's not complicated,
- 1:06:38but because the ways in which they test to see if you're lying.
- 1:06:41They're not super complicated. Psychologists do not have a special ability to read people's
- 1:06:47minds. Oh they don't. If we did, crime and criminal proceedings would
- 1:06:55be you know, three percent the length, right, humans, If they
- 1:07:00want to lie that, you know, then it's and they're good at it.
- 1:07:02It's hard to detect. So so there's that. There's also websites that
- 1:07:09and services that that teach you how to trick these tests because you know,
- 1:07:14so you have a whole industry testing people for hires, and then of course
- 1:07:18another industry pops up that says how to trick that, how to tricks and
- 1:07:24it's not it can't be illegal, right, it's it's just like you know,
- 1:07:27it's it's just helping you with your prospects. Right. So what advice
- 1:07:30do you think they give on these websites. Well, let's see for the
- 1:07:34personality one. Uh, they they probably tell you to not answer, try
- 1:07:42to not answer with extremes, you know, try to like answer down the
- 1:07:45middle of the road. Yeah, what you would expect of a NILA person
- 1:07:48to say, right, right, So they say that, but they also
- 1:07:51said something interesting. They said you should read the company website and and read
- 1:07:58their social media posts to figure out and maybe the job description, and maybe
- 1:08:01even talk to someone at the at the at the company to kind of figure
- 1:08:05out what the culture is. Oh, that's yeah, that's a good point,
- 1:08:10especially for personality, right, not so much for the theft one or
- 1:08:13the honesty one. You could generally think like, well, listen, just
- 1:08:16in general be a boy scout, right, But I think this is good
- 1:08:20advice anyway. In fact, I tell people this when a lot of students
- 1:08:25come to me asking me for advice about how to get an internship or how
- 1:08:28to get hired, and among many things that I tell them, one of
- 1:08:30the things I tell them is go to the website, maybe even talk to
- 1:08:33someone who works there, and figure out what kind of culture they have there.
- 1:08:38Is it a very interactive culture or is it a more work on your
- 1:08:43own kind of culture. Is it a small business where everyone knows each other,
- 1:08:48or is it a big business where what's the mission statement? What kinds
- 1:08:53of things are they getting involved in, what do they care about, what
- 1:08:56they how what's the identity of that agency? So when they ask you questions,
- 1:09:01you can say things. You know, if the identity of a particular
- 1:09:03agency is to give back to the local community and marginalized and they identify like
- 1:09:11LGBTQ people and and poor people or something. And when you are interviewed,
- 1:09:17you could say, well, I'm passionate about helping marginalized community. I mean,
- 1:09:21you're not lying, You're just sort of highlighting a particular thing that you
- 1:09:27have a guest that maybe they will they will mark down on their rating sheet.
- 1:09:32Oh, this person fits with our culture. You probably don't want to
- 1:09:34be quoting Gordon Gecko during your interview, unless unless it's that sort of thing.
- 1:09:42Yeah, And so when you take the test, that could influence things,
- 1:09:45right, So if you figure out it's like, oh, this place
- 1:09:48is very energetic, there's a lot of extroverts, and so when you're taking
- 1:09:53the tests, you know, I like to talk to people a lot,
- 1:09:56and if you're sort of borderline, you say, well, you know,
- 1:09:58I'll say I'll say yes to that, you know. Okay, Now,
- 1:10:02what does the research say about lying? Any ideas about what the research might
- 1:10:10say about about lying on these personality tests, about how to do it or
- 1:10:15about how to I don't know any findings that you could imagine that I might
- 1:10:18have in front of me. Okay, Well, I mean I would imagine
- 1:10:20that that people quite often lie when taking these tests in categories where it might
- 1:10:29make them look bad because they they even if they're told like, look,
- 1:10:31we're not gonna they might still feel like, oh, someone's going to read
- 1:10:34this and totally imagine you're you're applying for a job at Microsoft and one of
- 1:10:41the questions is I lose my temper all the time? I mean, just
- 1:10:44imagine what would go through a person's mind to say, Yep, I lose
- 1:10:46my temper lots. You know what kind of fucking question is this? I
- 1:10:50don't lose my fucking temper. Now. What the research actually says is that
- 1:10:56people people are actually honest, usually even when it hurts them on these tests.
- 1:11:01Really, there's something about the human need to be congruent that causes people
- 1:11:09to potentially shoot themselves in the foot when they're answering the questions like this.
- 1:11:13Did I ever tell you about my very first job interview ever? But okay,
- 1:11:17So I was in high school and a friend of mine worked at Old
- 1:11:21Country Buffet. In fact, it's our mutual friend Ron in Tacoma into Coma,
- 1:11:28and he was like, and I was like, man, I need
- 1:11:30a job, you know, I need a job for the summer. And
- 1:11:32he's like, oh, just just interview here. Anyone. He's like,
- 1:11:35anyone can get hired. You just need a pulse. It's fine. So
- 1:11:39I go and I'm like sweet. So I get my interview and they're asking
- 1:11:43me the questions and then you know, tell us about you know, maybe
- 1:11:45a flaw that you might have. Oh god, and I'm like, can
- 1:11:48you imagine young young Bardo. I'm like, well, sometimes I really procrastinate,
- 1:11:55and you know, and it tends to be really an issue because like
- 1:11:58I'll wait till the last second on Sunday and I won't have been doing my
- 1:12:01homework, and then I get like really, and I start basically like going
- 1:12:05to therapy with his interviewer and men, you know, like just it's horrible.
- 1:12:12But I don't I'm not realized. I'm not self aware enough to know
- 1:12:15that I'm just basically digging a six foot hole. And eventually, you know,
- 1:12:19they're like, well, thank you very much. Obviously I don't get
- 1:12:21a call back. And I told my friend about it, and he's like,
- 1:12:25why did you just keep your dumb mouth shut? Next time you say
- 1:12:30something like I care too much or something like that. Right, it's really
- 1:12:34hard for people to lie, is something. I mean, people will maybe
- 1:12:42edge things in a particular direction, but for the most part, the research
- 1:12:45shows that people are often honest on these kind of kinds of tests. And
- 1:12:54what about how to prevent people from lying? How do you what are some
- 1:12:59what are too techniques that you can do as you're administering the test that can
- 1:13:02stop people from lying. Well, one would be actually to make them feel
- 1:13:06like it's a safe environment. Okay, so I don't know exactly, but
- 1:13:11maybe verbiage either written or told to them before, with lots of caveats about
- 1:13:15how this is not going to be used to like, you know, hold
- 1:13:17it against you or whatever, like, just make him feel like it's safe.
- 1:13:20You could just you know, that might be one thing. The other
- 1:13:24one might be well, certainly in the way that the questions are ordered and
- 1:13:29things like that, if you if you make it so that it's not so
- 1:13:33obvious like here's all the bad ones, you know, but rather it's like
- 1:13:38they're interspersed, so it kind of throws you off a rhythm. Okay,
- 1:13:43yeah, I suppose those those might work, but those weren't identified in the
- 1:13:45literature. The two in the literature are to tell them, look, don't
- 1:13:50lie because we can tell when you're lying. Oh, it's the opposite,
- 1:13:54it's making them not feel safe. Right, But then the other but then
- 1:13:58the second one is along the line to safety, which is also don't lie,
- 1:14:01because we're actually trying to match you up with the best sort of job,
- 1:14:06and if you lie on it. You know, for example, if
- 1:14:12you think we're looking for an extrovert and you end up and you're introverted,
- 1:14:15and you end up answering in all these extroverted ways, you're going to get
- 1:14:19a very extroverted job and you're gonna hate it, right, and everyone's gonna
- 1:14:24hate you. So don't do that to yourself, like fill it out normally
- 1:14:28because because we're trying to actually figure out if where the best fit is for
- 1:14:31you. You know that makes sense. Yeah, now let me ask you
- 1:14:35this when people engage in so I don't know how to work this into a
- 1:14:44question, but I'll just tell you there are people who lie, and they
- 1:14:48tend to measure when they actually measure their personality on how honest and how moral
- 1:14:56they are. They the people who lie, guess what tend to have of
- 1:15:00low honesty and low morality, right, right, So the people who test
- 1:15:04low honesty tend to be not very honest on tests, and they will follow
- 1:15:12these people around for hiring and for work performance, and what they find is
- 1:15:17that they are more likely to engage in deviant behaviors at work, and they're
- 1:15:25more likely to get hired than an honest person. Oh of course, yeah
- 1:15:30wow, So that's interesting, right. So not only are they finding,
- 1:15:35yes, there are some people who have personality traits that cause them to lie
- 1:15:40on these tests, but they're more likely to get hired because employers and these
- 1:15:46tests can't figure out that they're lying, right, which goes back to your
- 1:15:50earlier point of right, are you sure you can tell right? Exactly?
- 1:15:55All right? So we talked about the liability thing. Now let's get into
- 1:16:01maybe some privacy. Is it an invasion of privacy to force an applicant or
- 1:16:09an employee to take one of these tests? I mean, there are some
- 1:16:13things in job applications that it seems like they don't do, they can't do,
- 1:16:18or they but like a job application, they can't say do you have
- 1:16:25an STD or or do you enjoy your sex life? And I don't think
- 1:16:30you can ask sexual orientation in an application, right, but these personality tests
- 1:16:35like the MMPI to include that, Yeah, I guess you must have to
- 1:16:41sign a waiver. But if it's for jobs, you know, when it's
- 1:16:46like people don't necessarily have the choice about you know, working, right,
- 1:16:54they've got everyone's got to work. Well, here are some two different cases
- 1:16:59that will shed some light on how the courts rule on this. A firefighter
- 1:17:03applicant who didn't get the job. You know, he applied, he didn't
- 1:17:08get the job. Well, he was not a cop, he was a
- 1:17:10firefighter, and he sued because he thought he was being discriminated against based on
- 1:17:16the personality tests that he had to take. So he you know, he
- 1:17:20and other applicants who took these personality tests and he didn't get the job.
- 1:17:25And he's just like, look, it's bullshit that they assess my personality.
- 1:17:30It's an invasion of my privacy and they're discriminating against me because of my personality.
- 1:17:34It's bullshit. They can't do that. What do you think the courts
- 1:17:39did in that situation? Firefighter applying for a firefighter job, Yeah, didn't
- 1:17:45get it because of these things. Yeah, I have a feeling they went
- 1:17:48with him. They didn't. They went with the firefighting crew. The court
- 1:17:56said that it's okay because you need to screen out people who can't handle the
- 1:17:59pressure of the job. Oh maybe for something that critical. It's even a
- 1:18:02But it's kind of weird, right because it's like, like you said,
- 1:18:04like I bet you that you know. It seems like the court kind of
- 1:18:10just tries to figure this out. And the more I study the law,
- 1:18:13the more I realized that a lot of things are like this. It's like
- 1:18:17individual judge opinion and who said it when, and then others use that as
- 1:18:21a prior right. Someone applied for a security guard position in California at Target,
- 1:18:29at a Target store, and they had to take the MMPI, which
- 1:18:33is one of the most revealing tests, right, and a bunch of other
- 1:18:39tests and didn't get the job. And the security guard or applicant sued and
- 1:18:45said that the test questions were probing into his innermost feelings and were not job
- 1:18:50related. What do you think the court did target? Okay? I think
- 1:18:56then they went with him because Target, who cares if why do you need
- 1:19:00a personality test? Yeah? But not for that the reasons. I don't
- 1:19:02think the court agreed, finding that certain questions invaded the applicants privacy because they
- 1:19:06asked about sexual and religious preferences. The MMPI is extremely I mean, the
- 1:19:13purpose of the MMPI is to measure your entire personality from front to back,
- 1:19:19and also it asks questions that the designers of the test don't even necessarily know
- 1:19:28logically why they're connected to certain personality traits. So it's not like when they
- 1:19:32it's some of the questions are things like I prefer newspaper over radio because it
- 1:19:39was developed in like the forties and fifties, and so there's some questions on
- 1:19:42the test. I don't know if that question is there anymore, but there's
- 1:19:45some questions on the test that logically there's no logic. You can't look at
- 1:19:50the question and go like, oh, I know what they're measuring there,
- 1:19:53but they measured that correlation. Yeah, there's a correlation between the way people
- 1:19:58answer that question and a particular personality trait. And so there's questions on there
- 1:20:02that are like really personal and weird that are I are crossing the line according
- 1:20:12to the law or the course. So the takeaway is when you're using these
- 1:20:20tests, you need to make sure that they're relevant, really and you need
- 1:20:26to make sure you're not going too far. And I would say the MMPI
- 1:20:30should never be used for this sort of it's way too invasive, and that
- 1:20:35your personality test should be on the light side. Let's just say. The
- 1:20:43final thing that I want to say that I've found in the literature is that
- 1:20:47so there's a lot of legal pressures to just not have assessments. Right,
- 1:20:51It's like, well, we could avoid getting in trouble if we just hire
- 1:20:56people the old fashioned way, look at resumes. We can still get sued
- 1:20:59for those kinds of things, but at least we're not adding to the to
- 1:21:02the likelihood of being sued. But you can actually be sued for not using
- 1:21:08assessments. Why do you think that is? Oh, because at least the
- 1:21:12assessments is some sort of standard versus if you're not using the assessments, it's
- 1:21:15some biased opinion from one random interviewer. Good. There's another reason too,
- 1:21:21because because other people are getting the benefit of being assessed via that method and
- 1:21:30you're not. No, So the other reason is, say down the line,
- 1:21:34you have an employee who does something terrible, who you have a truck
- 1:21:39driver who runs someone over, or you have a McDonald's cook who spits in
- 1:21:47all the hamburgers or something, Well, should you not have assessed that person
- 1:21:53before putting them in that position? There? The job is If you put
- 1:22:00the wrong person in that job, they have the potential to harm a lot
- 1:22:02of customers. I was only thinking from the the hiring right, Yeah,
- 1:22:08right, right, But yeah, people have been sued successfully for not doing
- 1:22:14enough in the hiring process to screen out certain kinds of people. So that's
- 1:22:20interesting. All right, Well, what's the final word on this? Bird?
- 1:22:24Oh? What do you say? Well? I think that it sounds
- 1:22:27like there is value on things like using some intellectual testing for weeding out especially
- 1:22:33in like you're saying, large pools of applicants for intellectually challenging jobs, especially
- 1:22:40and it sounds like the honesty one. Uh that's you know, got some
- 1:22:45nice stats behind why you might want to do it, especially in jobs where
- 1:22:49you know, inventory control might be a premium or or like Department of Defense
- 1:22:55or something. Right, but it does seem like this is an area that's
- 1:22:59definitely right for abuse. And you can imagine like all of a sudden,
- 1:23:03now we're gonna start doing genetic testing too, right, you know? Yeah,
- 1:23:08And so it does make me a little nervous, but I could see
- 1:23:11how applied judiciously, it could be useful. Right and along the way,
- 1:23:16our courts and advocacy groups and lawyers need to and society and politicians need to
- 1:23:23talk about the fairness of it all. We have apparently determined that some personality
- 1:23:31testing is fair if it seems to suss out a quality in that applicant that
- 1:23:39is very relevant to the job, Whereas if you aren't doing that, then
- 1:23:45you can be sued and it's deemed as unfair. What I'll say is,
- 1:23:50before doing a deep dive on this, I was very skeptical of it,
- 1:23:56because I'm I'm generally skeptical personality tests anyway, because after studying it, I
- 1:24:03again, the people who do this as a business are kind of they're incentivized
- 1:24:09to really prop it up as this really wonderful science, and in my opinion
- 1:24:15it's it just isn't that great. Even the MMPI, which is supposed to
- 1:24:20be like the best. Other people would argue with that is it's sort of
- 1:24:26I don't know. Some things are I think relevant at times, like the
- 1:24:32Big Five when you measure people on the Big Five. We all know those
- 1:24:36openness to experience, conscientiousness, extraversion, agreeableness, neuroticism. I think that
- 1:24:44is interesting and probably a valid measure for the most part. But when you
- 1:24:48start getting into like is this person going to be a good developer at Microsoft
- 1:24:55or is this person going to be a good firefighter for that matter, I
- 1:24:58just don't know if personnel tests can play a role in that. I think
- 1:25:02that it's just hard to tell, is the thing. It's it's just always
- 1:25:05As a person who was hired and failed at hiring, I can tell you
- 1:25:10that it's just one of those things that you do your best and sometimes you
- 1:25:14completely fail at it. Right, So I just think we need to be
- 1:25:18careful. But I think that there is some use for it. As you
- 1:25:24said, the integrity test seems pretty low key. You're just asking, you
- 1:25:29know, in general, what's your attitudes about theft and about telling the truth
- 1:25:35and all that kind of stuff. I think you know it's for example,
- 1:25:39if you can imagine Steve Jobs taking these, sure he'd probably score very well
- 1:25:43on the IQ one, but the integrity test integrity test if you're being honest,
- 1:25:47well, unless he was lying, which he probably would have been right.
- 1:25:50And there's things like that Also, I just watched the documentary about Ferios
- 1:25:54Bueler's Day Off, and that by itself is interesting. But they were talking
- 1:25:58a lot about John Hughes specifically, and like a typical artist, he's also
- 1:26:04not a well rounded individual. So he would start projects and be super excited
- 1:26:11and very creative, and then he really have a hard time following through and
- 1:26:15finishing them. He would be very very late on deadlines. He would be,
- 1:26:20you know, micro manage his actors, like all these kind of you
- 1:26:24know, have personality outbursts, but then he put out all this great creative
- 1:26:28output. So it's hard to know who can do what right. So if
- 1:26:31a movie house was hiring their next writer director and they measured those kinds of
- 1:26:40traits like follow through, can tankerism, they wouldn't hire him and they would
- 1:26:47pass up on all those great movies. Uncle did he do Uncle Buck?
- 1:26:53One of you know Chris you know Chris Train, Chris Huber. His favorite
- 1:26:57movie is Uncle buckle Buck but a breakfast club, Breakfast Lub, Pretty Pink
- 1:27:01Pink. He did Home Alone too, though, meaning Home Alone and Home
- 1:27:05Alone two and Home Alone three. Right, So the integrity test makes sense,
- 1:27:10and the cognitive ability test makes sense for particular jobs. I think the
- 1:27:15clinical measures I don't think should ever be used in a setting outside of psychotherapy
- 1:27:23and forensics, and the personality tests, since research shows that they're pretty poor
- 1:27:30predictors of job performance, I think should be used sparingly and with a lot
- 1:27:34of caution. All right, Well, that does it for that episode of
- 1:27:38psychology in Seattle. Thanks for joining us out there. Please take care of
- 1:27:41yourself because you deserve it.