Latest / The Science of Leading / Why Gut Hiring Fails, and What Predicts Performance

Transcript

Why Gut Hiring Fails, and What Predicts Performance · The Science of Leading

• 0:00
  Welcome to the show.
• 0:00
  Edwin, here's the uncomfortable truth that still stings a bit: someone
• 0:05
  can walk out of an interview feeling absolutely certain-like,
• 0:08
  "that's our hire"-and still be completely wrong.
• 0:08
  Yes,
• 0:12
  and the confidence is often the most misleading part.
• 0:15
  Unstructured interviews feel diagnostic because they're vivid.
• 0:19
  You remember the handshake, the eye contact,
• 0:22
  the quick answer to something unexpected.
• 0:25
  But those are exactly the conditions where halo effect,
• 0:29
  similarity bias, and first-impression lock-in quietly take over.
• 0:29
  First-impression
• 0:35
  lock-in is the one that gets me.
• 0:37
  You mean the first few minutes basically decide the whole interview?
• 0:37
  Very
• 0:41
  often, yes.
• 0:42
  If a candidate starts strong, every later answer gets interpreted generously.
• 0:46
  If they start awkwardly, they're climbing uphill the entire time.
• 0:50
  That isn't measurement.
• 0:52
  It's narrative.
• 0:53
  And people are very good at building narratives out of thin evidence.
• 0:53
  And
• 0:58
  similarity bias is the subtler one,
• 1:00
  right?
• 1:00
  Not some obvious "I like people like me," but more like... this person
• 1:04
  thinks the way I think, communicates the way I do,
• 1:07
  and suddenly my brain tags that as quality.
• 1:07
  Exactly.
• 1:11
  Familiarity masquerades as judgment.
• 1:14
  Leaders believe they're identifying excellence,
• 1:17
  when in practice they're rewarding comfort and calling it instinct.
• 1:17
  Okay,
• 1:21
  but I'm going to push back a little.
• 1:22
  Experienced managers do pick up on things that aren't on paper-judgment,
• 1:27
  presence, maybe even grit.
• 1:28
  Are we being too dismissive of intuition?
• 1:28
  Not dismissive-just precise
• 1:33
  about its role.
• 1:34
  Intuition can generate a hypothesis.
• 1:37
  It should not deliver a final decision.
• 1:40
  The more reliable approach is less intuitive and more structured: ask
• 1:45
  the same job-relevant questions,
• 1:46
  use a defined scorecard, and compare evidence across candidates.
• 1:51
  That consistency improves signal and reduces noise."Reduces noise" feels
• 1:57
  important.
• 1:57
  Because a lot of hiring discussions sound confident,
• 2:00
  but underneath it's... static.
• 2:02
  I've seen a panel shift in seconds.
• 2:04
  Candidate leaves, someone says,
• 2:06
  "She's a star," and suddenly everyone remembers the good parts and forgets
• 2:10
  the weak ones.
• 2:10
  That's a common failure mode.
• 2:13
  The strongest personality in the room becomes the unofficial scoring
• 2:17
  system.
• 2:18
  Not because they have better evidence,
• 2:20
  but because certainty spreads quickly,
• 2:22
  especially under time pressure.
• 2:22
  Right,
• 2:25
  confidence is contagious.
• 2:27
  One person says "executive presence," and now everyone's replaying the
• 2:30
  same polished moment instead of questioning the thin answers behind it.
• 2:30
  And
• 2:35
  "executive presence" often becomes a catch-all for vague impressions.
• 2:39
  It can conceal bias, class signals,
• 2:42
  communication style preferences.
• 2:44
  A structured scorecard forces a more useful question: what did this person
• 2:49
  actually demonstrate that connects to the role?
• 2:49
  So if a team can't point
• 2:54
  to specific behaviors or answers,
• 2:56
  then what they're calling judgment is probably just chemistry.
• 2:56
  Yes.
• 3:00
  And chemistry is useful in social settings.
• 3:02
  It is not sufficient as a hiring method.
• 3:02
  So what actually predicts performance
• 3:07
  better than that smooth, flowing interview everyone enjoys?
• 3:07
  Three methods,
• 3:12
  used properly: structured interviews,
• 3:15
  work sample tests, and job-relevant assessments.
• 3:18
  They outperform free-form conversations because they approximate future
• 3:23
  behavior rather than surface-level impression.
• 3:23
  Work samples feel almost
• 3:27
  too obvious once you say it.
• 3:28
  If you're hiring a writer, have them write.
• 3:31
  If you're hiring a salesperson,
• 3:32
  simulate a real sales conversation.
• 3:35
  If it's a manager, give them a messy team problem and see how they think
• 3:39
  through it.
• 3:39
  Exactly.
• 3:40
  "Show me" is far more informative than "tell me." Someone can be excellent
• 3:45
  at telling their story and still underperform in the actual work.
• 3:48
  Validity increases when the assessment resembles the job.
• 3:48
  And just to
• 3:53
  ground that-validity means the method actually connects to real performance,
• 3:57
  not just producing a clean-looking score.
• 3:57
  Correct.
• 4:00
  A valid method predicts outcomes that matter.
• 4:03
  An invalid one creates the appearance of rigor without meaningful signal.
• 4:03
  This
• 4:08
  is slightly uncomfortable to admit,
• 4:09
  but I can feel myself doing this.
• 4:11
  Someone answers quickly, confidently,
• 4:13
  with a neat structure, and my brain goes,
• 4:15
  "capable." Which is... not reliable.
• 4:15
  It's very human.
• 4:19
  Confidence is easy to observe.
• 4:22
  Competence is often quieter, slower,
• 4:25
  and context-dependent.
• 4:27
  The goal is not to judge personality in an hour-long conversation.
• 4:31
  It's to predict behavior under real conditions.
• 4:31
  That's the shift,
• 4:35
  isn't it.
• 4:36
  Not "do I like this person" or even "are they impressive," but "what
• 4:40
  are they likely to do here repeatedly when things get difficult?"Exactly.
• 4:45
  And this is where base-rate thinking helps.
• 4:48
  Instead of asking how this one interview felt,
• 4:51
  ask which methods consistently predict success across many hires.
• 4:55
  Leaders often ignore the base rate in favor of a compelling individual
• 4:59
  story.
• 4:59
  The "I know there's a process,
• 5:02
  but I have a really good feeling about this one" situation.
• 5:02
  Yes.
• 5:06
  Often the beginning of a costly mistake.
• 5:06
  And this is where culture fit
• 5:10
  gets tricky.
• 5:11
  It sounds reasonable, but it can easily turn into sameness.
• 5:11
  More often
• 5:15
  than leaders acknowledge.
• 5:16
  "Culture fit" becomes shorthand for familiarity-shared background,
• 5:21
  style, or comfort.
• 5:22
  A better lens is values in action: how does this person handle disagreement,
• 5:27
  accountability, pressure, learning?
• 5:27
  So not "would I enjoy working with
• 5:32
  them," but "when something breaks,
• 5:34
  do they respond in a useful way?"Exactly.
• 5:37
  And if the answer comes from a vague feeling,
• 5:40
  you don't yet have a reliable answer.
• 5:40
  Let's make this practical.
• 5:44
  If someone says, "this all makes sense,
• 5:46
  but I don't have time to build a massive hiring system," what's the minimum
• 5:50
  viable version?
• 5:50
  Start with five steps.
• 5:53
  Define the role clearly.
• 5:55
  Identify the few competencies that truly matter.
• 5:58
  Build a consistent scorecard.
• 6:00
  Compare candidates using evidence rather than memory.
• 6:03
  And calibrate after hiring-look back and check whether your interview
• 6:08
  signals matched real performance.
• 6:08
  That last step-calibration-feels like
• 6:13
  the one almost nobody does.
• 6:15
  People hire, move on, and never check if their decisions actually worked
• 6:20
  out.
• 6:20
  Without calibration, there is no learning loop.
• 6:23
  Hiring becomes folklore.
• 6:25
  People rely on confidence rather than outcomes.
• 6:25
  The part I'd want on a
• 6:30
  wall somewhere is not confidence-but hit rate.
• 6:32
  How often were you actually right?
• 6:32
  Exactly.
• 6:35
  Now, there is a real tension between speed and rigor.
• 6:39
  Teams often feel they need to hire quickly.
• 6:42
  Sometimes that urgency is valid.
• 6:44
  But a poor hire creates far more delay over time-rework,
• 6:48
  team friction, lost productivity.
• 6:48
  So what feels fast in the moment can
• 6:53
  be very slow over the next six months.
• 6:53
  Precisely.
• 6:57
  Sloppy hiring feels efficient only at the beginning.
• 6:57
  And none of this
• 7:01
  works if people won't actually use the system.
• 7:03
  So it has to be simple enough that busy teams don't ignore it.
• 7:03
  Correct.
• 7:08
  A usable system is better than a perfect one.
• 7:11
  Clear competencies, a small set of structured questions,
• 7:15
  one realistic work sample, independent scoring before discussion,
• 7:19
  and a simple calibration habit.
• 7:21
  That already creates a meaningful improvement.
• 7:21
  Independent scoring before
• 7:26
  discussion-that's a big one, right?
• 7:28
  It stops the loudest voice from shaping everyone else's opinion.
• 7:28
  Exactly.
• 7:32
  Capture judgments before social influence begins.
• 7:36
  Otherwise, you're not collecting multiple perspectives-you're watching
• 7:40
  one opinion spread.
• 7:40
  Which brings us back to the strange part.
• 7:43
  Leaders standardize everything else-finance,
• 7:46
  operations, quality-but hiring,
• 7:49
  which defines the entire system,
• 7:50
  still gets treated like taste.
• 7:50
  Yes.
• 7:53
  And that raises an important question.
• 7:55
  If effective hiring systems are repeatable and teachable,
• 7:59
  why do so many leaders still treat hiring as an art instead of building
• 8:03
  it like an operating system?
• 8:03
  Probably because art flatters the artist.
• 8:06
  Systems expose the score.