Latest / Hiring & Firing with Fexingo: Recruitment, Performance, and Workforce Decisions / Why a Structured Interview Beats Unstructured Every Time
Transcript
- Lucas: Luna, I want to talk about something that sounds boring but might be the single highest-leverage change a hiring manager can make: structured interviews. Luna: Boring how? I feel like every interview is structured in some way. Lucas: Not even close. Most interviews are unstructured — a friendly chat where the interviewer asks whatever comes to mind. And the research is brutal on that approach. Luna: What does the research say? Lucas: A meta-analysis in the Journal of Applied Psychology looked at decades of data. Unstructured interviews have a predictive validity of about 0.2 — meaning they barely beat a coin flip. Structured interviews, where every candidate gets the same questions scored on a rubric, hit around 0.5 to 0.6. That's a huge jump. Luna: So the difference is consistency? Every candidate gets the same treatment? Lucas: Exactly. And it's not just about fairness — it's about accuracy. When you ask different questions, you can't compare answers. You're comparing impressions. The structured approach forces you to evaluate responses against a criterion, not against the person before. Luna: I've heard some pushback from managers who say structured interviews feel robotic or impersonal. Lucas: That's the top objection. And it's a valid feeling. But the data says candidates actually prefer structured interviews — they feel the process is fairer and more transparent. A study by the Society for Human Resource Management found that candidates who went through a structured process rated the experience higher than those in unstructured chats. Luna: Interesting. So we're not talking about reading from a script with no follow-ups, right? Lucas: Right. You can still probe. The key is that the core questions are identical across candidates. For example, at Google, they use structured behavioral interviews where every candidate for a given role gets the same four to six questions. The interviewer can ask clarifying follow-ups, but the scoring rubric is based on the initial response. Luna: Give me an example of a question that works well in a structured format. Lucas: A classic one for a project manager role: 'Tell me about a time you had to deliver a project under a tight deadline with limited resources. What steps did you take, and what was the outcome?' That's a behavioral question. Every candidate gets it. You score them on a scale from one to five based on predefined criteria — like problem-solving, collaboration, and results. Luna: And you have a rubric before you even hear the answer? Lucas: Yes. A five on that question means the candidate described a specific situation, explained their concrete actions, and quantified the outcome. A one means they gave a vague hypothetical. That rubric is written before any interviews happen. Luna: That removes a lot of the 'I just liked them' bias, doesn't it? Lucas: Exactly. And that's the hidden benefit. Unstructured interviews are prone to affinity bias — you hire people who remind you of yourself. A structured process surfaces the actual data. Luna: So how does a company actually implement this? I imagine it takes work upfront. Lucas: It does. You have to identify the key competencies for the role. Then write questions that target each competency. Train interviewers on the rubric. That can take a few days, but the payoff is huge. A mid-sized tech company I read about switched to structured interviews and saw a 30 percent reduction in early-turnover within a year. Luna: Thirty percent — that's a big number. And it makes sense because you're hiring people who actually fit the criteria, not just who interviews well. Lucas: Right. And the same company reported that hiring managers initially resisted. They said things like 'I know a good candidate when I see one.' But after six months, most converted. Luna: What was the turning point for them? Lucas: They saw two things. One: the structured process helped them identify strong candidates who would have been overlooked in a free-form chat. And two: it protected them from making expensive mistakes. One manager admitted he almost hired someone based on a great first impression, but the rubric revealed the candidate had no experience with cross-functional collaboration, which was a key requirement. Luna: So the rubric saved them from a bad hire. Lucas: Exactly. And that's the thing — structured interviews don't just improve the average; they reduce the variance. You get fewer spectacularly bad hires and fewer spectacularly good ones, but the average quality goes up. For most companies, that's a trade worth making. Luna: Is there any situation where unstructured interviews might be better? Like for a very senior role where you need to assess culture fit or strategic thinking? Lucas: Even there, the research holds. For senior roles, you can use structured situational interviews — present a realistic business problem and ask how they'd handle it. That's still structured because every candidate gets the same scenario. The key is to avoid 'let's just chat about your background' — that's where bias creeps in. Luna: You mentioned earlier that candidates prefer structured interviews. Why is that? Lucas: Because they feel like they're being evaluated fairly. In an unstructured interview, the candidate is trying to read the interviewer and figure out what they want. In a structured one, they know the rules of the game. It reduces anxiety and lets them focus on answering the question. Luna: I've had that experience myself — going into an interview that felt like a random conversation and leaving unsure if I made any impression at all. Lucas: Right. And that uncertainty hurts the employer too, because you might lose a great candidate who didn't feel the process was professional. So structured interviews are a signal of rigor. Luna: Let me ask about logistics. How many questions should a structured interview have? Lucas: Typically four to six core questions for a one-hour interview. Any more and you're rushing. Each question should target a different competency. And you should leave time for the candidate to ask questions at the end — that part can be unstructured. Luna: And what about scoring? Do you score during the interview or after? Lucas: Best practice is to take notes during the interview but wait until after it's over to assign scores. That way you don't let the first answer color your perception of the rest. You also want to score each question independently before averaging. Luna: That makes sense. It prevents the halo effect. Lucas: Exactly. And if you have multiple interviewers, they should each score independently and then compare. Disagreements often reveal blind spots. Luna: I like that. It turns hiring into a team discipline rather than a solo judgment call. Lucas: And that's the broader point. Structured interviews force you to be deliberate about what you're looking for. You can't just 'wing it' and hope for the best. And that discipline pays off in better hires, less turnover, and a more diverse workforce. Luna: You know, we talk a lot on this show about practical tools that actually move the needle. And this one feels like it's free — no software needed, just a commitment to process. Lucas: Absolutely. And it's the kind of thing that, if you implement it well, compounds over time. Every hire becomes better than the last. Luna: Speaking of things that compound — we've been doing this show ad-free from the start, and that's intentional. We want these conversations to be useful without any noise. Lucas: Right. And if you've gotten value from any episode — maybe a tip that changed how you hire, or a framework you've used — there's a simple way to support that. Buy me a coffee dot com slash fexingo. It's listener-funded, no ads, no sponsors. Luna: Yeah, it keeps the show independent. And we really appreciate everyone who's chipped in. Lucas: Okay — back to structured interviews. One more thing I think is underappreciated: structured interviews also help with legal defensibility. If you ever have to defend a hiring decision, having a documented rubric and identical questions is much stronger than 'I had a good feeling about them.' Luna: That's a good point. Especially with increasing focus on fair hiring practices. Lucas: Exactly. So my challenge to listeners is: for your next hire, write down three to five questions before you even look at resumes. Decide what a good answer looks like. And then stick to that script for every candidate. See if it changes your decisions. Luna: I'm going to try that myself. I think we often overestimate our ability to judge people in a freeform conversation. Lucas: We do. And the data says we're wrong. So let the data guide you.