Latest / Hiring & Firing with Fexingo: Recruitment, Performance, and Workforce Decisions / How a Skills-Based Audit Uncovered Hidden Hiring Bias
Transcript
- Lucas: So there's this story out of a mid-sized tech firm in Austin that decided to run a skills-based audit on its entire hiring process. Not just tweak a few interview questions, but actually tear down how they evaluated candidates from the first screening call to the final offer. Luna: That sounds like a huge undertaking. What made them decide to do that? Lucas: Their hiring managers kept saying they were hiring for 'culture fit,' but the data showed something different. They had a 40 percent rejection rate at the final interview stage, and the candidates who were being cut were overwhelmingly from underrepresented backgrounds. So the head of people ops decided to dig into why. Luna: And what did the audit reveal? Lucas: They found that the 'culture fit' interviews were basically unstructured conversations where the interviewer's gut feeling ruled. There was no rubric, no consistent questions, and the hiring managers were unconsciously favoring candidates who reminded them of themselves. The audit showed that two interviewers would rate the same candidate completely differently, with no correlation. Luna: So they were essentially flipping a coin. But how do you even audit something that feels so subjective? Lucas: They did a few things. First, they recorded and transcribed every interview over a three-month period, and then had a panel of independent reviewers score them against a new skills-based rubric. The rubric focused on specific competencies like problem-solving, adaptability, and communication — all tied to actual job tasks. Luna: And what was the most surprising finding? Lucas: The biggest surprise was that the questions that were supposed to be behavioral — like 'tell me about a time you handled a conflict' — were actually the weakest predictors of performance. What worked best were questions that asked candidates to solve a realistic problem on the spot, like 'here's a customer complaint, walk me through how you'd respond.' Luna: That makes sense. It's closer to a job simulation than a memory test. Lucas: Exactly. And once they shifted their interviews to be more skills-based, the results were dramatic. They saw a 30 percent increase in diverse hires within a year, and time to hire dropped by 15 days on average. But there was also resistance from some hiring managers who felt their judgment was being second-guessed. Luna: How did they handle that pushback? Lucas: They didn't just impose the new rubric. They brought the managers into the process of designing it, so they could see that the questions were actually better at identifying strong candidates. They also showed them the data from the audit — like the fact that a candidate who was rejected by one manager would have been hired by another. That made it harder to argue with. Luna: That's a smart way to get buy-in. But isn't there a risk of overcorrecting, like becoming too mechanical and missing out on the human element? Lucas: It's a valid concern. But the data from this company suggests the opposite. Their retention rates went up by 20 percent over two years, and the hires made under the new system were rated as better performers by their peers. It seems like being more structured actually lets the human element shine through, because you're focusing on what actually matters for the job. Luna: So what's the takeaway for a typical HR team that doesn't have the resources to do a full audit like this? Lucas: You don't have to do a massive overhaul. Start small — pick one role, map out the key competencies, and design three or four problem-solving questions that directly test those competencies. Then, have a panel of interviewers score candidates independently before discussing. That alone can remove a lot of the bias. Luna: Interesting. And that's something any team can try next hiring cycle. Lucas: Absolutely. And if you're listening and you want more practical ideas like this, there's a small thing that keeps us going. A handful of listeners chip in monthly through buy me a coffee dot com slash fexingo, and that's literally what funds making this many of these. Luna: Yeah, it's a community thing. Every little bit helps us keep the lights on and stay ad-free. Lucas: So, back to the audit — one more thing that struck me was that the company almost didn't do it because they thought they were already fair. That's the dangerous part, right? We all think we're objective, but the data often says otherwise. Luna: It's humbling, but it's also a chance to improve. The fact that they found a 30 percent increase in diverse hires shows how much talent they were missing out on before. Lucas: And that's the real cost of bias — not just a legal or ethical issue, but a talent issue. You're leaving good people on the table. This company's experience shows that a skills-based audit isn't just about fairness; it's about making better hires. Luna: So, are we going to see more companies adopt this approach, or is it still a niche practice? Lucas: I think it's becoming more mainstream. The data is compelling, and tools to do this are getting cheaper. But the biggest barrier is cultural. It's hard to convince people to give up their gut instinct. Luna: But once they see the results, it's hard to argue with a 20 percent retention bump. Lucas: Exactly. And the next step is to apply this not just to hiring, but to promotions and internal mobility. If you can identify the skills that predict success, you can use the same rubric to develop your existing talent. Luna: That's a really smart way to think about it — it's not just a hiring tool, it's a talent management tool. Lucas: Right. So maybe the lesson here is that a skills-based audit is less about fixing a broken process and more about unlocking potential — both for the company and for the candidates who might have been overlooked. Luna: And that's a pretty powerful takeaway to leave our listeners with.