Latest / Hiring & Firing with Fexingo: Recruitment, Performance, and Workforce Decisions / How a Pre-Interview Quiz Raised Offer Acceptance Rates
Transcript
- Lucas: So there's this metric that keeps popping up in recruiting circles lately, and it's pretty counterintuitive. Companies that send a short, role-relevant pre-interview quiz before the first phone screen see their offer acceptance rates climb by nearly 20 percent. Luna: Wait — you're saying asking candidates to do extra work makes them more likely to say yes when you finally give them an offer? That seems backwards. Lucas: That's exactly what I thought. But the logic actually holds up when you look at what's really happening. The quiz isn't a gatekeeping hurdle; it's a signaling mechanism. It's asking the candidate to invest a small amount of time upfront — fifteen minutes, typically — before the employer invests in a full phone screen. Luna: Okay, so it's a mutual screening step. But doesn't that risk filtering out great candidates who just don't have time for a quiz? Lucas: That's the fear, and it's valid. But the data from a mid-size tech firm that piloted this last year showed something else. They had a 23 percent increase in offer acceptance rates after introducing a fifteen-minute coding logic quiz before the first recruiter call. And they specifically designed it so there were no right or wrong answers — it was about problem-solving approach, not a test. Luna: No right or wrong answers? So what were they measuring? Lucas: Effort and intent. They wanted to see if the candidate would actually sit down and think through the problem. The quiz was structured like a logic puzzle — something you could spend five minutes on or forty-five. The key was that it signaled: 'I care enough about this role to give you fifteen focused minutes.' And candidates who completed it thoughtfully were far more likely to accept an offer later. Luna: So it's a filter for passive applicants. People who just applied on a whim won't bother. The ones who do the quiz are already self-selecting as serious. Lucas: Exactly. And that's the real win. The company reduced ghosting during the interview process by over 30 percent. Because the candidates who made it past that initial step had already demonstrated a baseline level of interest. They weren't just window-shopping. Luna: But I can think of a downside. What if a candidate is perfect on paper, but they freeze on the quiz because it's timed or unfamiliar? You might lose someone who'd be great on the job. Lucas: That's why the design matters enormously. The best implementations make it clear up front that the quiz is not graded. It's not pass-fail. It's about seeing how you think. Some companies even give a sample question beforehand so candidates know what to expect. And they always allow reasonable time — like 24 hours to complete it, not a live timed constraint. Luna: Still, I wonder about bias. If the quiz uses language or references that are more familiar to certain backgrounds, you could inadvertently screen out diverse candidates. Lucas: Absolutely a risk. And that's where you have to audit the quiz the same way you'd audit any other screening tool. The firm I mentioned ran a pilot with two versions — one with technical jargon, one with plain language. They found the plain language version actually had a higher predictive validity for on-the-job performance for non-traditional candidates. So the quiz itself has to be inclusive. Luna: So the quiz isn't really about testing knowledge. It's about testing willingness. Lucas: Right. It's a proxy for genuine interest. And there's behavioral economics behind it. The IKEA effect — you value something more if you've invested effort into it. Candidates who complete the quiz feel a sense of ownership over the process. They've already put skin in the game. Luna: That makes sense. But does it work for every role? I can see it for engineering or analytical jobs. What about sales or customer support? Lucas: The principle applies broadly, but the format changes. For a sales role, the quiz might be a short scenario: 'Here's a customer objection. Write a two-sentence response.' For customer support, it might be a troubleshooting simulation. The key is relevance and brevity. If it feels like busywork, candidates will drop off. Luna: And the data shows that the drop-off from the quiz itself is actually desirable. You want people who aren't genuinely interested to self-select out early, before you invest recruiter time. Lucas: Precisely. The average recruiter spends about six seconds reviewing a resume. A quiz that takes fifteen minutes is a much stronger signal. So you're trading a small upfront effort for a much higher-quality pipeline downstream. Luna: What about candidates who might be wary of free work? There's a lot of skepticism about unpaid assessments. Lucas: That's fair. And that's why transparency is non-negotiable. The best companies explicitly state: 'This quiz is not a test. Submitting it does not guarantee an interview. It simply helps us understand your approach. We expect it to take about 15 minutes.' If you frame it as a conversation starter rather than a gate, candidates react positively. In fact, in the firm's post-hire surveys, most employees said the quiz made the company seem more thoughtful. Luna: So it's actually a branding tool too. You're signaling that you value preparation and thoughtfulness. Lucas: Exactly. And that attracts candidates who value those things. It's a win-win if done right. But there's a pitfall: if you make the quiz too long or too hard, you'll alienate your best candidates — because they have options. The sweet spot seems to be around ten to fifteen minutes, with clear instructions and no high-stakes pressure. Luna: And what about the 20 percent acceptance rate boost? Is that sustainable, or just a novelty effect? Lucas: The firm tracked it over eighteen months and the effect held. They even expanded it to all non-executive roles. Their hypothesis is that it consistently filters out the 'just browsing' applicants, leaving a pool that's more committed from the start. And committed candidates are more likely to say yes to an offer. Luna: So if a company is struggling with ghosting or low acceptance rates, a short, well-designed quiz might be a low-cost fix worth trying. Lucas: Absolutely. I'd say it's one of the most underused tools in hiring. Most companies jump straight to complex assessments or personality tests. But a simple, transparent, effort-based quiz can do a lot of the heavy lifting. Luna: Alright, I'm sold on the concept. But let's talk about implementation pitfalls. What's the most common mistake companies make? Lucas: Making it too long. I've seen quizzes that take an hour. That's going to filter out not just casual applicants, but also busy, high-quality candidates who have other options. Keep it short. Also, don't make it a secret. Be upfront about the time commitment. And never use it as a knockout without giving feedback. If someone fails, they should know why. Luna: And what about the scoring? If there are no right answers, how do you compare candidates? Lucas: You don't score it like a test. You look for patterns. Did they engage with the question? Did they show logical reasoning? Did they ask clarifying questions if allowed? It's more of a qualitative review. Some companies use a simple rubric: 'minimal effort', 'some effort', 'substantial effort'. That's it. Luna: So it's really about separating the signal from the noise. And noise is the candidate who applies to everything. Lucas: Exactly. And we know that the average job posting gets 250 resumes. The recruiter can't give each one deep attention. The quiz is a way to let candidates self-select into a smaller, more engaged pool. Luna: I want to try this in my next hire. But I'm also thinking about the candidate's perspective. If I were job hunting and got a short, relevant quiz, I'd actually appreciate it — as long as it's not a time suck. Lucas: And that's the key. It's a signal of respect. You're saying: 'We value your time, but we also want to make sure this is a good fit from both sides.' Candidates pick up on that. Luna: Honestly, if this concept saves you from one bad hire or one ghosted offer, it's worth the fifteen minutes it took to listen. And if it did, you know where to find us — buy me a coffee dot com slash fexingo. That's what keeps these conversations ad-free and focused. Lucas: Yeah, we don't run ads, so listener support is what keeps the show going. If today's episode moved your thinking forward even a little, that link is there. And we really appreciate it. Luna: Alright, back to the quiz. Lucas, any final warning for someone about to implement this? Lucas: Just one: don't make the quiz a substitute for a conversation. It's a pre-filter, not a replacement for a good interview. And always, always monitor for adverse impact. Check if certain demographic groups are dropping off more. If they are, redesign the quiz. Luna: Good advice. So, a pre-interview quiz: low cost, high potential, but needs careful design. Lucas: Exactly. And when done well, it can transform your hiring funnel from a sieve into a magnet.