Latest / 5 Minute UX / What Your Screener Questions Need To Establish
Transcript
- 0:08This lesson is What Your Screener Questions Need To
- 0:10Establish. Let's get started.
- 0:19Screener questions serve five distinct roles that move a
- 0:22candidate from a raw lead to a qualified participant, starting
- 0:24with verifying user status. The first move is confirming the
- 0:27respondent is either a current user of the specific features
- 0:29being tested or a likely future user. Next, the screener
- 0:32determines group fit by assessing how the respondent
- 0:34aligns with predefined user groups. This assessment helps
- 0:37ensure a good mix of participants within those
- 0:39groups, preventing the session from becoming a monologue.
- 0:41Finally, the process excludes skewing experience by removing
- 0:44respondents whose specific background might distort the
- 0:46results. Take a company selling eyeglasses online with no in-
- 0:49store options; their screener targets a user group comfortable
- 0:51purchasing such items digitally. The questions are designed to
- 0:54screen participants in or out and place qualified candidates
- 0:57into the correct user group. Once you have verified status
- 0:59and established that mix, the next step is defining the pre-
- 1:02screener requirements that dictate which groups are
- 1:04prioritized.
- 1:11Before you write a single question, you need to align with
- 1:13the project team and relevant stakeholders on exactly who
- 1:16matters. This step prioritizes user groups, ensuring everyone
- 1:18agrees on which specific segments should be represented
- 1:21in the study. You then select the distinct user groups to
- 1:23include, moving from broad categories to defined targets.
- 1:26Once those groups are chosen, you determine the precise number
- 1:28of users to include in each one. This sample size decision
- 1:31balances resource constraints against the statistical need for
- 1:34a reliable mix. You also work directly with the client to
- 1:36identify the specific participant types best suited
- 1:38for the testing, confirming their expectations. Finally,
- 1:41you define the testing scope by clarifying the method of
- 1:43representation and the specific tasks included. This ensures the
- 1:46screener actually matches what will be evaluated during the
- 1:49session. With these requirements locked down, you can structure
- 1:51the screener’s branching logic to filter participants
- 1:54effectively.
- 2:00When you build a screener, start with an introductory script that
- 2:03provides clear background information on what is being
- 2:05tested, because transparency ensures people exit on their own
- 2:08rather than feeling misled. This script must explicitly state
- 2:11that taking the screener is not a guarantee of participation in
- 2:14the study, which manages expectations before the
- 2:16respondent invests time. To apply branching logic
- 2:18effectively, configure your survey tool so that questions
- 2:20with wrong answers instantly disqualify the participant,
- 2:23allowing you to dismiss them quickly and reduce their
- 2:25frustration. The screener also requires clear termination
- 2:28criteria, providing specific directions on when to qualify a
- 2:30participant if they fit or terminate the process if they
- 2:33don’t. This structure ensures the process remains efficient
- 2:35and respectful while strictly adhering to the predefined group
- 2:38fit requirements established earlier.
- 2:46The most critical exclusion criteria target respondents
- 2:48whose professional background compromises genuine reactions.
- 2:51You must screen out market research professionals, because
- 2:53their familiarity with research processes makes them less likely
- 2:56to provide authentic feedback. Similarly, exclude competitors
- 2:59from the pool if there are concerns about sharing sensitive
- 3:01design information. These exclusions function as Screen
- 3:03In/Out questions, which qualify or disqualify participants based
- 3:06on their fit for the study. Once a participant passes these
- 3:09initial filters, you use Group Placement questions to sort them
- 3:11into the correct user group for testing. This two-step process
- 3:14ensures that only the right people enter the study, and that
- 3:17they are assigned to the appropriate context for their
- 3:19specific experience.
- 3:26Let's apply this to a concrete scenario. Imagine a company
- 3:29selling eyeglasses online with no in-store options. Your
- 3:31screener must target a user group known to be comfortable
- 3:33purchasing such items online. The questions serve two distinct
- 3:36purposes: they screen participants in or out based on
- 3:38their user status, and they place qualified participants
- 3:41into the correct user group for testing. This is where the
- 3:43design becomes active. You aren't just asking if they buy
- 3:46glasses; you are verifying they fit the specific behavior
- 3:48profile you need. If they don't qualify, your branching logic
- 3:51should terminate the process immediately. It is better for
- 3:53them to exit on their own than to feel misled. When the
- 3:56session begins, the facilitator will ask preliminary questions
- 3:58to understand the participant's background more deeply than the
- 4:01screener provided. They might ask about the frequency of their
- 4:04activity or their general usage habits. These details ensure you
- 4:07are testing with someone who truly represents the target
- 4:09group, not just someone who technically passed the filter.
- 4:12So, when you sit down to write your next screener, start with
- 4:14that specific user group in mind. Define who fits, who
- 4:17doesn't, and how you will place them. The clarity of your
- 4:19screening questions determines the quality of your data.
- 4:24Welcome to The Take. I'm joined by a fellow practitioner and
- 4:27together we're going to dig into What Your Screener Questions
- 4:30Need To Establish — what it means in practice and what's
- 4:32worth remembering.
- 4:34[HOST] I keep coming back to the idea that the screener is
- 4:37actually a filter for honesty, not just data. [LEARNER] That’s
- 4:41a sharp way to put it. Most people treat it like a
- 4:43gatekeeper, but it’s really a mirror. [HOST] Exactly. If the
- 4:47intro script doesn’t set the stage for self-selection, you’re
- 4:50just collecting noise. [LEARNER] I’ve seen clients get stuck on
- 4:53the "no guarantee" line. They think it hurts conversion rates.
- 4:57[HOST] It’s a misconception. Transparency actually improves
- 5:00the quality of the feedback we get later. [LEARNER] Yeah,
- 5:03because the people who stay are genuinely interested in the
- 5:06product. [HOST] And that’s where the group placement questions
- 5:10get tricky. You’re not just sorting, you’re profiling.
- 5:13[LEARNER] Right. I had a client who wanted "heavy users" but
- 5:16meant "daily users." [HOST] That ambiguity breaks the whole
- 5:19session. The screener has to be precise to avoid that. [LEARNER]
- 5:23It’s hard to define "heavy" without excluding the exact
- 5:26people you need. [HOST] That’s why we define the behavior
- 5:29profile first, then write the questions. [LEARNER] I wonder
- 5:32how AI handles that nuance. Can it really distinguish between a
- 5:36casual and a power user? [HOST] It can spot patterns, but it
- 5:39misses the context behind the behavior. [LEARNER] True. A bot
- 5:42might see "five purchases" and flag them as heavy. [HOST] But a
- 5:46human sees the hesitation and the returns in the support
- 5:49tickets. [LEARNER] So the AI drafts the screener, but the
- 5:52human validates the intent. [HOST] Precisely. The tool
- 5:55speeds up the logic, but the practitioner ensures the fit.
- 5:58[LEARNER] I like that balance. It keeps the human judgment
- 6:01central. [HOST] And that’s what saves the project from a
- 6:04monologue of irrelevant opinions. [LEARNER] Definitely.
- 6:07A bad screener is worse than no screener at all. [HOST] Agreed.
- 6:11It’s the foundation, not the decoration.