Latest / The Feed & The Thread / The Feed & The Thread - October 9, 2026
Transcript
- 0:00Synthetic users are killing the value of small sample sizes.
- 0:03Wait. You mean fake data is better than real people? It
- 0:06creates false confidence, and that's exactly why we need to
- 0:10rethink our research.
- 0:15Welcome to The Feed and The Thread, brought to you by
- 0:17Chicago Camps. The Feed & The Thread is available online at
- 0:20feed and thread dot com to submit your feeds, or download
- 0:23our app for all the feeds and threads delivered right to your
- 0:26pocket.
- 0:34The line between helpful tool and dangerous illusion is
- 0:37blurring. We're building products on data that might not
- 0:40exist, and selling work that might not need us. Kyle Soucy
- 0:43at UX Design.cc warns in "Synthetic users are making me
- 0:46rethink “imperfect research”" that synthetic users create a
- 0:49false confidence that small sample sizes never did. When
- 0:53teams use LLMs to generate responses from proto-personas,
- 0:56they mistake simulation for evidence, and that gap is where
- 0:59bad decisions hide. The danger isn't that the research is
- 1:02messy, it's that it looks clean. Emily Haines Lloyd at Chicago
- 1:06Camps argues in "Somebody Meant This: A Conversation With Emily
- 1:09Haines Lloyd" that the creative industry is drowning in low-
- 1:13quality machine text. She points out that clients now expect free
- 1:16AI content, which squeezes out the nuanced work that actually
- 1:20resonates. The value lies in the specific human connection that
- 1:23algorithms can't replicate. Scott Berkun announces his tenth
- 1:27book in "How To Live: Book Excerpt and TOC", a guide for
- 1:30people who don't like rules. It covers everything from basic
- 1:33survival to embracing ambiguity, and it suggests we need a
- 1:36holistic approach to decision making. In a world of rigid
- 1:39frameworks, learning to chop wood and embrace luck is the
- 1:43real skill. Other reads available from UX Planet on AI
- 1:46limitations in Figma and UX Design.cc on the value of human
- 1:49work.
- 1:57A page-flip animation, a set of command-menu icons, and a layout
- 2:00an AI tool shifted on its own are doing more work than their
- 2:03size suggests. Each one is really a question about where
- 2:06the mental model lives. Over on r/UI_Design, a designer is
- 2:09arguing that a card flip effect feels more intuitive than a
- 2:12standard carousel, claiming it mimics the tactile sensation of
- 2:15turning a physical sheet of paper. This is a small, specific
- 2:18choice, but it highlights a broader tension we face daily.
- 2:21We often prioritize functional efficiency over sensory
- 2:24feedback, assuming the user only cares about speed. But that
- 2:27subtle animation can make the interface feel less like a
- 2:30machine and more like an object you can hold. It's a reminder
- 2:33that micro-interactions aren't just decoration; they're the
- 2:36glue that holds the mental model together. In the same
- 2:39subreddit, a solo developer is asking how to stop AI coding
- 2:42tools from breaking existing UI layouts when making minor
- 2:45adjustments. They describe a frustrating loop where moving a
- 2:48single button causes unintended shifts across a fixed canvas.
- 2:51This touches on a deeper concern about control. We're handing
- 2:54over structural decisions to models that lack the context of
- 2:57our design system. The result is a brittle interface that fights
- 3:01back against the designer's intent. It's a clear signal that
- 3:04AI isn't yet a reliable partner for maintaining spatial
- 3:07consistency, and that human oversight remains critical for
- 3:10structural integrity. Also on r/UI_Design, a designer is
- 3:12questioning the visual hierarchy of a command menu, specifically
- 3:16whether using real app logos for external actions creates
- 3:19unnecessary noise. They're weighing the clarity of brand
- 3:22recognition against the risk of visual clutter. This is a
- 3:24classic usability trade-off. Distinct icons help users orient
- 3:28themselves, but they can also distract from the primary task.
- 3:31The question is less about which icon to choose and more about
- 3:34how much cognitive load we're willing to impose on the user.
- 3:37It's a nuanced balance that requires careful testing, not
- 3:40just aesthetic preference. We're building on a foundation
- 3:43that's becoming increasingly unstable. The tools are
- 3:46changing, the expectations are shifting, and the line between
- 3:49helpful automation and dangerous illusion is blurring.
- 3:59The Feed and The Thread is brought to you by Chicago Camps.
- 4:02For a weekly and monthly exploration of the patterns and
- 4:05signals across UX, you can also check out Patterns and Signals
- 4:08at the website patterns and signals dot com. Chicago Camps
- 4:11will have more events in 2027. You can submit to be a speaker
- 4:14at a future event at Chicago Camps dot org.
- 4:23There's a specific trap in Kyle Soucy's piece about synthetic
- 4:26users that I keep circling back to. She argues that LLMs create
- 4:29a false confidence that small sample sizes never did. The
- 4:32danger is that the research looks clean. We're mistaking
- 4:34simulation for evidence, and that gap is where bad decisions
- 4:37hide. I hear the risk, but I see the opportunity in the
- 4:40speed. When a team uses these tools to generate responses from
- 4:43proto-personas, they're doing rapid hypothesis testing. It's
- 4:45about getting a first pass on the logic before we spend weeks
- 4:48recruiting. If we treat it as a sketch, we avoid the trap Soucy
- 4:51describes. That's the distinction, but it's hard to
- 4:53enforce. The problem is that the output looks like data. It has
- 4:56structure, it has consistency, it feels verified. When a
- 4:59stakeholder sees a clean list of user needs generated by an
- 5:02algorithm, they don't ask where the friction was. They ask why
- 5:04we haven't built it yet. The aesthetic of the output
- 5:07overrides the validity of the source. Exactly. And that's
- 5:10where the human work has to come in. Emily Haines Lloyd points
- 5:12out that the value lies in the specific human connection that
- 5:15algorithms can't replicate. We need to be the ones who
- 5:18introduce the nuance, the contradiction, the "actually,
- 5:20this user would be annoyed by that." The machine gives us the
- 5:23skeleton, but we have to be the ones who breathe the life into
- 5:26it. So the skill is the ability to spot where the simulation
- 5:29breaks down. It's knowing when to stop trusting the clean data
- 5:32and go back to the messy reality. That's a shift in how
- 5:34we validate work. Yes. And I think that's where the real
- 5:37value is. We're not just making tools, we're making judgments.
- 5:40The machine can generate a thousand scenarios, but it can't
- 5:42tell you which one feels wrong in your gut. That intuition,
- 5:45that sense of what's human, is what we're selling. It's about
- 5:48being right. So the question isn't whether to use these
- 5:50tools. It's whether we have the discipline to treat them as what
- 5:53they are. We need to build a habit of questioning the clean
- 5:56data. We need to ask, "where is the human in this?" and mean it.
- 5:59That's the standard that separates a prototype from a
- 6:02product. And that's a skill anyone in this field can build,
- 6:04starting now.
- 6:07That's The Feed and The Thread for today. We'll catch you next
- 6:10time!