Latest / The Newsletter Podcast with Fexingo: Substack, Beehiiv, and Email Newsletter Business / How Newsletters Use Reader Surveys to Boost Paid Conversions
Transcript
- Lucas: There's a moment every newsletter writer hits — you have a solid free readership, maybe ten or twenty thousand subscribers, and you know some of them would pay if you asked the right way. The problem is you don't actually know what they'd pay for. Luna: Right, you're guessing. You assume they want exclusive analysis or early access, but you're projecting your own preferences onto an audience you don't fully understand. Lucas: Exactly. So a growing number of successful newsletter operators are doing something counterintuitive — they pause the content machine and ask their readers directly. I'm talking about structured reader surveys. Not the 'how are we doing?' checkbox thing, but a deliberate instrument designed to surface what a reader would actually open their wallet for. Luna: And there's a specific case study that really made this click for me — Lenny Rachitsky's 'Lenny's Newsletter'. He did a survey before he even launched his paid tier, and it completely shaped his offering. Lucas: Great example. Lenny sent a survey to his free list in late 2020. It was short — maybe ten questions — but it asked things like 'What is your biggest challenge right now?' and 'What format do you prefer for deep dives?' and crucially, 'What would you be willing to pay for?' Luna: And the responses weren't what he expected. He thought people wanted more tactical how-to guides, but the survey revealed that his readers valued his curated list of resources and his candid startup postmortems. So he built his paid tier around those. Lucas: He ended up with a conversion rate north of five percent on his first paid push, which is double the typical industry average of two to three percent. And a lot of that came down to the survey data. He didn't guess — he knew. Luna: But here's the thing — a lot of newsletter writers are terrified of surveys. They worry they'll annoy their audience or that the data will be useless. So what makes a survey actually work? Lucas: First, keep it under ten questions. Anything longer and completion rates drop off a cliff. Second, use a mix of multiple choice and open-ended. The multiple choice gives you quantifiable data, the open-ended gives you the emotional texture. Lenny had both. Luna: And timing matters. He sent it during a lull — not right after a big post, not during a product launch. Just a quiet Tuesday. The subject line was something like 'Help me make this newsletter better' — personal, low pressure. Lucas: The other key is segmentation. You don't send the exact same survey to everyone. If you have a free list and a paid list, you ask different questions. Paid subscribers might tell you what they'd pay more for, free subscribers might reveal their barriers to upgrade. Luna: And then you actually have to act on the data. That sounds obvious, but I've seen writers collect hundreds of responses and then just file them away. The whole point is to change something. Lucas: Speaking of acting on data — that's a good moment for an honest aside. This show is ad-free, and the only reason it exists is because a small group of listeners chip in monthly through buy me a coffee dot com slash fexingo. If you've ever gotten a usable idea from one of these episodes, that's the mechanism that keeps the lights on. No pressure, just the real economics. Luna: Yeah, and it lets us stay independent — no sponsors shaping the content. So if you find value, it's a way to keep these conversations going. Lucas: Back to surveys — once you've got the data, the next step is to actually implement changes and then tell your readers you did. Lenny published a post summarizing the survey results and explaining what he was building. That transparency built trust and set expectations. Luna: There's also the risk of survey fatigue. If you survey too often, readers stop responding. The sweet spot seems to be once per quarter at most, and only when you have a specific decision to make. Lucas: Another best practice: offer an incentive. A chance to win a free year of the paid tier, or a discount code. That lifted Lenny's response rate from maybe ten percent to over thirty percent. Luna: And the tooling matters. Most writers use Google Forms or Typeform. Typeform's conversational interface can feel more engaging, but Google Forms is fine for a quick test. The important thing is that the data is easy to export and analyze. Lucas: One of the most powerful insights you can get from a survey is the 'willingness to pay' question. You ask something like 'What price point would make you hesitate to subscribe?' That gives you a range. Most writers anchor too low — they undervalue their work. Surveys can correct that. Luna: There's a case from the Beehiiv universe — a writer called Dan Oshinsky, who runs a newsletter about email marketing. He surveyed his list and discovered his readers wanted a weekly roundup of links, not long-form essays. So he shifted his paid tier to a curated link digest, and his retention went up. Lucas: That's the counterintuitive part. You might think paid content has to be 'premium' — longer, more in-depth. But sometimes the audience just wants a time-saving curation. The survey reveals that. Luna: What about the ethical angle? If you ask free subscribers what they'd pay for, and they tell you, but then you keep some of that content behind a paywall — is that manipulative? Lucas: I think it's fine as long as you're transparent. You say 'Based on your feedback, I'm building a premium tier that includes X, Y, Z.' You're not tricking anyone. You're using market research. Every business does it. Luna: But you have to deliver. If you promise a weekly Q&A and then only do it once a month, you'll burn trust fast. The survey creates a contract of sorts. Lucas: Which is why some writers do a 'minimum viable paid tier' — launch with just one or two survey-driven features, then iterate based on feedback. That's exactly what Lenny did. He started with a few extra posts per week and a Slack community, then expanded. Luna: And he kept surveying. Every few months, a quick check-in: 'How's the paid tier working for you? What's missing?' That continuous loop is what turns a one-time conversion into long-term retention. Lucas: There's a trap though — confirmation bias. If you already believe your audience wants something, you might design the survey to prove it. You need to include questions that could disprove your hypothesis. Like 'What would make you unsubscribe?' That's a scary question, but it surfaces real pain points. Luna: I've seen newsletters lose subscribers after a survey because the survey itself felt like a bait and switch. If the subject line says 'Help me improve' and then the first question is 'Would you pay $10 a month?', people feel used. Lucas: So the framing has to be genuine. Lead with curiosity, not monetization. 'I want to create something you love' — that's the tone. The payment question comes later, after you've established trust. Luna: Let's talk about sample size. If you have a list of 50,000 free subscribers and only 200 respond, is that data meaningful? Lucas: It can be, if you segment. Those 200 are your most engaged readers — the ones who open every email. Their preferences are probably a leading indicator for the broader list. But you need to be cautious about extrapolating. You might also run a smaller, targeted survey to a random sample to validate. Luna: Another tactic I've seen work: the 'exit survey'. When someone unsubscribes, a one-question form: 'Why are you leaving?' The data is raw and often painful, but it's incredibly useful for reducing churn. Lucas: Absolutely. One writer I know discovered that most unsubscribes were because of email frequency, not content quality. So he reduced from five times a week to three, and his churn dropped by 40 percent. Luna: Surveys also work for B2B newsletters. A writer covering HR tech asked his readers what topics they found most challenging, and they overwhelmingly said 'employee retention'. So he pivoted his paid tier to deep dives on retention strategies, and his conversion rate doubled. Lucas: The common thread is specificity. The more granular your survey, the more actionable the data. Instead of 'What topics interest you?', ask 'Which of these three specific formats would you pay $10 a month for: a weekly video case study, a monthly downloadable template pack, or a private Q&A call?' Luna: That kind of question forces a trade-off. You learn not just what they like, but what they value enough to pay for. Lucas: One last thought: surveys are not a one-time fix. They work best as part of a feedback system that includes open rates, click-throughs, and direct replies. The survey gives you qualitative depth; the metrics give you quantitative breadth. Together, they tell you what to build. Luna: So if someone listening is running a newsletter right now — free or paid — what's the one thing you'd tell them to do this week? Lucas: Send a three-question survey to your most engaged segment. Ask: 'What's your biggest challenge right now?', 'What format do you prefer?', and 'What would make you recommend this newsletter to a colleague?' Don't overthink it. Just do it. Luna: And then actually read the responses. You might be surprised.