Latest / The Financial Freedom Podcast with Fexingo: Quitting Your Job, Living Off Investments, Independence / How to Avoid the Social Security Tax Torpedo in Early Retirement
Transcript
- Lucas: There is a tax trap in early retirement that nobody warns you about. It's called the Social Security tax torpedo, and it can quietly take fifty cents out of every dollar of your benefits — if you don't plan for it. Luna: I've heard the term, but I think most people assume Social Security isn't taxed unless you're rich. That's not the whole story, right? Lucas: Not at all. The IRS has a formula called 'provisional income' that determines how much of your benefit gets included in taxable income. And the thresholds are surprisingly low. For a married couple filing jointly, once your provisional income passes $44,000, up to 85 percent of your Social Security becomes taxable. Luna: So if you're living off a mix of investment withdrawals and maybe a small pension, you can easily cross that line without feeling wealthy. Lucas: Exactly. And that's the trap. Let's use a concrete example. Say you're a married couple, both 63, retired early. You have $30,000 in dividends and interest from a taxable account, plus you take $10,000 from your traditional IRA. That's $40,000 of income so far. Your Social Security benefit is $24,000 a year. You'd think you're in a low tax bracket. But the formula adds half of your Social Security — $12,000 — to that $40,000, giving you provisional income of $52,000. Luna: Which is over the $44,000 threshold. So now the IRS taxes 85 percent of your benefit. Lucas: Right. That means $20,400 of your $24,000 gets added to your taxable income. You're suddenly in the 22 percent federal bracket, plus state tax, and your effective marginal rate on that last dollar of IRA withdrawal can be north of 40 percent. That's the torpedo. Luna: So the solution isn't to avoid Social Security — it's to control what goes into the provisional income formula. Lucas: Bingo. And the best tool for that is a Roth conversion ladder — done before you claim benefits. If you convert your traditional IRA to a Roth in your fifties or early sixties, those Roth withdrawals don't count toward provisional income. They're invisible to the formula. So you can live on that money without pushing your benefits into the tax zone. Luna: But you have to pay tax on the conversion itself. So there's a trade-off: pay tax now to avoid a higher tax later. That's a classic timing decision. Lucas: And it's one where a little math goes a long way. Let me give you a real scenario. A couple I work with had $500,000 in a traditional IRA and planned to claim Social Security at 62. They were going to withdraw $20,000 a year from the IRA to cover expenses. I ran the numbers — their marginal rate on that IRA dollar would have been 46.5 percent because of the torpedo. Luna: Forty-six and a half percent. That's almost half. So what did they do? Lucas: They delayed Social Security to 70 and did Roth conversions in the gap years. They converted $30,000 a year from 62 to 69, paying 12 percent tax on that money. Then at 70, their Social Security is much larger — about $38,000 a year instead of $24,000 — but they have a Roth account with over $200,000 that they can draw tax-free, keeping provisional income under the threshold. Their effective tax rate on Social Security dropped to zero. Luna: So they paid a known low rate now to avoid an unknown high rate later. And they got a bigger Social Security check as a bonus. Lucas: That's the core of it. The torpedo is only dangerous if you let it hit you. If you plan ahead, you can steer around it. And the key is to keep your provisional income below the first bend point — that $32,000 for singles, $44,000 for couples — at least until you've claimed benefits. Luna: What about someone who has to claim early? Say health issues or job loss. Lucas: That's a harder case. But even then, you can manage the torpedo by using cash or a Roth for five years until you reach full retirement age. The point is to avoid withdrawing from a traditional account in the same year you're collecting Social Security, if you can help it. Every dollar of IRA withdrawal adds a dollar to provisional income, and then 50 cents of your benefit becomes taxable — it's a double whammy. Luna: It reminds me of the idea that in early retirement, the withdrawal order is everything. You don't just withdraw from any account — you sequence it based on tax consequences. Lucas: Exactly. And this is where the 'taxable account first, then Roth, then traditional' rule of thumb breaks down. If Social Security is in the picture, you want to keep your taxable income low in the years you claim. So you might actually withdraw from Roth first, even though that's usually considered the most valuable account to let grow. Luna: That's counterintuitive. Most of us are taught to leave Roth alone as long as possible because of the tax-free growth. Lucas: And that's still generally right — but not if it triggers the torpedo. If you're sitting on a pile of traditional IRA money, the growth in that account is going to get taxed eventually. The question is when and at what rate. Using Roth early to prevent a 46 percent marginal rate later is a win even if it means sacrificing some tax-free compounding. Luna: So the real strategy is to build a 'Social Security tax bridge' — a pool of money that doesn't count toward provisional income, like cash, Roth contributions, or a health savings account — and live on that from the time you retire until you start benefits. Lucas: And then keep using that bridge to manage your taxable income even after you claim. If you have a year where you need extra cash for a car or a roof, you pull from the bridge instead of the IRA. That way you don't accidentally spike your provisional income and lose 85 cents of every Social Security dollar to taxes. Luna: It's a lot of moving parts. But the core message is clear: don't assume Social Security is untaxed, and don't claim benefits without a plan for the tax interaction. Lucas: And honestly, this kind of planning is exactly why we do this show ad-free. We want you to have the tools without the noise. If these conversations have helped you think about your own retirement differently, and you'd like to support that mission, you can at buy me a coffee dot com slash fexingo. No pressure, just a way to keep the podcast independent. Luna: Yeah, it's a small gesture that goes a long way. We appreciate everyone who's contributed. Now back to the torpedo — one more nuance I want to get into. Lucas: Sure. What's on your mind? Luna: What about the two-year look-back? Doesn't the IRS use your prior year's income to determine the tax on your benefits? Lucas: That's a common myth. Actually, the tax is based on your current year's provisional income. But there's an important detail: you can request that the IRS withhold taxes from your Social Security check, and that withholding is treated as paid evenly throughout the year. So if you have a big lump sum in December, you can adjust your withholding to avoid a penalty. But the tax itself is calculated on the actual income of that year. Luna: Good to clarify. So no look-back, but you can manage the payment timing. Lucas: Exactly. And the other nuance is that states matter. Twelve states tax Social Security benefits to some degree, and their rules vary. Colorado, for example, recently started phasing out its tax. But if you live in one of those states, you're looking at an additional state tax on top of the federal torpedo. Luna: So location is a lever too. Moving to a no-tax state could be part of the strategy. Lucas: It can be. But the bigger lever is controlling your withdrawal sources. The simplest way to avoid the torpedo is to have enough in Roth or taxable accounts to cover your spending from retirement until age 70. Then you can delay Social Security, get the 8 percent annual increase, and take benefits at a time when your income is naturally lower. Luna: That's the ideal path. But what about someone who's already 63 and has most of their savings in a 401k? Is it too late? Lucas: It's not too late, but it's harder. You can still do partial Roth conversions over the next few years before you claim. The key is to keep your provisional income under the $44,000 threshold each year during the conversion. That might mean converting only $20,000 a year instead of $50,000. It takes longer, but you avoid the torpedo in the conversion years and build a Roth balance for later. Luna: So the message is: don't panic, but do start planning now. The torpedo is real, but it's avoidable with intentionality. Lucas: Exactly. And the worst thing you can do is ignore it and end up paying 46 cents in tax on your last dollar of retirement income. That's money that could have funded travel, hobbies, or grandkids' college. A few hours with a spreadsheet — or a good tax planner — can save you tens of thousands over a retirement. Luna: I think that's a great place to leave it. Next time we'll dig into another specific trap — maybe the Medicare IRMAA surcharges and how to avoid those too. Lucas: Perfect. That's a natural follow-up. Thanks for listening, everyone.