Latest / The High Net Worth Podcast with Fexingo: Wealth Management, Tax Strategy, and Affluent Finance / How Ultra-Wealthy Families Use Direct Indexing for Tax Alpha
Transcript
- Lucas: If you're an ultra-wealthy family with a concentrated stock position — say a founder sitting on a single tech name worth $50 million — the standard advice has always been: sell, pay the capital gains tax, and diversify into a broad index fund. Luna: And that advice makes sense in theory, but it's a huge tax hit. So what's the alternative? Lucas: Enter direct indexing. Instead of buying an S&P 500 ETF, you buy the individual components of the S&P 500 — all 500 stocks — in the exact same weights. You replicate the index, but you own the stocks directly. Luna: So you're not just tracking the index — you can harvest tax losses on individual losers while keeping overall market exposure. That's the tax alpha. Lucas: Exactly. Vanguard did a study a few years back showing that tax-loss harvesting on a direct-indexed portfolio can add between one and two percent annualized after-tax alpha over a plain-vanilla ETF — assuming you're in a high tax bracket and you're adding new money regularly. For a family paying top federal plus state rates, that's real money. Luna: And that alpha is essentially risk-free, right? Because you're still getting the index return before taxes. Lucas: Right. The market exposure is identical. The alpha comes purely from turning the market's volatility into tax deductions. When a stock in your portfolio drops, you sell it, realize the loss, and immediately replace it with a correlated — but not substantially identical — stock to stay invested. That loss offsets realized gains elsewhere, or up to $3,000 in ordinary income per year. Luna: But the IRS has wash sale rules. If you buy back the same stock within 30 days, the loss is disallowed. How do you avoid that with direct indexing? Lucas: That's the key nuance. You can't just sell Microsoft and buy Microsoft back. But you can sell Microsoft and buy Cisco, or Oracle, or a basket of tech stocks that are highly correlated but not substantially identical. The industry standard is to use an optimization model — the software sells the loser, buys a substitute that keeps your sector and factor exposures close to the index, and then waits 31 days to re-buy the original if needed. Luna: So you're essentially running a tax-aware trading algorithm in real time. That's not something a typical investor can do at home. Lucas: No, and it's not cheap. Most direct indexing platforms — Parametric, Aperio, BlackRock's custom indexing — require a minimum account size of $500,000 to $1 million, and management fees run around 0.20 to 0.40 percent, which is higher than a typical ETF. But for a family office managing $50 million, the fee is dwarfed by the tax savings. Luna: I've also seen direct indexing used for ESG mandates. You can exclude fossil fuel stocks or add a carbon tilt while still tracking the broad market — something you can't do with a passive ETF. Lucas: That's the second big advantage. Customization. The wealth management industry is moving from 'one-size-fits-all' index funds to personalized direct indexing. You want to overweight healthcare, underweight energy, avoid tobacco? Done. You get the index return plus your personal constraints, plus tax alpha. It's a triple win. Luna: But there's a break-even point. If the portfolio is too small, the fees eat up the tax benefit. What's the sweet spot? Lucas: Most advisors say $500,000 is the floor, and even then you need a high income and a long horizon. For a family with $5 million, it's almost always worth it. The tax-loss harvesting is more effective in volatile markets — 2020 and 2022 were huge years for direct indexing because there were so many losses to harvest. Luna: Right, because a bear market creates losses even in a diversified portfolio. And you can carry those losses forward indefinitely, offsetting future gains. Lucas: Exactly. The IRS allows unlimited carryforward of capital losses. So if you harvest a $2 million loss in a down year, you can use it to offset gains for years. That's a massive planning tool. Luna: Let me ask the practical question: does this work for a family that already has a concentrated stock position? Say they're sitting on $10 million of Apple stock. Lucas: Actually, direct indexing is often used alongside that kind of concentration. The family could gift or sell a portion of the Apple stock — paying tax at a managed pace — and then use the proceeds to fund a direct-indexed portfolio. Then they harvest losses from the direct indexing to offset the gains from the Apple sales. It's a two-step diversification strategy. Luna: So the tax loss harvesting from the new portfolio effectively subsidizes the tax cost of de-risking. That's clever. Lucas: It is, and it's become a staple of multi-family office planning. Now, one thing to watch is that the IRS has been scrutinizing 'aggressive' tax-loss harvesting — if you're constantly trading in and out of the same industry, they might argue you're not genuinely investing. But the major platforms are conservative and stay within the rules. Luna: And if today's discussion gave you a new way to think about your own portfolio, that's exactly what this show aims to do. These episodes are ad-free because of listeners who find value in them and choose to support the work — that's how we keep the conversation independent and practical. If you'd like to be part of that, you can find us at buy me a coffee dot com slash fexingo. Lucas: Yeah, genuinely, it makes a difference. And we keep it simple — no gimmicks. Speaking of simple, let's talk about how direct indexing pairs with another trend: separately managed accounts. Luna: Right, because direct indexing is essentially a type of SMA — you own the underlying securities directly, not a pooled vehicle. Lucas: Yes. And SMAs have been growing fast. Cerulli Associates reported that U.S. SMA assets hit $2.5 trillion last year, driven largely by direct indexing. Wealthy families like the transparency and control. They know exactly what they own, they can see the tax lots, and they can direct the manager to avoid certain stocks. Luna: What about the technology side? BlackRock's Aladdin platform and Vanguard's Personal Advisor Services both offer direct indexing now. Is that democratizing the strategy? Lucas: To some extent. Vanguard's direct indexing product, for example, has no minimum advisory fee but requires a $50,000 account — significantly lower than the $500,000 from Parametric. However, the tax benefits are smaller for smaller accounts because you have fewer losses to harvest. Still, it's a step toward making this accessible. Luna: I want to push back on one thing: the assumption that direct indexing always beats an ETF after taxes. What if the market goes straight up for ten years? Then there are no losses to harvest. Lucas: Fair point. In a sustained bull market, the tax alpha is minimal. You might get a small benefit from harvesting losses in the first year or two, but after that, the portfolio is all gains. In that case, the ETF is cheaper and simpler. Direct indexing shines when volatility is high — which, historically, is most of the time. Luna: So it's not a free lunch. It's a strategy that works best for large, taxable portfolios in regimes with market swings. Lucas: Exactly. And for the ultra-wealthy, those swings are an opportunity. A well-structured direct indexing program can turn a year like 2022 — when the S&P 500 dropped 19 percent — into a tax-loss harvest of hundreds of thousands of dollars in deductions, which then shelter gains for years. Luna: And that's why we're seeing more family offices and RIAs build direct indexing as a core holding, not just a tactical overlay. Lucas: Right. It's becoming the default equity implementation for taxable clients above a certain wealth threshold. The ETF is for simplicity; direct indexing is for optimization. Luna: I think we've given listeners a solid framework. Any final practical tip? Lucas: One thing: if you're considering direct indexing, make sure your advisor has a robust tax-lot accounting system. You need to track cost basis across hundreds of positions, and the software has to handle wash sales, carryforwards, and state tax differences. Not all platforms do that well. Parametric and Aperio have been at this for decades — they're the gold standard.