Latest / The High Net Worth Podcast with Fexingo: Wealth Management, Tax Strategy, and Affluent Finance / How Family Offices Use Debt for Tax Efficiency
Transcript
- Lucas: If our money conversations have helped you think about a decision differently, we would love your support. It is listener donations like yours that keep this show ad-free and allow us to dig into these topics without commercial interference. You can find us at buy me a coffee dot com slash fexingo. Luna: Thanks for the support, Lucas. It really does make a difference in how deep we can go on these structural questions. Lucas: Let's get straight into it. The conventional wisdom for the ultra-wealthy is simple: sell an asset, pay the tax, live the proceeds. But that is often the most expensive way to fund a lifestyle or a new venture. Today we are looking at why sophisticated family offices are increasingly choosing debt over equity when they need cash. Luna: So instead of triggering a taxable event, they borrow against what they already own? Lucas: Exactly. And the math is compelling. When you sell a stock or a piece of real estate, you trigger capital gains tax immediately. In the current September twenty twenty six market, with rates stabilized but still above the zero-rate era, the cost of borrowing has risen, but it is often still cheaper than the immediate tax hit plus the opportunity cost of losing that asset's future appreciation. Luna: But isn't there a risk if the asset value drops? That sounds like a classic margin call waiting to happen. Lucas: It is a valid concern, which is why this strategy requires discipline. We are talking about high-quality collateral here. Think blue-chip equities, investment-grade commercial real estate, or even diversified private equity holdings. The key metric family offices watch is the loan to value ratio. They rarely borrow more than fifty percent of the asset's value. Luna: That creates a massive buffer against volatility. If the market dips, they still have room before hitting any warning lights. Lucas: Precisely. A fifty percent loan to value means the asset has to lose half its value before the lender gets nervous. For a well-diversified portfolio, that is a long time horizon. Meanwhile, the interest on that loan is often deductible if the proceeds are used for investment purposes. So you are effectively arbitraging the spread between your after-tax cost of debt and your pre-tax return on assets. Luna: Wait, so they are earning on the full asset value while only paying interest on half of it? Lucas: Yes, and that compounding effect is where the real wealth is built. Let's look at a concrete example. Imagine a family office holds five million dollars in Apple stock. Instead of selling two million dollars worth to fund a new property purchase, they take out a one-point five million dollar loan against the position. Luna: And they avoid the capital gains tax on that two million dollars entirely? Lucas: They avoid it today. The principal remains intact. If Apple goes up another ten percent next year, their collateral base grows, giving them more borrowing capacity without ever having to liquidate shares. They are leveraging their balance sheet to maintain control and defer taxes indefinitely. Luna: This feels like the opposite of the retail investor mindset where people try to time the market by buying low and selling high. Lucas: It is night and day. Retail investors often feel pressure to realize gains to prove they made money. Institutional players know that unrealized gains are just paper until they are taxed. By keeping those gains unrealized, they retain maximum purchasing power. Plus, there is the estate planning angle. Luna: The step-up in basis? Because the debt is paid off from the estate, the heirs get the asset free and clear? Lucas: Spot on. If the borrower passes away, the estate can use life insurance proceeds or other liquid assets to pay off the loan. The heirs then inherit the underlying asset with a stepped-up cost basis. They start fresh, with no historical capital gains liability attached to that position. It is a incredibly powerful tool for generational wealth transfer. Luna: So the debt disappears, and the asset resets. That seems like the holy grail of estate planning. Lucas: It is, provided you don't over-leverage. The danger zone is when family offices start treating borrowed money as free income. If you borrow to fund a lavish lifestyle rather than productive assets, you are digging a hole. The interest compounds, and eventually, the debt service eats into your ability to maintain the loan to value cushion. Luna: That is a common mistake I see even among successful entrepreneurs. They treat their home equity line like a checking account. Lucas: Right. And home equity lines are risky because residential real estate can be illiquid in a downturn. Private banks lending against securities or commercial real estate are much more sophisticated. They offer lower rates because the collateral is easier to value and liquidate. As of September twenty twenty six, prime lending rates are hovering around five percent, which is manageable if your portfolio is yielding seven or eight percent. Luna: So the spread is still there, but it is tighter than it was five years ago. That changes the calculus significantly. Lucas: It does. Five years ago, you could borrow at two percent and invest at four percent. Now you need your assets to perform better to justify the leverage. This forces family offices to be more selective about their underlying holdings. You cannot just throw garbage into a portfolio and expect to borrow against it. Luna: Quality over quantity. The bar for collateral has been raised. Lucas: Exactly. Lenders are also looking at cash flow coverage. If you are borrowing against rental properties, they want to see strong occupancy. If you are borrowing against stocks, they want to see low volatility. It is a holistic view of risk that individual investors rarely get access to. Luna: Do you see a lot of family offices using this to buy back their own companies' stock? Lucas: We do. It is a very common tactic for founders who want to increase their ownership stake without diluting the company or triggering personal tax events. They borrow against their existing shares, buy more shares, and essentially consolidate control. It is aggressive, but mathematically sound if you believe in the long-term trajectory. Luna: That sounds risky if the stock price collapses, though. One bad quarter could wipe out the equity cushion. Lucas: It is concentrated risk. That is why you usually see this done by individuals with deep pockets and stable income streams elsewhere. If your only source of wealth is that one volatile stock, borrowing against it is a recipe for disaster. Diversification is the safety net. Luna: So the lesson is: don't put all your eggs in one basket, especially if you are using that basket as collateral. Lucas: Well said. Another nuance is the type of debt instrument. Family offices often use private placement notes or securitized debt structures rather than standard bank loans. These can be customized to match the cash flow needs of the borrower. Maybe you want interest-only payments for five years, or maybe you want to capitalize the interest, adding it to the principal balance. Luna: Capitalizing interest is smart for cash-poor, asset-rich situations. You don't have to write a check every month. Lucas: Correct. It preserves liquidity. But remember, capitalized interest increases the loan balance, which tightens your loan to value ratio over time. You have to monitor that closely. It is a silent drag on your equity position. Luna: I can see why these family offices have dedicated teams just watching the balance sheets. Lucas: They do. And they use technology to track real-time valuation changes. Automated alerts trigger when a position drops below a certain threshold. It removes emotion from the equation. If the collateral weakens, the system flags it, and the relationship manager steps in to discuss restructuring or additional collateral. Luna: Is there a downside to this strategy that people overlook? Lucas: Regulatory scrutiny is growing. The IRS is becoming more interested in large loan balances that persist for decades. There is a concept called 'built-in gain' that can come into play if the loans are forgiven or structured in certain ways. It is not a free pass forever. Eventually, someone has to die or sell, and the tax bill comes due. Luna: Deferral is not elimination. It is just pushing the payment further down the road. Lucas: Exactly. But in finance, time is money. Deferring tax allows that capital to compound for another decade. That extra growth often outweighs the eventual tax liability. It is a temporal arbitrage. Luna: So it is less about avoiding tax and more about optimizing the timing of it. Lucas: Perfectly put. And that optimization is what separates the amateurs from the professionals. Amateurs sell when they need cash. Professionals borrow when they have assets. Luna: I think a lot of listeners will benefit just from understanding that distinction. Lucas: Absolutely. If you have significant assets but limited liquidity, exploring asset-backed lending should be your first conversation, not your last resort. It keeps your options open and your tax burden managed. Luna: Smart move. It keeps the engine running without selling the car. Lucas: For now, the question is whether you will wait until the market corrects to rebalance, or if you will start thinking about leverage as a tool rather than a trap.