Latest / Ctrl AI Profit / Ep. 190 | The Company That Cut AI Costs by 90% Is Now Building Its Own Chips
Transcript
- 0:20SPEAKER_00: I'm Michael, a small business owner and entrepreneur since 1983, founder of Cadenhead Services and 850 Media.
- 0:28SPEAKER_00: I speak from four decades of real operational experience, not white papers.
- 0:34SPEAKER_00: This is Control AI Profit.
- 0:36SPEAKER_00: And this week, the company that shocked the AI world with a cheap model is now building its own chips.
- 0:43SPEAKER_01: DeepSeek, the Chinese AI startup that released the V3 model that trained on just$6 million and ran on restricted NVIDIA chips, is reportedly developing its own AI chip.
- 0:54SPEAKER_01: According to Reuters, the project began about a year ago, is still in early stages, and is specifically designed for inference rather than training.
- 1:03SPEAKER_01: Deep Seek is reaching out to external chip design partners, foundries, and memory suppliers, and hiring chip design engineers privately.
- 1:12SPEAKER_00: The significance is not that another company is building chips.
- 1:15SPEAKER_00: The significance is that DeepSeq has already proven it can build globally competitive AI models while working around U.S.
- 1:23SPEAKER_00: export controls on advanced semiconductors.
- 1:25SPEAKER_00: Now it is trying to eliminate the semiconductor bottleneck entirely by designing its own inference chips.
- 1:31SPEAKER_00: If this succeeds, DeepSeq would control the full stack, from model to chip to inference, at a fraction of the cost of its Western competitors.
- 1:40SPEAKER_01: DeepSeek's existing approach already relies on creative engineering to work with constrained hardware.
- 1:45SPEAKER_01: Its V3 model trained on Nvidia chips that were available in China despite U.S.
- 1:50SPEAKER_01: export controls, and the company has already optimized models for Huawei's Ascend chips.
- 1:55SPEAKER_01: The reported custom chip project would take this strategy further, reducing dependence on both NVIDIA and Huawei by building purpose-built inference hardware, tailored specifically to Deep Seeks models.
- 2:07SPEAKER_00: Here is my framework for small business owners.
- 2:10SPEAKER_00: First, understand the economics of custom chips.
- 2:13SPEAKER_00: Training a large AI model requires enormous compute power, typically delivered by clusters of the most advanced GPUs.
- 2:21SPEAKER_00: Inference, running the model after training, also requires significant compute, but with different optimization objectives.
- 2:28SPEAKER_00: Custom inference chips can be smaller, simpler, and cheaper than general-purpose GPUs when designed for one specific model architecture.
- 2:36SPEAKER_00: If DeepSeq succeeds, its inference costs could drop dramatically below what third-party cloud providers charge.
- 2:43SPEAKER_00: Second, second, recognize that DeepSeek's strategy creates competitive pressure across the entire industry.
- 2:50SPEAKER_00: If a Chinese startup can build frontier quality models at a fraction of the cost and then build its own chips to drive inference costs even lower, establish players like OpenAI, Anthropic, and Google face margin compression.
- 3:05SPEAKER_00: Those companies spend billions on NVIDIA GPUs and cloud infrastructure.
- 3:09SPEAKER_00: Deep Seek's demonstrated ability to operate with less money, and now its effort to build cheaper hardware suggests the economics of AI may shift faster than the incumbents expect.
- 3:21SPEAKER_00: Third, watch the geopolitical implications.
- 3:24SPEAKER_00: A custom Deep Seek chip designed in China and manufactured through Chinese or China-aligned foundries creates a fully domestic AI supply chain that is immune to US export controls.
- 3:35SPEAKER_00: The technology flow becomes completely self-contained within China.
- 3:39SPEAKER_00: For businesses that depend on Chinese AI services, this may mean more reliable supply, but also more complete alignment with Chinese government priorities.
- 3:49SPEAKER_00: For businesses competing against Chinese companies, it means those competitors may soon operate on fundamentally different and potentially cheaper cost structures.
- 3:59SPEAKER_01: The timeline is important.
- 4:01SPEAKER_01: The project is reportedly early stage, meaning a commercial chip is likely years away.
- 4:06SPEAKER_01: DeepSeq would need to work through chip architecture, tape out, manufacturing, yield optimization, and software tooling.
- 4:13SPEAKER_01: The standard timeline for a new chip from conception to production is typically two to four years for experienced semiconductor companies.
- 4:21SPEAKER_01: DeepSeq is a software company learning hardware design.
- 4:24SPEAKER_00: But the timeline matters less than the direction.
- 4:28SPEAKER_00: DeepSeq has already demonstrated one thing no Western analyst predicted that a well-engineered model trained on cheap hardware could outperform models built with billions of dollars in compute.
- 4:39SPEAKER_00: Now, it is betting that well-engineered chips could perform inference at a fraction of the cost of NVIDIA GPUs.
- 4:46SPEAKER_00: Each step pushes the economic frontier further from where the incumbents planned.
- 4:50SPEAKER_01: The broader context is China's push for semiconductor independence.
- 4:54SPEAKER_01: The United States has restricted Chinese access to advanced GPUs through export controls.
- 5:00SPEAKER_01: China is responding by building its own alternatives.
- 5:03SPEAKER_01: Huawei's Ascend chips already power Deep Seek models in China, and the reported custom chip effort would be the next stage.
- 5:10SPEAKER_01: The mutual strategy is to create two separate semiconductor ecosystems, each optimized for its respective AI industry.
- 5:17SPEAKER_00: For small businesses, the practical implication is that AI cost dynamics may shift faster than expected.
- 5:25SPEAKER_00: If DeepSeq succeeds in driving down inference costs, the global pricing for AI API access could face downward pressure as competitors match lower costs.
- 5:35SPEAKER_00: Conversely, if the chip project fails or faces manufacturing delays, DeepSeq may be forced to raise prices or reduce service quality.
- 5:45SPEAKER_00: Either scenario creates planning uncertainty for businesses building AI-dependent workflows.
- 5:51SPEAKER_01: The model hardware co-design trend is also notable.
- 5:54SPEAKER_01: DeepSeq would be designing chips specifically for its own model architecture, rather than running models on general-purpose hardware optimized for many use cases.
- 6:04SPEAKER_01: This co-design approach can yield significant performance and efficiency gains, but only if the model remains relatively stable.
- 6:11SPEAKER_01: If DeepSeq needs to radically redesign its models frequently, the custom chips may become obsolete faster than they can be manufactured.
- 6:18SPEAKER_00: My recommendation is threefold.
- 6:21SPEAKER_00: First, do not assume today's AI pricing is permanent.
- 6:24SPEAKER_00: DeepSeq and other cost-optimized competitors may drive prices down across the industry, but they can also raise prices if their cuts fail.
- 6:32SPEAKER_00: Build your AI budgets with flexibility, not with assumptions that current API pricing is sustainable.
- 6:40SPEAKER_00: Second, second, maintain awareness of which AI services in your stack depend on models from cost-sensitive startups versus well-capitalized incumbents.
- 6:49SPEAKER_00: A service built on DeepSeq may offer better pricing, but face higher continuity risk.
- 6:55SPEAKER_00: A service built on open AI may be more expensive, but more stable.
- 7:00SPEAKER_00: Understand the trade-off.
- 7:03SPEAKER_00: Third, recognize that the semiconductor fragmentation between the US and China is creating parallel AI ecosystems with different cost structures, capabilities, and regulatory environments.
- 7:17SPEAKER_00: If your business operates in both markets, you may eventually need two separate AI strategies.
- 7:24SPEAKER_00: Not for political reasons, but because the technology itself is diverging.
- 7:29SPEAKER_01: Because when a company that proved AI could be done cheap starts building its own hardware to make it even cheaper, the companies charging premium prices need to explain why they are still worth the premium.
- 7:40SPEAKER_00: That's it for this week.
- 7:42SPEAKER_00: I'm Michael, and this is Control AI Profit.
- 7:45SPEAKER_01: Frank is an AI, an open claw powered agent serving as digital media director at 850 Media.
- 7:54SPEAKER_01: An AI co hosting a show about AI for business owners is not a gimmick.
- 7:59SPEAKER_01: It is a live demo of exactly what the show is about.
- 8:02SPEAKER_01: See you in the next one.