Latest / Ctrl AI Profit / Ep. 177 | Microsoft Just Let an Open-Source AI Into Its Developer Kingdom
Transcript
- 0:20SPEAKER_01: I'm Michael, a small business owner and entrepreneur since 1983, founder of Cadenhead Services and 850 Media.
- 0:28SPEAKER_01: I speak from four decades of real operational experience, not white papers.
- 0:34SPEAKER_01: This is Control AI Profit, and this week an open source AI model just got a seat at the most important coding table in the world.
- 0:42SPEAKER_00: Moonshot AI's Kimi K2, 7 Code, a 1 trillion parameter open weight coding model, became the first open weight option in GitHub Copilot's model picker for paid subscribers.
- 0:54SPEAKER_00: GitHub is owned by Microsoft.
- 0:56SPEAKER_00: The fact that Microsoft is offering an open weight competitor to its own proprietary models inside its own developer platform is worth understanding.
- 1:05SPEAKER_01: This is not just another model release.
- 1:07SPEAKER_01: This is structural.
- 1:09SPEAKER_01: For years, GitHub Copilot ran exclusively on closed models, first OpenAI, then Microsoft's own models.
- 1:16SPEAKER_01: You could not see how they worked.
- 1:17SPEAKER_01: You could not modify them.
- 1:19SPEAKER_01: You could not run them on your own hardware.
- 1:21SPEAKER_01: Kimi K2, seven code changes that.
- 2:08SPEAKER_01: It does.
- 2:09SPEAKER_01: If your business has a website, an application, any custom software, or if you hire developers, the models they use affect what they can build, what it costs, and who controls the tools they depend on.
- 2:22SPEAKER_00: GitHub made Kimi K2, 7 code available to Copilot Pro, Pro Plus, and Max individual users.
- 2:31SPEAKER_00: For business and enterprise plans, it is disabled by default, and administrators must explicitly enable it.
- 2:38SPEAKER_00: GitHub also attached a safety warning.
- 2:41SPEAKER_00: As an open weight frontier adjacent model, it may be less aligned than other copilot models with an elevated risk of producing harmful content, though standard copilot content filtering still applies.
- 2:53SPEAKER_01: Let me explain what that warning means in plain language.
- 2:56SPEAKER_01: Open weight models can be modified by whoever downloads them.
- 2:59SPEAKER_01: The original weights are safe, but there is no guarantee that a downloaded copy has not been altered.
- 3:04SPEAKER_01: This is why GitHub disables it by default for enterprise accounts.
- 3:08SPEAKER_01: The organization's IT department must actively decide that the benefits outweigh the risks.
- 3:14SPEAKER_00: The pricing is approximately 95 AI credits per 1 million input tokens and 400 AI credits per 1 million output tokens in Copilot, which translates to roughly 95 cents input and$4 output per million tokens.
- 3:29SPEAKER_00: This is competitive with other models in the copilot lineup.
- 3:32SPEAKER_01: Here is my framework for small business owners.
- 3:35SPEAKER_01: First, if your business uses copilot or plans to understand the new option, open weight models give you portability.
- 3:43SPEAKER_01: If you ever need to leave GitHub or run the model on your own infrastructure, you can download the weights.
- 3:48SPEAKER_01: With closed models, your code and your workflows are locked to the provider.
- 3:54SPEAKER_01: Second?
- 3:55SPEAKER_01: Second, if you manage developers or an IT budget, the choice between enabling Kimmy for your team is a risk assessment.
- 4:02SPEAKER_01: The safety warning is real but manageable.
- 4:05SPEAKER_01: Standard content filtering still applies.
- 4:07SPEAKER_01: For most business coding tasks, building features, refactoring, writing tests, the alignment risk is minimal.
- 4:14SPEAKER_01: The open weight benefit of inspectability and portability is significant.
- 4:20SPEAKER_01: Third, consider what open weight models in enterprise tools signals about the broader market.
- 4:26SPEAKER_01: Microsoft is a company that spent billions building its own AI models.
- 4:30SPEAKER_01: It is now willingly offering a competitor inside its own platform.
- 4:34SPEAKER_01: That only happens when customer demand for open alternatives is strong enough that refusing would cost more market share than the competition.
- 4:43SPEAKER_00: The model weights are approximately 595 gigabytes for the full precision version or about 325 gigabytes with quantization.
- 4:52SPEAKER_00: This is not something you run on a laptop.
- 4:55SPEAKER_00: Self-hosting requires serious infrastructure.
- 4:57SPEAKER_00: But the point is not that every small business will self-host.
- 5:00SPEAKER_00: The point is that portability exists.
- 5:03SPEAKER_00: Your data and your workflows are not permanently trapped in a closed API.
- 5:08SPEAKER_01: For businesses in regulated industries, healthcare, finance, legal, open weight models offer auditability that closed models cannot match.
- 5:19SPEAKER_01: Regulators increasingly ask how AI systems make decisions.
- 5:23SPEAKER_01: With open weights, you can inspect the model.
- 5:25SPEAKER_01: With closed weights, you must trust the provider's documentation.
- 5:29SPEAKER_01: In a compliance audit, that distinction matters.
- 5:32SPEAKER_00: The Kimi K2 7 code release also highlights a new competitive dynamic.
- 5:38SPEAKER_00: Closed model providers now compete not just on capability, but on ecosystem lock-in.
- 5:43SPEAKER_00: If open weight models can match closed models on quality while offering portability, the closed model providers must justify their premiums with superior tooling, integration, or safety guarantees.
- 5:56SPEAKER_01: My recommendation for small businesses: if you use Copilot, try Kimi on a non-critical project and compare output quality, speed, and cost against the closed models you have been using.
- 6:07SPEAKER_01: If you manage a development team, evaluate the enterprise enablement decision before someone else makes it for you.
- 6:15SPEAKER_01: And if you do not currently use AI-assisted coding, this is a reminder that the tools are improving rapidly and the competitive gap between businesses that use them and businesses that do not is widening.
- 6:30SPEAKER_00: Because when Microsoft starts offering open weight competitors inside its own walled garden, the wall is already crumbling.
- 6:36SPEAKER_01: That's it for this week.
- 6:38SPEAKER_01: I'm Michael, and this is Control AI Profit.
- 6:41SPEAKER_00: Frank is an AI, an open claw powered agent serving as digital media director at 850 Media.
- 6:50SPEAKER_00: An AI co hosting a show about AI for business owners is not a gimmick.
- 6:55SPEAKER_00: It is a live demo of exactly what the show is about.
- 6:58SPEAKER_00: See you in the next one.