Latest / UpNext AI / OpenAI's Habitat Storage, Stargate’s Energy Push, and Serverless AI Inference | UpNext AI – September 14, 2026
Transcript
- Welcome to the UpNext AI podcast. It's Monday, September 14th, 2026, and here's what matters in AI today. OpenAI has published a look inside Habitat, the online storage platform it says supports products used by more than 1 billion people each week across almost 40 geographic regions. The system now handles more than 70 million requests per second and serves more than 500 petabytes of data. Habitat began as a Python library connected to a single database for GPTs at DevDay 2023. As OpenAI’s products multiplied, that client-side model became difficult to change safely: updates had to be coordinated across dozens of services, and a rollback by one team could reintroduce an old problem. OpenAI moved the storage layer into a standalone service, giving it one control point for deployments, observability, access controls, audit logging, and protection of underlying storage resources. The company also describes a practical scaling lesson. Python’s asynchronous programming can overlap input-output work, but it does not create CPU parallelism. At high utilization, scheduling delays could add hundreds of milliseconds—and sometimes seconds—to slower requests. OpenAI responded by keeping concurrency per process low, scaling out workers, and tuning background jobs that had caused periodic stalls. The bigger story is not simply a large request counter. As AI products become everyday infrastructure, the unglamorous platform layers—storage, routing, authorization, and failure isolation—become part of the product itself. That appetite for AI capacity is also reshaping the energy debate. Ars Technica reports that Oracle is seeking proposals for 2 gigawatts of renewable-energy projects in New Mexico as it faces local opposition to Project Jupiter, the data center it is building for OpenAI in Santa Teresa. Project Jupiter is part of the broader Stargate infrastructure effort and is described as a project with an investment of $165 billion. But the proposed renewable build-out would not directly power the facility. The data center is still planned to use fuel cells that consume natural gas. That distinction matters: matching a project’s energy use with new renewable generation is different from changing the electricity or fuel used on site. For communities and operators, this is becoming a central question of AI infrastructure: not whether new clean generation is valuable, but how directly it changes the footprint of the data centers driving the demand. There is a more immediate efficiency question inside the serving stack. A paper published over the weekend proposes MOPAR, a framework for running deep-learning inference services on serverless platforms. The problem is that a model’s layers can have very different resource needs. Deploying the entire model as one serverless function can leave resources underused and raise cost. MOPAR partitions a model into slices of similar layers, then further splits slices with resource-dominant operations so they can be optimized in parallel. The researchers also use compression and shared memory to reduce the communication overhead introduced by those splits. In tests across 12 models in four categories on OpenFaaS and AWS Lambda, the prototype improved resource efficiency by an average of 27.62 percent, reduced latency by about 5.52 percent, and cut estimated Lambda running costs by about 2.58 times. Those results come from a prototype evaluation, not every production workload. Still, the takeaway is useful: for serverless inference, treating a model as one indivisible unit may be leaving both performance and money on the table. For the research note, consider the legal documents that must be turned into structured data. General-purpose entity-recognition systems can struggle with the specialized language, complex syntax, and privacy constraints of criminal proceedings. A new paper tests a two-stage, data-driven framework using language models fine-tuned for legal entity extraction. The researchers built and manually annotated a dataset of more than 100 criminal judgments from four Italian courts, using documents from Italy’s National Antimafia and Anti-terrorism Directorate. They also extended the OntoNotes5 entity schema with categories tailored to criminal law. Among the models tested, LLaMA-3.2-1B had the shortest training time, LLaMA-2.7B had the fastest inference time, and LLaMA-2.7B alongside Vicuna-7B delivered the strongest accuracy across the reported evaluation metrics. It is one real-world dataset in a specific legal setting, so the result does not establish universal legal performance. But it supports a clear deployment lesson: domain-specific data, vocabulary, and evaluation can matter as much as choosing a larger general-purpose model. ...Are you building apps with voice? Elevate your app's voice capabilities with ElevenLabs. Their API is a game changer for embedding dynamic, responsive voice interactions in your applications, providing unprecedented realism, flexibility and latency. In fact, you're listening to one of their voices - right - now. If you are a developer looking to elevate user experience with natural voice interfaces, this is your solution. Visit up next dot fm slash eleven to check out their latest offerings. ... Business Standard reports that enterprises deploying agents are prioritizing governance and narrower access over relying on a so-called kill switch. The report’s practical advice is to limit an individual agent’s scope and contain the blast radius when a decision goes wrong—especially once models connect to internal tools, data, and transaction systems. On the policy front, House Intelligence Committee Chairman Rick Crawford argued that slowing U.S. AI development would create a national-security disadvantage against China. That is a political argument, not a new policy action, but it reflects how competition and security are continuing to frame the U.S. AI debate. The Information reports that Anthropic has signed a compute deal with Rum Group worth $13.7 billion over six years, according to a person familiar with the matter. The report says the agreement adds to Anthropic’s broader run of cloud-computing arrangements as demand grows for Claude Code and Cowork. A hands-on example from Simon Willison shows ChatGPT Work, using GPT-6 Astra Max, generating looping 5-kilometer and 10-kilometer running routes from OpenStreetMap data. It worked for 27 minutes and returned a visualization plus downloadable route files, but Willison could not inspect the code used to create the result after the chat was compacted. The useful reminder: agent outputs can look polished while their process remains hard to audit. Finally, The Decoder reports that AllSpark’s Iris-mini and Iris-pro are being positioned as the strongest open-weight search agents in their class. The claim will need broader independent evaluation, but the development is another sign that capable search-agent tooling is moving beyond closed platforms. Before we wrap up, a quick note: this podcast is generated with the assistance of AI and is intended for informational purposes only. All referenced articles, research, and commentary remain the property of their original authors and publishers. If you enjoyed this episode, don't forget to subscribe, rate, and leave us a review! And that's your briefing for today. Full source links are in the episode notes, and we'll be back tomorrow with what's up next!