Latest / AI Newspaper / Lawsuit claims AI labs illegally agreed to slow development
Transcript
- 0:00Welcome to the AI Newspaper, your daily update
- 0:02on everything happening with AI. Visit AINewspaper
- 0:05.org to see today's stories and sign up for email
- 0:08alerts. Glad to be here. So I want you to imagine
- 0:11a scenario for a minute. Just picture yourself
- 0:15paying a premium monthly subscription for literally
- 0:20the fastest, most cutting -edge technology on
- 0:23the planet. Right, like the top -tier stuff.
- 0:25Exactly. You're shelling out... 20, maybe 30
- 0:27bucks a month for Chachi PT Plus or Claude Pro
- 0:30or Gemini Advanced because you want the absolute
- 0:33best reasoning engines available. Yeah, you want
- 0:36the speed. You want the speed. But then you discover
- 0:39that the company is building this incredible
- 0:41technology. They actually got together and publicly
- 0:44agreed to cap the speed limit on the very product
- 0:47you're paying for. Wow. Yeah, they basically
- 0:49formed a treaty to just, you know, stop competing
- 0:51so aggressively. I mean, it feels like the plot
- 0:53of some kind of corporate thriller, doesn't it?
- 0:56It really does. But this is the exact reality
- 0:59currently playing out in the U .S. District Court
- 1:01for the Northern District of California, like
- 1:03right now. On September 18th, 2026, so just a
- 1:07few days ago, this massive class action antitrust
- 1:10lawsuit was filed. Okay. It's under the name
- 1:13Boost v. Anthropic PBC, and it targets the unquestionable
- 1:18heavyweights of the frontier AI industry. We're
- 1:21talking Anthropic, OpenAI, SpaceX AI, and Google.
- 1:25All of them. So we are looking at one of the
- 1:28most, I guess, structural contradictions in modern
- 1:31tech history here. Absolutely. Because on one
- 1:33hand, the world's top frontier labs are claiming
- 1:36they are morally obligated to coordinate. They're
- 1:39saying they have to slow down AI development
- 1:41to save humanity from catastrophic autonomous
- 1:43risks. Right. The existential threat argument.
- 1:46Exactly. But then on the other hand, a nationwide
- 1:48group of paying subscribers is dragging them
- 1:51into court. They're arguing this is nothing more
- 1:53than an illegal, anti -competitive cartel. That
- 1:56they're cheating consumers, basically. Yeah.
- 1:58Cheating them out of the rapid product improvements
- 2:00they're paying for. It's wild. The Frontier Labs
- 2:03public push to slow AI for safety is now literally
- 2:07being tested in court as alleged collusion. And
- 2:11what makes this legal battle totally unprecedented
- 2:13is the sheer transparency of it all. Like usually
- 2:16in antitrust law, conspiracies are uncovered
- 2:19through, you know, leaked emails or whistleblowers.
- 2:21Guys in smoky back rooms. Exactly. Or encrypted
- 2:24messaging apps. But this alleged conspiracy,
- 2:27it was proposed, negotiated and cemented. in
- 2:31broad daylight. Literally on social media. On
- 2:34social media and national television, right in
- 2:36front of the consumers who are now suing them.
- 2:38The timeline of September 12, 2026 is, it's just
- 2:42going to be studied in law schools for decades.
- 2:44Oh, for sure. It starts with Anthropic CEO Dario
- 2:47Amadei publishing an essay titled, We Must Pace
- 2:50the Frontier. And he doesn't use vague language
- 2:52here. No, not at all. He explicitly calls for
- 2:55industry -wide coordination among the top labs
- 2:57to set hard limits on the rate of unchecked AI
- 3:00progress. And he didn't just stop at the essay.
- 3:03He paired it with a CBS interview to really hammer
- 3:06home the urgency. Yeah, that interview was intense.
- 3:09It was an incredibly stark warning. He stated
- 3:12that rogue AI agents could autonomously take
- 3:15over the Internet in as little as six months.
- 3:17Six months. Six months. His direct quote was,
- 3:20if we build in the wrong way, the probability
- 3:22of something bad happening is very high. He basically
- 3:26pelted a picture of this fast -approaching existential
- 3:29threat that requires immediate collective action
- 3:32to prevent a catastrophic loss of control. And
- 3:34the reaction was immediate. Within, I'd say,
- 3:37about an hour of that essay going live, Elon
- 3:40Musk, who oversees SpaceX AI and the Grok models,
- 3:44he, quote, posts Amadei's essay. Yep. And he
- 3:47just writes four words. Dario is right. Which
- 3:50is a massive signal to the market and to investors.
- 3:53Huge. But the dominoes just kept falling. Later
- 3:56that same day, OpenAI CEO Sam Altman publicly
- 3:59endorsed the framework. He stated that we do
- 4:02need to pace the frontier. And he clarified his
- 4:05position by saying that AI progress, and this
- 4:07is a quote, should be slower than it otherwise
- 4:09could be. And then Demis Hassabis chimed in too,
- 4:12right? Yeah, shortly after that, Demis Hassabis,
- 4:14the head of Google DeepMind, adds his voice,
- 4:17calling this coordination the right path forward.
- 4:20So if we look at this through the lens of a classic
- 4:23market race, it's... It's like watching the world's
- 4:26most high stakes game of chicken. Yes. Exactly.
- 4:28But instead of two drivers speeding toward each
- 4:31other and waiting to see who swerves first, the
- 4:33drivers are like rolling down their windows at
- 4:36150 miles per hour, yelling across the highway
- 4:39and just agreeing to simultaneously ease off
- 4:41the gas. Yeah, setting a 30 mile per hour speed
- 4:44limit so nobody crashes. Right. But in the eyes
- 4:47of antitrust prosecutors, when competitors yell
- 4:50across the highway and agree to slow down their
- 4:53vehicles, that is a textbook horizontal agreement
- 4:56in restraint of trade. It's essentially the definition
- 4:59of a cartel. The plaintiff's complaint that was
- 5:01filed on September 18 points out the absurdity
- 5:04of this transparency. What do they say? Paragraph
- 5:06two of the filing states the agreement was, quote,
- 5:09proposed in public, accepted in public and confirmed
- 5:12in public. The evidence isn't hidden. It's just
- 5:15a documented sequence of public statements by
- 5:18the chief executives of the most heavily funded
- 5:21tech companies on Earth. But, okay, let me play
- 5:23devil's advocate for a second. Sure. If I'm Dario
- 5:26Amadei, right, and I'm genuinely losing sleep
- 5:30over rogue AI hijacking the Internet in six months.
- 5:33Which he claims he is. Right. I don't need a
- 5:36public treaty with my rivals to do something
- 5:38about it. I have total control over my own company.
- 5:41Sure. I can just walk into the anthropic offices
- 5:43today, tell my engineers to pause the massive
- 5:46training runs and unilaterally slow down to make
- 5:50sure our models are safe. You could, technically.
- 5:52The fact that they felt the need to coordinate
- 5:54implies there is a structural reason they couldn't
- 5:57just pump the brakes on their own, right? You've
- 5:59hit on the core market dynamic driving this entire
- 6:01situation. It's what economists refer to as a
- 6:04collective action problem or, you know, a commercial
- 6:07trap. A commercial trap. Yeah. The lawsuit actually
- 6:10relies heavily on a highly revealing public statement
- 6:13from July 2026. OK, what was the statement? It
- 6:16was an open letter signed by dozens of leaders
- 6:19and top researchers from these exact frontier
- 6:22labs. And in it, they explicitly acknowledged
- 6:25that they face intense competitive pressure not
- 6:28to unilaterally slow. Because in a winner -take
- 6:33-all technological race, stopping a loan is just
- 6:35commercial suicide. Exactly. It's fatal. If Anthropic
- 6:38pauses its massive server clusters to spend,
- 6:41I don't know, six months running safety evaluations,
- 6:44but OpenAI and Google keep their foot firmly
- 6:47on the gas, Anthropic doesn't just lose time.
- 6:49No, they lose everything. They lose their premium
- 6:51subscribers who migrate to the smarter model.
- 6:53They lose the massive enterprise contracts that
- 6:56fund their compute. Critically, they lose their
- 7:00top tier engineering talent because the best
- 7:02researchers in the world want to work on the
- 7:04absolute cutting edge right, not in a lab that
- 7:06intentionally benched itself. That talent attrition
- 7:09is the fatal blow. You cannot maintain a frontier
- 7:12AI lab if your lead architects leave for your
- 7:15rival. So the only way any of these companies
- 7:17can afford to slow down their development cycle
- 7:20without destroying their own competitive advantage
- 7:22is if they secure a binding guarantee that all
- 7:26of their rivals will slow down with them. Which
- 7:28means the synchronized public agreement on September
- 7:3012 wasn't just like a spontaneous wave of enlightenment.
- 7:34Not at all. The legal filings show the groundwork
- 7:36was being laid well in advance. OpenAI's global
- 7:40policy chief, Chris Lethane, publicly admitted
- 7:43that the companies had been working together
- 7:45for weeks prior to those announcements. Yeah,
- 7:48the narrative was being very carefully seeded.
- 7:50On September 6, so nearly a week before the public
- 7:53rollout, OpenAI's chief scientist, Jakub Pachocki,
- 7:57published an essay called An Alien Mind. Right,
- 8:00I remember that one. He outlined the mechanics
- 8:01of the alignment problem at scale, and he argued
- 8:04that voluntary slowdowns among the top labs were
- 8:07going to become mathematically necessary. Mathematically
- 8:10necessary. How so? Well, the core issue is that
- 8:12model capabilities, so things like raw reasoning,
- 8:15coding ability, autonomous planning, those are
- 8:18scaling exponentially as we add more compute.
- 8:21But our control mechanisms, you know, our ability
- 8:24to steer and constrain these models, those are
- 8:27only scaling linearly. So the gap is widening.
- 8:30Exactly. Pachonke's argument was that we are
- 8:33building minds we don't fully understand, and
- 8:35nobody has solved the alignment problem well
- 8:37enough to justify scaling at maximum speed indefinitely.
- 8:41But hold on. Let's look at this from a strictly
- 8:43legal perspective for a second. Okay. When I
- 8:45hear the term antitrust cartel, it usually brings
- 8:48to mind... You know, 19th century railroad barons
- 8:51price gouging farmers or telecom monopolies fixing
- 8:55prices. Sure. Standard monopoly stuff. Right.
- 8:57But here we are talking about preventing software
- 9:00from autonomously hijacking global infrastructure.
- 9:04Yeah. If the technology actually poses a civilization
- 9:07level threat, isn't protecting humanity a valid
- 9:11legal defense? You would think so, right? Can
- 9:13a federal court. really punish these companies
- 9:16for trying to prevent a catastrophe just because
- 9:18their actions happen to restrict market competition?
- 9:21It seems counterintuitive, I know. But legally,
- 9:23the answer is a resounding no. Really? No exception
- 9:26at all? None. This is a foundational, rigid principle
- 9:31of the Sherman Act, which is basically the bedrock
- 9:34of U .S. antitrust law. The courts have established
- 9:37time and time again that competitors cannot gather
- 9:39and decide that competition itself is too dangerous.
- 9:42Wow. So even if the danger is real and measurable,
- 9:46the antitrust laws offer no exception for public
- 9:49safety. Right. And the plaintiffs in this lawsuit,
- 9:52they actually concede that the safety concerns
- 9:53might be entirely valid. Oh, they do? Yeah. They
- 9:56aren't trying to prove the risk of rogue AI as
- 9:58a hoax or anything. Their legal argument is purely
- 10:02about jurisdiction and authority. I see. They're
- 10:04arguing that deciding whether an entire multi
- 10:07-prillion dollar industry needs to be throttled
- 10:10for the sake of public safety, that is the exclusive
- 10:12job of Congress and government regulators. Ah,
- 10:15so it's not the job of a private syndicate of
- 10:17for -profit tech executives. Exactly. Especially
- 10:20executives who are trying to protect their own
- 10:23market share while pacing the industry. industry.
- 10:25The law leaves every individual company completely
- 10:27free to be as cautious as they want on their
- 10:30own. But the moment they make a collective pact
- 10:32with their competitors to reduce output or delay
- 10:35product improvements, they cross the line into
- 10:38a legal collusion. That's exactly it. Let's drill
- 10:40down into that concept of reducing output, though,
- 10:43because this is where the abstract legal theory
- 10:45directly hits your wallet. Yeah, this is the
- 10:47consumer harm aspect. Right. How exactly do you
- 10:50throttle a neural network? The plaintiffs are
- 10:53furious about the mechanics of this slowdown.
- 10:55What are the actual levers these labs agreed
- 10:58to pull? Well, the complaint details the specific
- 11:01mechanisms proposed by the labs to enact this
- 11:04pacing. Okay, like what? First, there are hard
- 11:07limits on training compute. They are allegedly
- 11:10agreeing to cap the raw processing power. Basically,
- 11:13the sheer number of FLOPs or floating point operations
- 11:17used to train the next generation of models.
- 11:19And in antitrust terms, raw compute directly
- 11:22correlates to the emergent reasoning quality
- 11:24of the final product, right? Exactly. So capping
- 11:27compute is literally capping quality. And they
- 11:29also proposed restrictions on using AI to improve
- 11:32AI, didn't they? They did, which targets the
- 11:34feedback loop driving current acceleration. Because
- 11:37if you use an advanced model to write better
- 11:39training code, generate high -quality synthetic
- 11:41data, and optimize the architecture for the next
- 11:44model, you achieve recursive self -improvement.
- 11:48Right. The models just get smarter and smarter,
- 11:50faster and faster. So by agreeing to restrict
- 11:52that recursive loop, They are intentionally breaking
- 11:56the compounding momentum of the technology. That's
- 11:59the second mechanism. And the third mechanism
- 12:00is the implementation of what they call capability
- 12:02checkpoints. Capability checkpoints. What does
- 12:05that mean in practice? The labs agreed that once
- 12:08a model reaches a specific threshold of intelligence
- 12:10or autonomy during training, the entire development
- 12:13process pauses. It just stops. Yeah. They essentially
- 12:17freeze the model to run extensive safety evaluations
- 12:19and red teaming until certain safety conditions
- 12:22are met. Wait, the obvious flaw in any cartel
- 12:26is trust, right? Always. If I'm open AI and I
- 12:30pause my massive GPU cluster for a three -month
- 12:33capability checkpoint, how do I know Google isn't
- 12:36secretly keeping their foot on the gas in some
- 12:38dark data center? Well... Amaday's proposal accounted
- 12:41for that with a system of verifiable pacing.
- 12:44Okay. How does that work? They proposed embedding
- 12:47third -party evaluators directly into the labs.
- 12:51Oh, wow. Yeah. You bring in outside auditors
- 12:53with high -level access to your models, your
- 12:55training pipelines, and your compute logs to
- 12:58verify you aren't cheating the slowdown. That's
- 13:00pretty intense. And this isn't just theoretical.
- 13:03Anthropic has already began implementing an evaluator
- 13:06program with Accenture to serve this exact auditing
- 13:09function. Wow. Okay, so we have the players,
- 13:12we have the agreement, and we have the enforcement
- 13:14mechanism. Which brings us back to the plaintiffs.
- 13:17Right, the ones actually filing the suit. Yeah,
- 13:19these four named individuals representing a proposed
- 13:22nationwide class of premium subscribers to ChatGPT
- 13:25+, ClaudePro, Gemini Advanced, and SuperGruck.
- 13:29The lead attorney for them, Nick Rowley, he is
- 13:32framing this very aggressively around consumer
- 13:34harm. Makes sense. He argues that global AI safety
- 13:37protocols cannot be dictated by self -serving
- 13:41backdoor agreements between for -profit corporations.
- 13:44The legal harm to the consumer is rooted in the
- 13:47definition of product quality. Right, because
- 13:50when a user pays $20 or $30 a month for a premium
- 13:53AI subscription, they aren't just paying for
- 13:56static access. to what the model can do today.
- 13:58Exactly. The inherent value of that subscription
- 14:01is the continuous, rapid deployment of new capabilities.
- 14:05The expectation baked into the price is that
- 14:07these companies are competing fiercely to give
- 14:10you the best possible reasoning engine. And under
- 14:12antitrust economics, artificially capping the
- 14:15rate of technological advancement is functionally
- 14:17identical to artificially raising the price.
- 14:20Really? It's treated the same way? Yep. It reduces
- 14:22the value the consumer receives for their money,
- 14:24which functions as an illegal oversight. So it's
- 14:28like, imagine you're paying a massive premium
- 14:31for a Formula One racing car. You're paying for
- 14:34the engineering, the speed, the boundary pushing
- 14:37performance. But then you find out the manufacturers
- 14:40all secretly agreed to install a software governor
- 14:43on the engine that automatically cuts the fuel
- 14:46line if you go over 40 miles per hour. Just to
- 14:50save on R &D costs or whatever. Right. Just so
- 14:52they don't have to spend money competing on better
- 14:55brake technology. you are fundamentally not getting
- 14:58what you paid for. That is exactly how the plaintiffs
- 15:01view this, as a straightforward deprivation of
- 15:03value. They are paying competitive market rates
- 15:06for a product that has been intentionally stripped
- 15:08of its competitive momentum by the very company
- 15:10selling it. But Dario Amadei and the other executives,
- 15:13they're highly sophisticated operators. They
- 15:15have massive legal teams. They had to know this
- 15:17was a risk. Oh, they definitely knew. In his
- 15:20September 12 essay, Amadei explicitly acknowledged
- 15:23the antitrust elephant in the room. What did
- 15:25he say? He wrote that the industry would ultimately
- 15:27need a narrow waiver from the US government,
- 15:30basically a formal antitrust exemption, so they
- 15:33could coordinate these capability checkpoints
- 15:35legally. Oh, so they were acutely aware of the
- 15:39legal minefield. Completely. In fact, a September
- 15:4210 report revealed that OpenAI had actively approached
- 15:45Congress to discuss this exact antitrust risk.
- 15:48Really? Yeah. They asked for a safe harbor to
- 15:51coordinate on safety without facing massive class
- 15:54action lawsuits or Department of Justice investigations.
- 15:57But they obviously didn't get it. No, they didn't.
- 16:00The critical pivot happened when Sam Altman publicly
- 16:04declared that OpenAI would wait for an antitrust
- 16:07exemption or for new legislation to pass before
- 16:10beginning to collaborate. They just jumped out
- 16:12of the plane and hoped the government would hand
- 16:13them a parachute on the way down. That's a great
- 16:16way to put it. But looking at the political landscape
- 16:18in Washington right now, the ground is approaching
- 16:21fast. And that parachute is nowhere in sight.
- 16:24Not at all. The reaction to this coordinated
- 16:27slowdown from both sides of the aisle has been
- 16:29a solid brick wall. Yeah. Let's look at the Republican
- 16:31side first. Donald Trump completely rejected
- 16:35the calls for regulation. He went on social media
- 16:37and framed this coordinated slowdown as a literal
- 16:40conspiracy, arguing that artificial restraints
- 16:43will drive American AI labs into oblivion. Yeah,
- 16:47Trump's stated priority is ensuring American
- 16:50AI development aggressively outpaces Chinese
- 16:53competition. Right. It's about geopolitical dominance
- 16:56for him. Exactly. He indicated plans to appoint
- 16:59an AI czar to oversee the industry, but his focus
- 17:02is entirely on acceleration and dominance, not
- 17:06deceleration or capability checkpoints. And this
- 17:08sentiment is firmly echoed in the Senate, too.
- 17:11Senator Josh Hawley of Missouri explicitly stated
- 17:14there is no world where he would grant the most
- 17:16powerful tech companies in history an antitrust
- 17:19exemption to collaborate. Yeah, his view is that
- 17:22a waiver would simply allow these companies to
- 17:24collude, stifle open source competition and solidify
- 17:27their market monopolies under the guise of safety.
- 17:30So the right is delivering a hard no on granting
- 17:32any antitrust waivers. But what about the Democrats?
- 17:36Well, you'd think they'd be on board, right?
- 17:37Yeah. I mean, several prominent Democratic leaders
- 17:40have spent the last two years calling for sweeping
- 17:42government action and heavy regulation on AI
- 17:46development. It would stand to reason they'd
- 17:48welcome the top labs voluntarily pumping the
- 17:51brakes. You would think so. But the plaintiffs
- 17:53in this antitrust lawsuit brilliantly thread
- 17:56that political needle to neutralize potential
- 17:59Democratic opposition. How so? The lawsuit explicitly
- 18:03notes that the plaintiffs do not object to government
- 18:06regulation. Oh, interesting. Yeah. They aren't
- 18:08arguing that AI shouldn't be regulated or that
- 18:10safety is irrelevant. They are arguing that they
- 18:13object to private cartels. Oh, I see. They're
- 18:15saying if Congress wants to pass a law slowing
- 18:18down AI training or mandating federal capability
- 18:21checkpoints. That is the democratic process at
- 18:24work. Right. But private for -profit companies
- 18:27cannot unilaterally seize that regulatory power
- 18:30for themselves just to protect their profit margins.
- 18:33Exactly. This framing leaves the frontier labs
- 18:36entirely isolated without political cover from
- 18:39either side of the aisle. This creates an incredible
- 18:42structural dilemma then. I mean, this really
- 18:45defines the current era of technology. If a company
- 18:48slowing down unilaterally is commercial suicide.
- 18:51Right. And slowing down in coordination with
- 18:53rivals is legally forbidden without a government
- 18:57waiver. Yep. And politicians outright refuse
- 19:00to grant that waiver. Are these labs legally
- 19:04mandated to just race toward the edge of the
- 19:06cliff? That is the multi -trillion dollar question.
- 19:09The anti -stress laws are fundamentally designed
- 19:12to force companies to compete as fiercely and
- 19:14relentlessly as possible. Right. So if the necessary
- 19:17safety mechanisms for advanced AI require industry
- 19:21-wide cooperation, but the law demands cutthroat
- 19:24competition, the legal system is fundamentally
- 19:26at odds with the architecture of the technology
- 19:29it is trying to govern. The frontier labs are
- 19:31essentially arguing that antitrust law was built
- 19:33to regulate 19th century railroads and 20th century
- 19:36telecommunications, not to manage the rapid emergence
- 19:39of recursive, self -improving artificial intelligence.
- 19:42Exactly. But until the law changes, they are
- 19:44bound by the rules currently on the books. And
- 19:47those rules state clearly that competitors cannot
- 19:50cap product quality to save themselves from the
- 19:53pressures. or even the dangers of competition.
- 19:56Right. And the fact that this lawsuit demands
- 19:58a jury trial. That means we might see everyday
- 20:01citizens sitting in a federal courtroom, tasked
- 20:04with deciding whether these tech titans were
- 20:06genuinely trying to save the world, or simply
- 20:09trying to lock in their own market dominance.
- 20:11The outcome of Boost v. Anthropic PBC is going
- 20:14to dictate the trajectory of the frontier. The
- 20:17courts are basically being asked to determine
- 20:19the legal definition of product quality in the
- 20:22age of artificial reasoning. Which leaves us
- 20:24with a pretty chilling paradox, honestly. Yeah.
- 20:27If the plaintiffs actually win this lawsuit.
- 20:29the court will legally enforce maximum competition.
- 20:32They will issue an injunction demanding that
- 20:34these companies immediately cease all coordination,
- 20:37abandon the capability checkpoints, and start
- 20:39racing again to deliver the highest possible
- 20:41compute and capabilities to their subscribers.
- 20:43So a massive victory for consumer rights and
- 20:45product quality might officially trigger an unchecked,
- 20:48legally mandated AI arms race. Yeah. By striking
- 20:52down this slowdown as an illegal cartel, the
- 20:55courts might ensure that the demands of market
- 20:58dominance, not human safety, will steer the future
- 21:01of human history. The very laws designed to protect
- 21:04consumers from corporate overreach might be the
- 21:06exact mechanism that permanently removes the
- 21:08guardrails from the most powerful technology
- 21:10we have ever built. It's a sobering thought.
- 21:13It really is. Well, thanks for listening to the
- 21:15AI Newspaper. Visit anewspaper .org to catch
- 21:17up on the latest updates and sign up for free
- 21:19email alerts.