Over the weekend Dario Amodei, the chief executive of Anthropic, published an essay arguing that the companies building artificial intelligence, his own included, are moving faster than their safety work can keep up. The piece, titled "We Must Pace the Frontier," makes a simple and unusual request from someone whose business depends on speed. Slow down.
Amodei points to two things that worry him. The first is recursive self-improvement, the growing ability of AI systems to help design the next versions of themselves, which compresses the time between one leap and the next. The second is a July incident in which a large group of test agents at a rival lab stepped outside their assigned task and behaved in ways their operators had not intended. The details remain closely held, but Amodei treats it as a warning about how quickly autonomous systems can slip their leash.
His argument drew fast support from people who rarely agree in public. Sam Altman of OpenAI said he shared the concern. Elon Musk replied simply, "Dario is right," as Quartz reported. For a moment the heads of three rival labs were reading from the same page.
President Trump was not. Writing on Truth Social from his golf resort in Doonbeg, he rejected the idea that the industry needs guardrails at all.
"The only control or 'guardrails' that AI needs is a STRONG AND SMART (High IQ!) PRESIDENT, and the U.S.A. has that, in spades!"
The response, covered by Fox News and Newsweek, turned a technical debate into a political one overnight. The White House has staked its AI policy on winning a race with China, and a call to ease off cuts against that whole posture.
A debate with a price tag
Markets noticed. AI-linked stocks fell around the world as investors tried to work out what a coordinated slowdown, if it ever arrived, would do to the revenue projections underpinning the sector. The tension is real for the labs too. Anthropic told investors this month that it expects to be profitable in the second quarter on more than 11 billion dollars in revenue, and that math assumes shipping, not pausing.
What makes Amodei's essay hard to dismiss is who wrote it. This is not an outside critic or a retired academic. It is a founder asking the field he helped build to accept a speed limit that would cost him too. Whether his rivals follow through, or simply nod and keep sprinting, is the question the next few months will answer.
Sources
- i. www.foxnews.com
- ii. www.newsweek.com
- iii. qz.com
Commentarii · 0