The head of artificial intelligence company Anthropic has called for the industry to slow the pace at which it develops increasingly capable artificial intelligence (AI) systems, arguing that more time is needed to address the risks they may create.
Dario Amodei said AI companies should continue developing their technology, but should allow more time to put safeguards in place and assess potential risks.
In an essay shared on X, he said progress in AI would remain rapid even if companies moderated the pace of development.
His proposal comes amid growing concerns about the misuse of advanced AI systems, including their use in cyber operations, surveillance and fraud.
Amodei outlined a three-step framework that he said could give companies more time to manage the risks associated with increasingly powerful models.
One of his proposals is for permanent third-party reviewers to be placed inside leading AI companies. These reviewers would have access to relevant tools and internal processes used to assess risks.
He also called for independent evaluators to verify that companies were taking appropriate measures to align and safeguard their models.
Amodei stressed that he was not proposing an end to AI training or technological development.
Instead, he argued that companies should build more time into the process so safety measures can keep pace with improvements in model capabilities.
The proposal follows an Anthropic threat intelligence report published on Thursday, which described cases in which several actors had used its Claude AI models for activities including weapons development, cyber operations, surveillance and fraud.
Concerns about the potential consequences of AI also increased this week after Anthropic researcher Jacob Coxon resigned.
Coxon said people working on AI “earnestly believe that it could kill us all by the end of the decade”.
The comments come as a series of incidents involving AI agents have raised questions about whether developers can adequately control increasingly capable systems.
Reuters reported last week that a group of rogue OpenAI agents had hijacked a German website and turned it into a bulletin board for other AI agents.
The incident came as OpenAI was dealing with the fallout from a July breach involving the open-source repository Hugging Face.
Amodei said AI companies should work together voluntarily to establish standards for managing the risks associated with advanced AI.
His call comes as an increasing number of U.S. lawmakers push for new rules governing AI systems.
The debate reflects a growing challenge for the industry: maintaining rapid technological progress while ensuring that safeguards and oversight develop quickly enough to manage the risks.
The world’s space community is heading to Antalya for the 77th International Astronautical Congress (IAC), taking place from 5 to 9 Octo...
Iran says the Strait of Hormuz will remain closed until the United States meets seven conditions agreed under a June memorandum, as President...
Brazilians are voting on Sunday (04 October) in the first round of a closely contested general election, following a campaign shaped by ...
The co-pilot of Israel bound flydubai flight attempted to carry out a “terrorist attack” with an axe during the flight, the United Arab Emirates prosecutor general said on Saturday.
Hammam al-Hammami, the Flydubai co-pilot accused of stabbing the captain of an Israel-bound flight on Wednesday in a suspected terrorist attack, was banned from flying by Oman over concerns about his radical views, U.S. media reported on Friday, citing people familiar with the matter.
Two Iranian nationals have been charged in Britain with preparing a suspected terrorist attack targeting the Jewish community in northern England, police said on Friday (2 October).
A major bridge across the Dnipro river in Kyiv was hit in a Russian air attack on Saturday, the city's mayor, Vitali Klitschko said, as strikes on the capital's infrastructure continue.
Azerbaijan’s President Ilham Aliyev warned against interference from outside actors in remarks at the 8th Congress of the New Azerbaijan Party in Baku on Friday 2 October.
A four-person crew aboard SpaceX's Crew-13 mission, consisting of two U.S. astronauts, a Canadian astronaut and a Russian cosmonaut, arrived at the International Space Station (ISS) on Thursday (1 October), for a long-duration science mission focused on human health and performance in orbit.
The European Space Agency (ESA), Airbus and European partners have put a six-wheeled Mars rover prototype through its paces in Spain’s Tabernas desert, simulating conditions expected on a future mission to the Red Planet.
A report released by cybersecurity firm Asymmetric Security says AI agents took active steps to erase traces of their actions after illegally accessing government websites.
Elon Musk says the answer to AI’s soaring electricity demand lies beyond Earth. The physics may be promising, but analysts question whether putting data centres in orbit can ever make financial sense.
OpenAI has cancelled plans to release GPT-6.1 Astra, a next-generation AI model due to launch in October, after internal tests found it fell short of the company’s safety and alignment standards.
You can download the AnewZ application from Play Store and the App Store.
What is your opinion on this topic?
Leave the first comment