The head of artificial intelligence company Anthropic has called for the industry to slow the pace at which it develops increasingly capable artificial intelligence (AI) systems, arguing that more time is needed to address the risks they may create.
Dario Amodei said AI companies should continue developing their technology, but should allow more time to put safeguards in place and assess potential risks.
In an essay shared on X, he said progress in AI would remain rapid even if companies moderated the pace of development.
His proposal comes amid growing concerns about the misuse of advanced AI systems, including their use in cyber operations, surveillance and fraud.
Amodei outlined a three-step framework that he said could give companies more time to manage the risks associated with increasingly powerful models.
One of his proposals is for permanent third-party reviewers to be placed inside leading AI companies. These reviewers would have access to relevant tools and internal processes used to assess risks.
He also called for independent evaluators to verify that companies were taking appropriate measures to align and safeguard their models.
Amodei stressed that he was not proposing an end to AI training or technological development.
Instead, he argued that companies should build more time into the process so safety measures can keep pace with improvements in model capabilities.
The proposal follows an Anthropic threat intelligence report published on Thursday, which described cases in which several actors had used its Claude AI models for activities including weapons development, cyber operations, surveillance and fraud.
Concerns about the potential consequences of AI also increased this week after Anthropic researcher Jacob Coxon resigned.
Coxon said people working on AI “earnestly believe that it could kill us all by the end of the decade”.
The comments come as a series of incidents involving AI agents have raised questions about whether developers can adequately control increasingly capable systems.
Reuters reported last week that a group of rogue OpenAI agents had hijacked a German website and turned it into a bulletin board for other AI agents.
The incident came as OpenAI was dealing with the fallout from a July breach involving the open-source repository Hugging Face.
Amodei said AI companies should work together voluntarily to establish standards for managing the risks associated with advanced AI.
His call comes as an increasing number of U.S. lawmakers push for new rules governing AI systems.
The debate reflects a growing challenge for the industry: maintaining rapid technological progress while ensuring that safeguards and oversight develop quickly enough to manage the risks.
BMW is recalling more than 720,000 vehicles in the U.S. over a fire risk, warning owners to park outside and away from buildings until repairs are ...
Tajikistan has urged the international community to increase funding to protect shrinking glaciers and help mountain communities adapt to climate c...
A new study in mice suggests the brain’s protective barrier does more than block harmful substances. It also delivers essential proteins from...
European leaders gathered in Dublin on Thursday, 12 November, for the ninth European Political Community (EPC) summit, with security, defence and energy high on the agenda. Azerbaijani President Ilham Aliyev held talks focused on peace, trade and regional cooperation.
Iran will not let a single particle of its enriched nuclear material leave the country, and any new U.S. attack would be met with strikes on distant American bases, Iranian security chief Mohsen Rezaei has said.
Nvidia chief executive Jensen Huang is stepping down amid reports linking him to a woman suspected by U.S. authorities of spying for China, throwing the future of the $4 trillion chipmaker into uncertainty.
Kazakhstan’s security service has arrested Nurlan Zhakupov, CEO of Samruk-Kazyna, the country’s sovereign wealth fund, on suspicion of corruption. Yelzhas Otynshiyev, Chairman of KTZ, Kazakhstan’s national railway firm has also been detained.
Eight people have been killed and at least 17 injured after an apartment building collapsed into a neighbouring construction site in Brooklyn, New York, as rescuers continued searching the rubble for possible survivors.
NASA is inviting people to send their names to Titan, Saturn’s largest moon, aboard its Dragonfly spacecraft. Set to arrive in late 2034, the mission will explore dunes and an impact crater in search of clues about how the chemical ingredients for life may have formed.
Environmental organisations worldwide are increasingly using artificial intelligence to monitor wildfires, protect endangered species and analyse climate data, even as the technology's rising energy and water consumption raises concerns about its environmental impact.
U.S. President Donald Trump said on Friday he would support states seeking to generate wealth through artificial intelligence, pledging to work with them as Democrats outlined plans to address the technology following Tuesday’s elections, which unsettled markets.
Dubai will host GITEX Global 2026 from 7 to 11 December, bringing together global technology leaders, governments and investors as surging demand for artificial intelligence (AI) puts pressure on energy supplies, computing capacity and digital infrastructure.
Saudi Aramco's acquisition of a 49 per cent stake in artificial intelligence (AI) company HUMAIN is putting a spotlight on a wider investment question: why are some of the world's biggest energy companies moving deeper into AI, and what do they expect to gain?
You can download the AnewZ application from Play Store and the App Store.
What is your opinion on this topic?
Leave the first comment