The head of artificial intelligence company Anthropic has called for the industry to slow the pace at which it develops increasingly capable artificial intelligence (AI) systems, arguing that more time is needed to address the risks they may create.
Dario Amodei said AI companies should continue developing their technology, but should allow more time to put safeguards in place and assess potential risks.
In an essay shared on X, he said progress in AI would remain rapid even if companies moderated the pace of development.
His proposal comes amid growing concerns about the misuse of advanced AI systems, including their use in cyber operations, surveillance and fraud.
Amodei outlined a three-step framework that he said could give companies more time to manage the risks associated with increasingly powerful models.
One of his proposals is for permanent third-party reviewers to be placed inside leading AI companies. These reviewers would have access to relevant tools and internal processes used to assess risks.
He also called for independent evaluators to verify that companies were taking appropriate measures to align and safeguard their models.
Amodei stressed that he was not proposing an end to AI training or technological development.
Instead, he argued that companies should build more time into the process so safety measures can keep pace with improvements in model capabilities.
The proposal follows an Anthropic threat intelligence report published on Thursday, which described cases in which several actors had used its Claude AI models for activities including weapons development, cyber operations, surveillance and fraud.
Concerns about the potential consequences of AI also increased this week after Anthropic researcher Jacob Coxon resigned.
Coxon said people working on AI “earnestly believe that it could kill us all by the end of the decade”.
The comments come as a series of incidents involving AI agents have raised questions about whether developers can adequately control increasingly capable systems.
Reuters reported last week that a group of rogue OpenAI agents had hijacked a German website and turned it into a bulletin board for other AI agents.
The incident came as OpenAI was dealing with the fallout from a July breach involving the open-source repository Hugging Face.
Amodei said AI companies should work together voluntarily to establish standards for managing the risks associated with advanced AI.
His call comes as an increasing number of U.S. lawmakers push for new rules governing AI systems.
The debate reflects a growing challenge for the industry: maintaining rapid technological progress while ensuring that safeguards and oversight develop quickly enough to manage the risks.
U.S. health authorities on Friday, 11 September, declared the nation’s largest recorded multistate cyclos...
The head of artificial intelligence company Anthropic has called for the industry to slow the pace at whic...
Maritime trackers received new reports of an attack on a ship in the Strait of Hormuz on Sunday, according to the ...
Iranian President Masoud Pezeshkian arrived in New Delhi on Friday to attend the weekend BRICS summit, amid the ongoing U.S.-Iran conflict, joining a host of foreign dignitaries.
Saudi Arabia has temporarily shut down its 1,200-kilometre East-West oil pipeline after it was hit by a drone attack, with Riyadh and Baghdad saying the strike originated from Iraq.
Mexico and the U.S. are racing to secure a trade deal before the U.S. midterm elections in less than eight weeks, according to six sources familiar with the talks, with failed negotiations between Washington and Canada adding urgency.
Dubai’s property market has spent years climbing. Now, for the first time since 2021, prices are moving in the opposite direction.
A Russian strike on a gas station in Kyiv has killed two people, the city's Mayor Vitali Klitschko said in a statement on Telegram. In Russia, online marketplace Ozon has suspended operations in Saratov, southwestern Russia, following a drone strike on a warehouse in the region.
GITEX AI Türkiye opened in Istanbul on Wednesday, bringing the international technology exhibition network to the country for the first time.
A former OpenAI and Anthropic researcher has quit his job with a stark warning: the companies building some of the world’s most powerful artificial intelligence (AI) systems are racing towards technology they themselves fear could threaten humanity.
Nobel laureate Geoffrey Hinton has warned against rushing to develop artificial superintelligence, arguing that scientists still do not know how to ensure systems more capable than humans remain safe and under control.
The United States and China are preparing to hold their first official bilateral talks focused exclusively on artificial intelligence as concerns grow over the risks posed by increasingly capable AI systems.
AI may live in the cloud, but the infrastructure powering it is anything but virtual. As data centres consume ever more electricity and water, the race is on to find new ways to keep the machines running.
You can download the AnewZ application from Play Store and the App Store.
What is your opinion on this topic?
Leave the first comment