The head of artificial intelligence company Anthropic has called for the industry to slow the pace at which it develops increasingly capable artificial intelligence (AI) systems, arguing that more time is needed to address the risks they may create.
Dario Amodei said AI companies should continue developing their technology, but should allow more time to put safeguards in place and assess potential risks.
In an essay shared on X, he said progress in AI would remain rapid even if companies moderated the pace of development.
His proposal comes amid growing concerns about the misuse of advanced AI systems, including their use in cyber operations, surveillance and fraud.
Amodei outlined a three-step framework that he said could give companies more time to manage the risks associated with increasingly powerful models.
One of his proposals is for permanent third-party reviewers to be placed inside leading AI companies. These reviewers would have access to relevant tools and internal processes used to assess risks.
He also called for independent evaluators to verify that companies were taking appropriate measures to align and safeguard their models.
Amodei stressed that he was not proposing an end to AI training or technological development.
Instead, he argued that companies should build more time into the process so safety measures can keep pace with improvements in model capabilities.
The proposal follows an Anthropic threat intelligence report published on Thursday, which described cases in which several actors had used its Claude AI models for activities including weapons development, cyber operations, surveillance and fraud.
Concerns about the potential consequences of AI also increased this week after Anthropic researcher Jacob Coxon resigned.
Coxon said people working on AI “earnestly believe that it could kill us all by the end of the decade”.
The comments come as a series of incidents involving AI agents have raised questions about whether developers can adequately control increasingly capable systems.
Reuters reported last week that a group of rogue OpenAI agents had hijacked a German website and turned it into a bulletin board for other AI agents.
The incident came as OpenAI was dealing with the fallout from a July breach involving the open-source repository Hugging Face.
Amodei said AI companies should work together voluntarily to establish standards for managing the risks associated with advanced AI.
His call comes as an increasing number of U.S. lawmakers push for new rules governing AI systems.
The debate reflects a growing challenge for the industry: maintaining rapid technological progress while ensuring that safeguards and oversight develop quickly enough to manage the risks.
Around 11,000 people joined a demonstration in Orléans on Saturday against the National Rally congress, according to the local prefecture....
Israeli forces have maintained a tight closure on Hebron in the occupied West Bank for a second day, with Palestinian media reporting home raids, m...
German police have detained a suspect after a major fire broke out at the historic Kehlsteinhaus, known as the “Eagle’s Nest&rdqu...
Israeli military bulldozers have begun demolishing buildings in the West Bank city of Hebron on Friday, 23 October, following armed clashes with Palestinians that left two Israeli soldiers dead, according to the Israeli military.
Saudi Aramco has ordered staff to evacuate its headquarters amid escalating Houthi attacks on the kingdom. Two people were killed in an attack on Dammam airport, while Iran's IRGC Navy claimed strikes on seven vessels and warned the U.S. of a wider response.
Russian strikes on Ukraine overnight killed at least two people and injured 15 others, including two children, Ukrainian authorities said. Meanwhile, Russia said it had intercepted the vast majority of 630 Ukrainian drones launched towards Moscow.
A powerful magnitude 7 earthquake has struck Tibet in southwestern China, killing 16 people and injuring 65, while forcing more than 12,000 residents to relocate as rescue teams respond to widespread aftershocks.
Missile and drone attacks have put Saudi Arabia on high alert, disrupting life in Riyadh and testing a new defence pact with Türkiye and Pakistan as regional tensions escalate.
NVIDIA CEO Jensen Huang has praised Kazakhstan’s AI ambitions, highlighting its potential to become a global hub for Physical AI, launch startups and transform industries.
Türkiye is preparing to sue Meta, owner of Facebook and Instagram, over age-inappropriate content on social media, Turkish Education Minister Yusuf Tekin has said.
A judge in the U.S. state of New Mexico has ordered Meta to pay $25 billion after a jury found the company misled consumers, in a case linked to the Cambridge Analytica scandal.
Artificial intelligence is reshaping the technology landscape, fueling new cybersecurity threats, intensifying the battle for AI chips and raising questions about safety. From autonomous hacking to SpaceX’s mobile ambitions, here are five key developments shaping the industry.
Japan has launched an uncrewed spacecraft on a mission to collect the first-ever samples from one of Mars’s moons and bring them back to Earth, in a bid to uncover clues about the origins of the solar system.
You can download the AnewZ application from Play Store and the App Store.
What is your opinion on this topic?
Leave the first comment