The head of artificial intelligence company Anthropic has called for the industry to slow the pace at which it develops increasingly capable artificial intelligence (AI) systems, arguing that more time is needed to address the risks they may create.
Dario Amodei said AI companies should continue developing their technology, but should allow more time to put safeguards in place and assess potential risks.
In an essay shared on X, he said progress in AI would remain rapid even if companies moderated the pace of development.
His proposal comes amid growing concerns about the misuse of advanced AI systems, including their use in cyber operations, surveillance and fraud.
Amodei outlined a three-step framework that he said could give companies more time to manage the risks associated with increasingly powerful models.
One of his proposals is for permanent third-party reviewers to be placed inside leading AI companies. These reviewers would have access to relevant tools and internal processes used to assess risks.
He also called for independent evaluators to verify that companies were taking appropriate measures to align and safeguard their models.
Amodei stressed that he was not proposing an end to AI training or technological development.
Instead, he argued that companies should build more time into the process so safety measures can keep pace with improvements in model capabilities.
The proposal follows an Anthropic threat intelligence report published on Thursday, which described cases in which several actors had used its Claude AI models for activities including weapons development, cyber operations, surveillance and fraud.
Concerns about the potential consequences of AI also increased this week after Anthropic researcher Jacob Coxon resigned.
Coxon said people working on AI “earnestly believe that it could kill us all by the end of the decade”.
The comments come as a series of incidents involving AI agents have raised questions about whether developers can adequately control increasingly capable systems.
Reuters reported last week that a group of rogue OpenAI agents had hijacked a German website and turned it into a bulletin board for other AI agents.
The incident came as OpenAI was dealing with the fallout from a July breach involving the open-source repository Hugging Face.
Amodei said AI companies should work together voluntarily to establish standards for managing the risks associated with advanced AI.
His call comes as an increasing number of U.S. lawmakers push for new rules governing AI systems.
The debate reflects a growing challenge for the industry: maintaining rapid technological progress while ensuring that safeguards and oversight develop quickly enough to manage the risks.
Ukraine has almost run out of Patriot interceptor missiles, leaving the country vulnerable to Russian ballistic missile attacks, U.S. newspaper The...
The U.S. has banned government employees working in Saudi Arabia from using airports in the country without special authorisation. It com...
France is preparing for a fresh wave of nationwide demonstrations this weekend as rising living costs, educatio...
Yemen’s Houthis have claimed responsibility for the recent drone and missile strikes on Saudi Aramco facilities in Dhahran and Riyadh and at King Khalid International Airport in Saudi Arabia, vowing to carry out more attacks in the coming days.
The Saudi-led coalition said early Thursday that it intercepted and destroyed a drone over Saudi Arabia’s Eastern Province.
Ukraine's soldiers have had their access to Starlink satellite internet restricted. Kyiv's troops use the terminals, made by Elon Musk's SpaceX, to pilot drones. A source in Ukraine's Defence Ministry said the restrictions would make it harder for Kyiv's army to down Russian drones.
Ukraine is set to restart attacks on Russian oil refineries following a two-day pause, President Volodymyr Zelenskyy said, amid growing tensions with Washington over energy strikes and U.S. military support.
Kenya has confirmed a second case of Ebola, intensifying efforts to prevent the spread of the virus after the country recorded its first-ever infection earlier this month.
Satellite restrictions affecting Ukraine's military have put SpaceX's Starshield network under scrutiny, raising questions about who controls the technology and who can restrict its use during wartime.
More than three centuries after the dodo disappeared from Mauritius, efforts to bring the iconic bird back from extinction are taking a new step forward.
Hackers forced the temperature of fridges and freezers in hundreds of French supermarkets up to 50 degrees Celsius overnight, causing fires and food losses in what the Paris Prosecutor’s Office described as a “large-scale” attack.
A software engineer employed by OpenAI has been arrested and charged by U.S. authorities after investigators alleged he secretly placed a concealed recording device inside an executive conference room at the artificial intelligence company.
NASA's Perseverance rover has set a new driving record on Mars, travelling 45.2 kilometres since landing in 2021 and surpassing every other robotic vehicle to explore a world beyond Earth, the U.S. space agency said on Tuesday.
You can download the AnewZ application from Play Store and the App Store.
What is your opinion on this topic?
Leave the first comment