A former OpenAI and Anthropic researcher has quit his job with a stark warning: the companies building some of the world’s most powerful artificial intelligence (AI) systems are racing towards technology they themselves fear could threaten humanity.
Jacob Coxon announced his resignation from Anthropic in a post on X that has been viewed more than 140 million times.
“I spent the last three years doing pretraining research at both OpenAI and Anthropic,” Coxon wrote. “Neither company is acting responsibly. They are racing straight to self-improving superintelligence and gambling with our lives.”
Coxon warned that future systems could become capable of outperforming humans across fields, conducting sophisticated cyberattacks and eventually improving their own capabilities.
“The people building AI earnestly believe that it could kill us all by the end of the decade,” he wrote.
Coxon’s claims quickly received support from people currently or previously working inside leading AI laboratories.
Anthropic researcher Evan Hubinger said Coxon was “correct”, adding that he personally estimates the probability of AI killing all humans at more than 10 per cent within the next decade.
“I believe Anthropic is trying its best, but we do not yet have a plan to solve alignment for superintelligence,” Hubinger wrote.
Anna Wang, who previously worked at Google DeepMind and now works at Anthropic, described the concern as common among her peers and said there was not yet a viable scientific plan for managing risks from recursively self-improving AI.
Former Google DeepMind researcher Alex Turner also backed Coxon, saying many researchers believe they are building technology that could eventually kill everyone on the planet.
The extraordinary public exchange has also drawn attention from U.S. lawmakers. Senator Bernie Sanders backed Coxon’s warning and said he would introduce legislation seeking to ban artificial superintelligence and pause AI development.
Other lawmakers have called for stronger safeguards, including Republican Senator Ted Cruz, who described the potential consequences of AI as a “catastrophic risk”.
Anthropic said it has “always been transparent” that AI could bring both enormous benefits and unprecedented risks, adding that it continues to develop safeguards and supports greater coordination over the release of increasingly powerful models.
Coxon, however, argues that voluntary restraint is unlikely to be enough while companies remain locked in competition.
“Should you put your head down because ‘it’s happening anyway’,” he asked fellow researchers, “or take this moment to call for different conditions?”
Ukrainian forces struck a Russian oil refinery in Siberia and a seaport in Dagestan in the past 24 hours, President Volodymyr Zelenskyy s...
Overnight Iranian strikes on an air base in Jordan damaged multiple U.S. aircraft and left one without a wing, American media reported. Meanwhile, ...
A former OpenAI and Anthropic researcher has quit his job with a stark warning: the companies building some of the world’s most powerful arti...
Four people were killed, including a child, in Ukrainian strikes on the Russian port city of Novorossiysk overnight, according to the governor of the Krasnodar region. Ukraine's drone forces commander, Robert Brovdi, said Russian military ships were destroyed in the attacks.
A TV channel was struck during a live broadcast on Tuesday, Ukrainian President Volodymyr Zelenskyy said, as Russian strikes on Kyiv killed at least three people, the city's Mayor Vitali Klitschko said. Meanwhile, drones hit civilian infrastructure in Russia's southwestern Saratov region.
U.S. Central Command (CENTCOM) said its forces destroyed five Iranian crude oil carriers after the Islamic Revolutionary Guard Corps (IRGC) allegedly launched two ballistic missile attacks against a U.S. Navy warship over the past two days.
Wildfires have broken out in Türkiye’s Antalya province, forcing hundreds of people to evacuate as strong winds fuelled the flames.
Iran’s Revolutionary Guards (IRGC) said on Wednesday they attacked two U.S. vessels and eight oil tankers in the Persian Gulf, calling the strikes a response to a U.S. attack on five Iranian tankers.
Nobel laureate Geoffrey Hinton has warned against rushing to develop artificial superintelligence, arguing that scientists still do not know how to ensure systems more capable than humans remain safe and under control.
The United States and China are preparing to hold their first official bilateral talks focused exclusively on artificial intelligence as concerns grow over the risks posed by increasingly capable AI systems.
AI may live in the cloud, but the infrastructure powering it is anything but virtual. As data centres consume ever more electricity and water, the race is on to find new ways to keep the machines running.
Hua Hong Semiconductor, China's second-largest contract chipmaker, is investing $2 billion to build a new fabrication plant in Wuxi, China as part of a push to expand capacity as domestic demand for AI-related chips outstrips what the industry can currently produce.
A humanoid robot developed by Chinese smartphone maker Honor has run 100 metres in 9.32 seconds, beating Usain Bolt's men's world record of 9.58 seconds, China's state broadcaster reported on Saturday.
You can download the AnewZ application from Play Store and the App Store.
What is your opinion on this topic?
Leave the first comment