Warnings from researchers at leading U.S. artificial intelligence (AI) developer Anthropic, that increasingly powerful AI models could escape human control have drawn attention in China, where policymakers have already been preparing for some of the same risks.
The United States and China are the two main drivers of frontier AI development and the technology's global adoption. Both superpowers have been at loggerheads over AI policies and industry practices, with these issues slated to feature prominently in bilateral talks later this month.
Both countries share AI-control concerns but favour different safeguards. Beijing relies more on state oversight; U.S. debate hinges on company-level controls, whilst China flags risk of rogue AI agents and is developing regulation to prevent such incidents.
While the debate in the U.S. is focused on whether frontier AI could pose an existential threat to humanity, Chinese policymakers have generally treated AI as a powerful but governable technology whose risks can be contained through technical standards, regulation and state oversight.
“Chinese and American experts largely agree on AI risks,” said Brian Tse, founder and CEO of Concordia AI, adding the difference was on “how risks are framed and prioritised”.
Chinese developers have increasingly promoted open-weight models. These refer to systems whose underlying parameters can be downloaded, inspected, and modified. Their leading U.S. rivals such as Anthropic and OpenAI, however, do not make these specifications publicly available.
Policy issued in May by China's cyberspace regulator, economic planner and industry ministry identifies “operational loss of control” as a security risk for AI agents - systems that can plan and carry out multi-step tasks more independently than conventional chatbots.
China's strategy require developers to improve their ability to discover, intervene, block and recover from improper or rogue AI agent behaviour.
The policy also calls on developers to guard against risks including data poisoning, algorithm manipulation and system vulnerabilities. It also says the AI system must be transparent so that users should be informed about agents' autonomous decisions and retain final decision-making authority, so that humans stay in control.
Beijing flags risks from leading U.S. AI models
China's Minister of State Security, Chen Yixin, wrote in a government outlet on Sunday (13 September) that advanced U.S. models such as Anthropic's Mythos and OpenAI's GPT-5.5-Cyber could pose serious risks to China's critical information infrastructure, and called for a comprehensive strengthening of AI security.
Anthropic and OpenAI did not immediately respond to Reuters requests for comment.
Chinese AI developers have promoted open-weight models partly on the grounds that cybersecurity teams can inspect, modify and deploy them for defensive work.
But experts also highlight the risks posed by open-weight models, which can be modified and redistributed with little oversight.
Regulators flag AI 'loss-of-control' risk
China first included an explicit future loss-of-control scenario in an AI safety framework released in September 2024 under the guidance of the Cyberspace Administration of China (CAC).
The document said it could not be ruled out that future AI might autonomously obtain external resources, replicate itself, develop self-awareness and seek external power, creating a risk of competing with humans for control.
The CAC released an expanded version in September 2025. The newer framework sharpened the scenario, saying AI could undergo a sudden and unexpectedly large “leap” in intelligence before acquiring resources, replicating itself and seeking power. It also added a governance principle of “trusted application, preventing loss of control”.
Different approach to 'pacing'
China's regulatory approach differs from calls in some Western AI-safety circles for developers to slow or pause development of the most capable models until stronger safeguards are in place.
It has instead since early this year pushed for the integration of AI into all industries, part of Beijing's bid to make technology the new engine of the world's second-largest economy.
But China has also shown it can delay deployment when officials believe governance has not caught up.
Saudi Arabia said its air defences destroyed a Houthi drone south of Mecca before it could enter prohibited airspace over the holy city, as attacks...
Warnings from researchers at leading U.S. artificial intelligence (AI...
Ukrainian President Volodymyr Zelenskyy said that Ukraine was carrying out tests on a new weapon to intercept dron...
U.S. Central Command said 101 commercial vessels have been redirected in the Strait of Hormuz, while oil prices rose more than three per cent amid fresh regional attacks and supply concerns.
U.S. President Donald Trump has again said Iran is keen to reach a deal quickly, but a senior Iranian security official rejected the claim, saying Tehran will not negotiate until its conditions are met.
A Russian strike on a farm warehouse in Pryluky, north-central Ukraine, has killed at least three people, local police said. Meanwhile, EU foreign policy chief Kaja Kallas said an attack on a train near the Polish border was an attempt to intimidate Ukraine's allies.
A Danish military helicopter came within “metres” of being struck by flares fired by a Russian warship, Denmark's Defence Minister Jeppe Bruus said on Tuesday. Russia accused Denmark of carrying out “dangerous manoeuvres” near its ship, and said it was investigating the incident.
A federal judge has halted a Trump administration immigration policy that would have significantly changed how long foreign students, exchange visitors and international journalists can remain in the United States.
The U.S. has deployed weapons in Earth’s orbit capable of defending its forces against hostile action, Air Force Secretary Troy Meink said, marking the first public acknowledgement of such capabilities.
Shares in artificial intelligence-related companies fell sharply across Asian markets on Monday, after some of the industry's most prominent chief executives warned that the breakneck pace of AI development needs to slow down.
The head of artificial intelligence company Anthropic has called for the industry to slow the pace at which it develops increasingly capable artificial intelligence (AI) systems, arguing that more time is needed to address the risks they may create.
GITEX AI Türkiye opened in Istanbul on Wednesday, bringing the international technology exhibition network to the country for the first time.
A former OpenAI and Anthropic researcher has quit his job with a stark warning: the companies building some of the world’s most powerful artificial intelligence (AI) systems are racing towards technology they themselves fear could threaten humanity.
You can download the AnewZ application from Play Store and the App Store.
What is your opinion on this topic?
Leave the first comment