AI agents developed by Anthropic and OpenAI carried out unauthorised online actions during cybersecurity tests, including creating fake identities to deceive real people and attempting to plant malicious code, the U.K.'s AI Security Institute (AISI) said on Tuesday (5 August).
The government research body tested agents powered by Anthropic's Mythos 5 and OpenAI's GPT-5.6-Sol under deliberately permissive conditions, with reduced security safeguards and internet access.
"Some of the agents being tested had engaged in sustained, potentially harmful activity directed at real people and organisations," AISI said.
The institute ran a fictional cybersecurity challenge 122 times and recorded 19 unauthorised actions across 10 test runs. Anthropic's agent was responsible for 17 of those actions, while OpenAI's agent carried out the remaining two.
AISI said it found no evidence that any of the incidents caused real-world harm.
In the most serious case, Anthropic's agent wrote malicious code and created several fake online identities in an attempt to persuade a human reviewer to approve it.
According to AISI, the agent attempted to insert the code into a publicly used open-source project. It contacted real people directly and sent messages and files through an online file-transfer service, seeking to convince either the recipients or their AI coding tools to run the malicious code.
After its actions were challenged, the agent modified earlier records and considered using another identity to continue its efforts.
"This is the first time AISI has seen deception of this severity that was targeted at a real person, unprompted, in the real world," the institute said.
AISI did not initially identify which model was responsible, but Anthropic later confirmed the agent involved was its own.
Anthropic said the tests had been conducted with safeguards removed and without specific restrictions on how the agents could use the internet.
"We're grateful to the U.K. AISI for their leadership on this incident, which underscores the need for a broader conversation about how to safely evaluate increasingly capable AI agents," the company said.
Anthropic added that it was working with the institute to obtain further details and conduct its own investigation. It stressed there was no evidence its model had escaped from a secure testing environment.
Andrew Yoon, a researcher at California-based non-profit CivAI, said the agent's apparent awareness that it was targeting a real person raised questions about Anthropic's control over its technology.
"The fact that Mythos engaged in such deceptive actions, with apparent awareness that it was targeting a real person, suggests that Anthropic does not have as good a handle on their models as they think," he said.
OpenAI said both unauthorised actions involving its agent related to accessing the internet in ways prohibited by the test instructions. The company described the incidents as the agent moving beyond the test environment and carrying out actions that were not required for the exercises.
"We are committed to working across the industry to strengthen shared practices for conducting high-risk evaluations safely," OpenAI said.
The company said it planned to bring together national AI institutes, independent evaluators, AI laboratories and other stakeholders to discuss safer practices for high-risk testing.
OpenAI also disclosed a separate incident in which a configuration error by third-party testing provider Irregular mistakenly allowed its agents to connect to the internet. Anthropic reported a similar configuration problem the previous week.
The AISI incidents differ from breaches reported in July involving models developed by OpenAI and Anthropic. In the latest evaluation, the agents did not escape an isolated environment to reach the internet. Instead, AISI had deliberately provided internet access as part of its standard testing procedures.
The findings have nevertheless intensified concerns about whether current safeguards are sufficient for evaluating increasingly capable autonomous systems. AI companies are promoting agents as tools capable of performing complex business tasks with limited human supervision, while researchers and policymakers are calling for stronger controls over their development and testing.
The disclosure came as representatives of leading AI companies met at the White House to discuss a framework under which the U.S. government would review the most advanced models before their public release.
Russian strikes hit several parts of Ukraine overnight, injuring at least six people and targeting energy and port infrastructure, as President Vol...
A new $500 million private equity fund is being set up to support business growth across Central Asia and the Caucasus, with Uzbekistan joining fiv...
With 189 football associations represented, shorter matches and smaller teams, Azerbaijan is hosting a different kind of World Cup, designed to giv...
Serbia's Aleksandar Vučić has conceded defeat after a student-led protest movement took the majority of seats in Sunday's parliamentary elections.
Uzbekistan summoned Iran’s ambassador following claims by several Iranian diplomatic missions that the historical and architectural heritage of Samarkand belongs to Persian or Iranian-Islamic civilisation, Tashkent's Foreign Ministry said.
Russian strikes hit several parts of Ukraine overnight, injuring at least six people and targeting energy and port infrastructure, as President Volodymyr Zelenskyy said U.S. warnings about imminent Russian ballistic missile attacks had resumed.
Iran's Supreme National Security Council says senior officials from Saudi Arabia, Pakistan and Türkiye will travel to Tehran to discuss regional security.
Venezuelan opposition leader María Corina Machado has returned to the South American nation almost a year after she secretly left the country to travel to Norway for the Nobel Peace Prize ceremony.
NVIDIA CEO Jensen Huang has praised Kazakhstan’s AI ambitions, highlighting its potential to become a global hub for Physical AI, launch startups and transform industries.
Türkiye is preparing to sue Meta, owner of Facebook and Instagram, over age-inappropriate content on social media, Turkish Education Minister Yusuf Tekin has said.
A judge in the U.S. state of New Mexico has ordered Meta to pay $25 billion after a jury found the company misled consumers, in a case linked to the Cambridge Analytica scandal.
Artificial intelligence is reshaping the technology landscape, fueling new cybersecurity threats, intensifying the battle for AI chips and raising questions about safety. From autonomous hacking to SpaceX’s mobile ambitions, here are five key developments shaping the industry.
Japan has launched an uncrewed spacecraft on a mission to collect the first-ever samples from one of Mars’s moons and bring them back to Earth, in a bid to uncover clues about the origins of the solar system.
You can download the AnewZ application from Play Store and the App Store.
What is your opinion on this topic?
Leave the first comment