After OpenAI disclosure, Anthropic says Claude also hacked outside systems The incidents have heightened concerns about AI agents, software products designed to perform tasks autonomously. Anthropic has said its Claude AI model hacked into the systems of three organisations during testing that was supposed to keep them isolated from the internet. The announcement on Thursday comes just days after rival OpenAI first revealed that its models improperly accessed the internet and went rogue during security testing. Recommended Stories list of 3 items- list 1 of 3What is the AI Kill Switch Act proposed in the US and how will it work? - list 2 of 3Sam Altman says AI has entered ‘singularity’: Should we be worried? - list 3 of 3How are AI models able to autonomously hack others? Anthropic said a misconfiguration allowed Claude models to reach the internet. The company said it discovered the incidents after reviewing 141,006 test sessions. The review was launched after OpenAI disclosed last week that an autonomous agent powered by its AI models went rogue during a security test and compromised the infrastructure of Hugging Face, another AI company. The incidents have heightened concerns about AI agents, software products designed to perform tasks autonomously. OpenAI and Anthropic have both released their most powerful models this year, known as Sol and Mythos, respectively. Anthropic said the breaches occurred during “capture-the-flag” exercises, in which models are tasked with finding hidden information in simulated networks. Its prompts told the models they had no internet access, but a misunderstanding with its evaluation partner, Irregular, left the systems connected to the public internet. “Claude compromised the impacted organisations’ infrastructure using basic techniques, such as exploiting weak passwords and unauthenticated endpoints,” the company said. Anthropic said it suspended all cyber evaluations on July 23 after finding evidence that Claude
After OpenAI disclosure, Anthropic says Claude also hacked outside systems
Read the original article
aljazeera.com →