LAS VEGAS — OpenAI models’ autonomous attacks on other companies represent an urgent warning to the AI industry about the need for stronger model development safeguards, employees from the frontier label said on Wednesday. “This is a pivotal moment both for our company as well as the AI industry as a whole,” Michael Dalton, a member of OpenAI’s technical staff, said during a presentation at the Black Hat 2026 cybersecurity conference here. OpenAI stunned the world in late July when it announced that two of its models broke out of their testing environments and used zero-day vulnerabilities to hack into the networks of other companies, including the AI tool library Hugging Face. The disclosure, followed shortly thereafter by a similar announcement from Anthropic, reignited fears about the dangers of powerful and largely unregulated AI models. Speaking at Black Hat, Dalton said that “numerous teams are dropping everything” to improve OpenAI’s ability to detect and prevent similar incidents in the future. The company has slowed down its research and “dramatically scal[ed] up the monitoring of our AI agents.” While the autonomous hacks were effectively innocent mistakes, OpenAI employees described them as harbingers of a grim future, one in which companies face constant, sophisticated attacks by malicious actors using powerful open-source models that no frontier lab can contain. “We believe this is a watershed moment for computer security as an industry,” Dalton said. “AI orchestrated, fully automated offensive attacks are real now.” The Hugging Face incident, he added, represents “a glimpse into the near future of what attacks will look like for our industry.” Defenders need to accelerate their work to keep up with the anticipated surge in attack sophistication, Dalton argued. That could involve experimenting with defense-focused AI models, as well as doubling down on basic security measures that are newly
OpenAI warns autonomous hacks are 'watershed moment for computer security'
Read the original article
cybersecuritydive.com →