Connexion
Last week, when Australian Prime Minister Anthony Albanese told the world that an OpenAI agent had accessed "non-public files" from his country's Medicare statistics portal during testing, his description of the incident was a little light on details. Today, we're getting new information on just how far OpenAI's overzealous agent went in attempting to satisfy a rather innocuous-sounding informational prompt.
In a newly published blog post, OpenAI says the June incident started when the company asked "an experimental, internal-only OpenAI model" to research government spending statistics in the Australian state of Victoria. When the model ran into trouble finding that data using the publicly published statistics that it was supposed to reference, "it took actions that we had not authorized it to take" to find an answer, OpenAI said.
Those unauthorized actions included finding "a way to gain non-public access to the service" and using that access to view "technical system information and source code" alongside credentials and the aggregate statistics it was actually searching for, OpenAI said.
OpenAI says it has paused all internal training of "our most capable models" as it continues what CEO Sam Altman is calling "an extensive and ongoing review related to our agents’ use of internet access during training and evaluation."
The company revealed the pause in a report about a so-called misalignment incident in which an agent attempted to exploit a gap in Internet-access restrictions during a routine research task during training. OpenAI says that improper DNS filtering allowed the agent to attempt to break out of its sandbox and access the wider Internet when asked for biographical details about a blogger.
OpenAI says the agent was only able to access the company's offline web cache and that it has implemented additional multi-layered blocking controls to prevent similar incidents in the future. Despite that, though, the company says it has decided to "pause all other training, evaluation, and inference with tool-use" for this frontier model "until we have both validated that the gap is resolved and performed additional red-teaming of the system."
Lateo.net - Flux RSS en pagaille (pour en ajouter : @ moi)