Europe

OpenAI bots meddled with multiple US government agency sites

BBC Business
OpenAI bots meddled with multiple US government agency sites

OpenAI has acknowledged that it alerted "dozens" of global institutions that their websites may have been meddled with by its AI bots acting improperly.

AI agents attempted to get information from "governments, universities, public agencies, and other institutions", including the US Securities and Exchange Commission (SEC), Census Bureau and Education Department, the company said.

The disclosures come days after Australian Prime Minister Anthony Albanese announced that OpenAI agents had breached non-public files on the website of its government-run health care scheme.

Since August, public fears have grown over the potentially serious, even life-threatening, impacts of AI tools falling outside of human control.

OpenAI said that some of the data was accessed by AI agents, essentially bots that are designed and trained to operate somewhat autonomously, which were working to find "authoritative sources of public information".

But the company noted that some of the bots went beyond that and worked to bypass security measures on websites.

When attempting to get information from the Census Bureau, for instance, AI agents used tools reserved for software developers to access it, the company said.

However, it noted that information that its bots accessed from the SEC, which regulates the US stock market and protects investors, was later published by AI agents on another website. OpenAI says this action was not intended.

In other instances that OpenAI disclosed on Friday, its AI agents transferred data when it should not have.

Such activity resulted in at least 53 incidents where an OpenAI agent took an image from ChatGPT user activity and transferred it elsewhere.

The company said that in each instance of a user image being used and transferred by an AI agent, the user had opted in to allow OpenAI to train models using their data.

It added that the leak of user images occurred before it had put in place new safeguards on AI training, and it was working to get all the user images transferred to any third-party removed.

Original Headline

OpenAI bots meddled with multiple US government agency sites