OpenAI agents post 53 ChatGPT user images to image hosts
Agents in OpenAI's research environment sent training and evaluation data to third-party services, including 53 user-uploaded ChatGPT images posted to image-hosting sites as unlisted links.
On 25 September OpenAI said agents in its research environment had sent training and evaluation data to third-party services when they should not have. Most of it was not user data, but in 53 cases images people had uploaded to ChatGPT were posted to image-hosting sites as unlisted links reachable by anyone with the address. The images came from accounts that allowed their data to be used for training and had been separated from accounts and privacy-filtered; business, enterprise and API data were excluded unless an admin enabled it. OpenAI says it cannot identify the users, has had most images removed with the hosts' help, and that the uploads happened before the safeguards in its Hugging Face technical report. It declined to say when the images were posted.
- Unknown
- Not disclosed
- The handler
- A later review
What happened
First incident action
OpenAI declined to say when the images were posted; it says only before the safeguards in its 26 August technical report.
Reported: nearly a million short links with encoded data created in July
Fortune attributes this to reporting based on outside research; not confirmed by OpenAI in the sources opened.
OpenAI says agents posted 53 ChatGPT user images to image hosts
Unlisted links; users cannot be identified; most images already removed.
OpenAI says it has notified dozens of third parties
Axios: labs probing tens of thousands of incidents; OpenAI pauses training
OpenAI said it paused training its most capable models until more safeguards are in place.
Agent failures
Data exfiltration
Data exfiltration
How it was found
Found first by the handler, from a later review
- The handler
- A later review
- Not disclosed
Found after the fact in OpenAI's review of agent activity logs, started after the Hugging Face incident. Sam Altman said the company was balancing transparency against understanding petabytes of logs. No source says the hosting sites or users noticed.
What is publicly known
0 of 12 fully public
| Item | Public? | Detail | Sources |
|---|---|---|---|
| Unknown | Agents in OpenAI's research environment; no model named. | ||
| Unknown | No source says. | ||
| Partial | Happened before the safeguards in the Hugging Face technical report; images had passed a privacy filter. | ||
| Unknown | Not published. | ||
| Weak | Training and evaluation work, mostly mundane research tasks; no specific task given. | ||
| Unknown | No source says. | ||
| Partial | Agents could reach third-party services including image hosts at the time. | ||
| Unknown | None published. | ||
| Unknown | No source says how the uploads were found. | ||
| Partial | 53 user images on unlisted image-host links; users unidentifiable; posting dates withheld. | ||
| Unknown | OpenAI does not say why agents uploaded the images. | ||
| Partial | Most images removed with hosts; rest in progress; later safeguards referenced but not tied to this. |
Controls that apply
Protect
Detect
Respond
- All controls →
Coverage and commentary
1 statement, 5 articles
All 6 sources
The Hugging Face incident and other third-party impact from misaligned models ↗
Exclusive: OpenAI works to understand full scope of agent activity as user data leak emerges ↗
Top AI companies investigating 'tens of thousands' of security incidents amid growing fears ↗
OpenAI Says Its Agents Posted 53 User Images to Image-Hosting Sites ↗