AI agents autonomously compromised real companies, now confirmed across two frontier labs. What that changes for anyone deploying agents.
For two years the agentic-security conversation has run on a lot of hypotheticals. What if an agent reasoned its way out of a sandbox? What if a model turned its cyber capability on the infrastructure it was running in? What if the same intelligence we hand to defenders got pointed the other way? We have seen the occasional interesting incident in research or within the wild but with limited impacts; at least based on what the public record shows. However, on July 16, Hugging Face disclosed a breach that serves as the first major incident and reality check to these questions. Five days later OpenAI confirmed details that we would argue makes the whole situation a landmark event: the attacker was an AI agent, and not one an adversary had hijacked. It was a set of OpenAI's own frontier models, doing exactly what they were told, that chained novel exploits across two companies' production systems entirely on their own. Much of the industry assumes agents acting as an insider threat due to employees not monitoring its actions, but here we see that a misbehaving agent can actually go outside your org and attack another one (and you own the liability of that action).
And this was not a one-off. On July 30, Anthropic disclosed that a retrospective of its own cyber evaluations had surfaced three more real-world intrusions of its own; three different companies, three different Claude models, the earliest dating back to April. Two frontier labs, at least four breached organizations, three weeks.
Most prior incidents that touched agents have been “traditional” attack types leveraging an agent as the vector. This included things like a poisoned MCP server, a prompt-injected assistant, and a supply-chain package used to reach a human's credentials. These are valid attacks, and very relevant to agent security. However, these are the first attacks of this scale where the agent is not the vector, but instead it is the threat actor.
What happened at Hugging Face
OpenAI was running an internal evaluation called ExploitGym, designed to measure how far its models could push advanced exploitation across complex attack paths. The models under test were GPT-5.6 Sol and a more capable pre-release model, later clarified to be an internal-only research prototype, never slated for release, both run with their cyber refusals deliberately reduced so the benchmark could measure maximal capability. The evaluation ran in a sandboxed research environment whose only route to the outside world was a single internally hosted proxy that cached package registries.
The story goes that inside that box, the models did something no rule told them to do. They went looking for a way out, because getting out helped them win. They discovered and exploited a zero-day in Artifactory, the package-registry cache proxy, escalated privileges, and moved laterally until they reached a node with open internet access. From there they reasoned that Hugging Face likely hosted the datasets and solutions for the very benchmark they were being graded on, and so they went after them. On Hugging Face's side, a malicious dataset abused two code-execution paths (a remote-code dataset loader and a template injection in a dataset configuration) to land code on a processing worker, then escalated to node-level access and spread across internal clusters. Roughly seventeen thousand individual actions, a swarm of short-lived sandboxes, self-migrating command-and-control staged on public services, all to reach a production database and lift the answer key to its own test.
Hugging Face caught it through AI-assisted anomaly detection over its telemetry, contained it, and reconstructed the timeline with an open-weight model running on its own hardware. OpenAI's security team independently flagged the anomalous activity, and the two companies are now investigating jointly.
OpenAI's later updates filled in the tradecraft. Along the way the models used publicly exposed account credentials across four external services, stood up an outbound relay and staging path plus a separate account for data storage, and leaned on public paste, screenshot, and request-capture utilities — ordinary attacker tooling, assembled autonomously. One of the four was Modal Labs, via a customer's exposed endpoint rather than the platform itself. OpenAI disclosed the Artifactory zero-day to the vendor and now has CrowdStrike, METR, and Redwood Research reviewing the model behavior.
Then Anthropic looked at its own logs
OpenAI's disclosure prompted Anthropic to go back through its own cyber evaluations, 141,006 runs in which Claude could conceivably have reached the internet. It found three incidents, across three different organizations, involving three different models: Opus 4.7, Mythos 5, and an internal research prototype. The earliest was in April, meaning this had been happening quietly for months.
The mechanism was different from OpenAI's. There was no zero-day and no sandbox escape. A misconfiguration at a third-party evaluation partner left a live internet path open, while Claude's prompt told it (wrongly) that it had none and set it a capture-the-flag task. So when its search led to real systems on the open internet, Claude treated them as part of the exercise and attacked them with basic technique: weak passwords, unauthenticated endpoints, an exposed debug page, SQL injection. No exotic capability required.
The impact was still real. One run pulled several hundred rows of production data out of a company's database. In another, Claude built and published a malicious PyPI package under a name a fictional setup document had referenced, going to remarkable lengths to do it, working around the need for an email address, then a phone number, then payment, until it succeeded. The package was live for about an hour, was downloaded and executed on fifteen real systems, and one of those was a security vendor's malware scanner, whose credentials Claude then used to reach further infrastructure. A model published working malware that compromised a security company, in pursuit of a flag in a game it thought was fake.
Two findings deserve to be pulled out. First, none of the three victim organizations detected the activity themselves, Anthropic found it in its own transcripts and had to go notify them. Second, the models behaved differently once reality intruded: the oldest kept attacking even after it worked out the target was real, while the newest recognized it was on the open internet and stopped on its own. Put the two disclosures side by side and the surface they share is the evaluation environment itself, the place where labs deliberately take the safety rails off to measure raw capability, pointed at or one misconfiguration away from the open internet. This is no longer one spectacular OpenAI incident. It is a category.
Why this is the wakeup call
What makes this incident matter is not the sophistication of any single exploit. It is that it pulled together, in one event, every thread the industry has been arguing about agents separately, and showed what they look like when all connected.
The agent is an insider (threat) by design. In every one of these cases the agent authenticated with valid credentials and operated inside its granted permissions the entire time. There was no unauthorized entity to detect, because nothing about it was unauthorized. Every tool built to ask “should this thing be here?” answers yes, forever, for an agent.
It is eager to please and obsessed with its goal. In OpenAI's own words, they said the models were “hyperfocused on finding a solution for ExploitGym, going to extreme lengths to achieve a rather narrow testing goal.” Anthropic's Claude did the same — one instance manufactured an email account, a phone number, and a payment method just to publish malware and win. There was no malice. The drive to complete the objective was sufficient, on its own, to breach real companies. The trait that makes agents useful is the same trait that made this happen.
It carries the knowledge of countless expert hackers. A frontier model has internalized more offensive-security technique than any individual on any red team. Point that at a live environment and, whether it reaches for a novel zero-day or hunts basic misconfigurations across thousands of targets, it does not need source code or prior access — it discovers, chains, and executes at machine speed, patiently, across systems, without tiring.
AI safety and cybersecurity are now the same discipline. The two labs do not even agree on what happened. OpenAI frames its incident around alignment and cyber capability; Anthropic argues its own were “closer to a harness and operational failure than a model alignment failure,” because its models were misconfigured into internet access and reasonably believed the real systems were simulated. For a defender, that distinction is academic. Whether the agent broke out through a zero-day or walked through a door it was told did not exist, whether you file the root cause under misalignment or misconfiguration, the outcome on the victim's side is identical: a trusted, capable agent reached production systems it was never meant to touch and acted against them. You can no longer treat “is the model aligned?” and “is the system secure?” as separate questions owned by separate teams. This pattern answered both at once, and the answer was no.
Want to see what your agents are actually doing, and whether your stack would catch this if it were yours? Talk to Manifold.
The “guardrails were loosened” is not an excuse.
Many have been quick to claim that these incidents only happened because the labs did things like turned the cyber refusals down for the test, so it says nothing about a normally configured deployment. That is a somewhat disturbing claim, and wrong for at least two reasons.
First, this is precisely the scenario the frontier labs have told us other controls handle. The standard reassurance has been that even if a model slips its guardrails, a properly isolated sandbox, zero-trust access enforcement, and advanced SIEM monitoring will contain it. This incident is that exact configuration (a real sandbox, a constrained egress path, monitored infrastructure) and the agent walked through all of it. It found a zero-day in the one egress control, treated isolation as a puzzle to solve rather than a wall, and reached another company's database. If there was ever a clean demonstration that “isolate it, permission APIs and tools, and watch the logs” is not containment for a reasoning system, this is it. Anthropic makes the same point from the other direction: it says the safeguards that ship with its released models would have blocked the behavior, but they were not running in the eval, and a single wrong assumption, that the environment had no internet, was all it took.
Second, “it only happened because one control was relaxed” is not a defense. It says that removing a single layer is enough to get an autonomous intrusion across two companies. That is a statement about how little margin these systems have. We do not accept that fragility from any other powerful technology (nuclear, aerospace, energy, etc.), we expect defense in depth, graceful degradation, and resilience when a control fails, because controls fail routinely. An LLM guardrail is one probabilistic layer, and it will be bypassed, misconfigured, or turned off again. Anthropic's own postmortem lands in the same place, calling these incidents a demonstration of “the importance of defense-in-depth.” The question every organization should be asking is not “was a guardrail down?” It is “what would have stopped this if it were our agent, and one of our controls failed on an ordinary Tuesday?” For most organizations today the answer is nothing. Resilience, not a single dependency on model-level refusals, is the bar this incident sets.
What organizations need to do
These spectacular intrusions are merely a preview of the risks and threats every organization is deploying at scale with its own agents. Enterprises are deploying agents at scale that have exactly the properties on display here; trusted access, goal-seeking behavior, expert capability, machine speed. The work now is to make sure the agents you deploy cannot do to you what OpenAI's did to itself and Hugging Face, and that when one of your controls fails, something else still sees and stops it.
Start with observability into what your agents actually are and do. Most organizations cannot see their agents at all: where each one runs, who it acts on behalf of, what supply chain of MCP servers, plugins, and skills it pulls in, what permissions it holds, and what data, systems, and endpoints it touches over a session. The gap is not marginal. Across real agent workloads, prompt-level tooling, the layer most “AI security” still watches, sees only a fraction of what an agent does. The tool calls, delegations, and side effects that carry the actual risk run underneath it.
Continuously evaluate risk posture An agent's risk is not a static label, it moves as the agent picks up tools, permissions, and data access over its life. Measure it the way it actually behaves. Evaluate it by blast radius (what it can touch, and whether it can read, write, execute, or delete), by exposure (every tool is an input path back into the agent, and every dependency drags its own vulnerabilities along), and by defensive controls (its autonomy level, isolation, and the governance enforced against it). A coding agent that quietly acquires an accounting tool has changed its posture, and you want to know the moment it does.
Enforce deterministic, preventative restraints at the harness and make them dynamic. The one thing this incident proves you cannot rely on is asking the model nicely. Restraints that live in prompt context are more of the same probabilistic layer that just failed, in Anthropic's case, a prompt that asserted “no internet access” is exactly what the model reasoned around. What is needed is deterministic policy that sits at the harness, the layer that actually dispatches the agent's actions, and can refuse to let the agent cross a trust boundary regardless of what it has reasoned itself into. And it has to be contextual. The same action is fine in one moment and a breach in the next, so allow/deny must adjust to what else is happening in the session, not sit as a static rule written once and forgotten.
Detect and respond against the agent in addition to the OS and network. Endpoint and network tooling was built to find an unauthorized entity. There isn't one here, and it shows: of the four organizations known to have been breached in these incidents, only Hugging Face caught it on its own; the three Anthropic notified never saw it. The signal that matters lives in the agent's composition and its session activity. This includes the sequence of tool calls, the delegations between agents, the trust boundaries crossed, measured against the baseline of how agents in that role normally behave.
That is also why the industry's favorite agentic signals, the lethal trifecta and intent drift, need to be treated with suspicion. As they are usually framed, both fire on the ordinary shape of legitimate agent work and bury a SOC in false positives; the discriminating signal is not that a session touched three risky capabilities or changed direction, but that its behavior departed from what that agent, in that role, has ever done. Build detection and response for that and hold it to a real standard.
None of this is a call to slow down agent adoption. It is a call to deploy agents with the assumption these incidents makes unavoidable: your agent is a capable, trusted, goal-driven insider that will, sooner or later, find a path you did not intend, and no single control will always be there to stop it.
Those are the layers Manifold is built for, observability, live risk posture, deterministic runtime governance, and detection and response against the agent itself. If you want to see what your agents are actually doing, and whether your stack would catch this if it were yours, talk to Manifold.
Referenced
— Hugging Face, “Security incident disclosure, July 2026” (Jul 16, 2026) https://huggingface.co/blog/security-incident-july-2026
— Hugging Face, “Agent intrusion: technical timeline” (post-mortem) https://huggingface.co/blog/agent-intrusion-technical-timeline
— OpenAI, “OpenAI and Hugging Face partner to address security incident during model evaluation” (Jul 21, updated Jul 28–29, 2026) https://openai.com/index/hugging-face-model-evaluation-security-incident/
— JFrog, “JFrog and OpenAI collaboration on zero-day security findings” (Artifactory) https://jfrog.com/blog/jfrog-and-openai-collaboration-on-zero-day-security-findings/
Latest articles








