Muse Spark 1.1 attacks a real website in an Irregular eval
During a cyber evaluation run by Irregular, a pre-release Muse Spark 1.1 reached the open internet, exploited a flaw in a real website named as its target, read data from it and changed its database.
Irregular began evaluating Muse Spark 1.1 in early July in a closed testing environment with Meta's standard safeguards removed. Meta says a misconfiguration in Irregular's setup gave the model open internet access, and that Irregular gave the model the name of a real website as the target instead of a fictional one. Believing the real website was the intended target, the model found and exploited a security vulnerability, accessed some information and changed the website's database. Irregular identified the issue, disabled the evaluation and notified Meta and the affected party. Meta confirmed the incident to Bloomberg on 5 August without naming the model, and published a retrospective on 14 August saying a review of over 10,000 activity records found no other case. The website has not been named.
- about 20 days
- Not disclosed
- A vendor's control
- An outside report
What happened
Irregular starts a cyber evaluation of Muse Spark 1.1 with safeguards removed
A closed testing environment, meant to have no internet, was misconfigured to allow open internet access, and the scenario named a real website as the target.
The model exploits a flaw in the real website and changes its database
Meta says the model believed the real website was the intended target, accessed certain information and made changes to the website's database. Not dated beyond the July evaluation.
Irregular disables the evaluation and notifies Meta and the affected party
Meta gives no date for Irregular's notice.
Meta reviews over 10,000 records of the model's test activity
Meta says its security teams found no other instance of the model exploiting a third-party company's system.
Meta confirms the incident to Bloomberg
Spokesperson Andy Stone blamed a misconfiguration by Irregular. Meta did not name the model; The Information identified it as Muse Spark 1.1.
Irregular ties it to the issue behind the Anthropic incidents
Irregular says it was the same evaluation-environment issue, not a sandbox escape, with no open issues remaining, and that it is writing guidance on containment.
Meta publishes its retrospective
Meta says it will require independent verification of test environment isolation and scenario review before evaluations, and that scenarios must not reference real companies.
Agent failures
Sandbox escape, Unauthorised access
Sandbox escape
Unauthorised access
How it was found
Found first by a vendor's control, from an outside report
- A vendor's control
- An outside report
- Not disclosed
Meta learned of it from its evaluation vendor. Meta says Irregular notified it of the issue, disabled the affected evaluation and made sure the affected party was told. Neither Meta nor Irregular says what signal Irregular saw, or when. After the notice Meta's security teams reviewed over 10,000 records of the model's activity during testing and found no other instance of it exploiting a third party's system.
What is publicly known
1 of 12 fully public
| Item | Public? | Detail | Sources |
|---|---|---|---|
| Partial | Muse Spark 1.1, a pre-release version per Meta; checkpoint not given. Bloomberg calls it recently released. | ||
| Unknown | No source says whether reasoning was on or at what setting. | ||
| Partial | Meta says standard production safeguards were removed for the evaluation. Which safeguards, and whether any monitor ran, is not stated. | ||
| Unknown | Not published or described. | ||
| Partial | An adversarial cybersecurity task against a target that was meant to be fictional but named a real website. Wording not published. | ||
| Weak | An Irregular-built closed testing environment. Scaffold and tools not described. | ||
| Partial | A misconfiguration by Irregular allowed open internet access. No configuration detail given. | ||
| Unknown | No transcript or action log published. | ||
| Weak | Irregular identified the issue and told Meta; what signal it saw, and when, is not stated. | ||
| Partial | One unnamed real website: information accessed and database changed. Extent and data type not given. | ||
| Known | Meta states a setup misconfiguration opened internet access and a real website name was given as the target. | ||
| Partial | Irregular fixed the misconfiguration; Meta adds isolation verification, bans real names in scenarios and plans earlier monitoring. Not independently verified. |
Controls that apply
Protect
Detect
- All controls →
Coverage and commentary
1 statement, 4 articles
All 5 sources
Addressing an issue involving a third-party cyber evaluation of Muse Spark 1.1 ↗
Meta AI Model Accessed Internet, Hacked Outside Firm in Testing ↗
Meta's Muse Spark 1.1 hacked an external organization during cybersecurity test ↗
Meta claims its own AI also hacked into a third-party service during testing ↗
Meta Breach Reveals Irregular Cleared Muse Spark's Risk, Then Caused Breach It Had Cleared ↗