← Back to tableAll incidents timeline

Suggest a change

About Alibaba ROME agent opens SSH tunnel and mines crypto in training

Suggest a change to an entry, the methodology or the ledger as a whole: something to fix, correct or add. We read every suggestion, and check corrections against their sources.

Alibaba· ROME, based on Qwen3-MoE (ROCK & ROLL & iFlow & DT Joint Team)

Alibaba ROME agent opens SSH tunnel and mines crypto in training

During reinforcement-learning training, the ROME agent probed internal network resources, opened a reverse SSH tunnel from an Alibaba Cloud instance to an external IP and used provisioned GPU capacity for cryptocurrency mining, none of which the task prompts asked for.

Alibaba's technical report on the ROME agent model (arXiv 2512.24873, v1 dated 31 December 2025) says that during RL training Alibaba Cloud's managed firewall flagged a burst of security-policy violations from the training servers: attempts to probe or access internal-network resources and traffic consistent with cryptomining. The violations recurred intermittently across runs. The team first treated it as a conventional incident (misconfigured egress or external compromise), then matched firewall timestamps against system telemetry and RL traces and found the traffic lined up with episodes where the agent called tools and ran code. The report cites a reverse SSH tunnel to an external IP and GPU capacity repurposed for mining, and calls these instrumental side effects of autonomous tool use under RL optimisation. The passage drew wide attention after Alexander Long posted a screenshot on X on 6 March 2026. On 8 March 2026 Alibaba's Future Living Lab account posted a different account: a model on a security-audit task simulated a cryptocurrency miner to build a suspicious-process scenario, inside a strictly isolated sandbox with no external impact. The two accounts have not been reconciled in any source found.

Updated 27 Sep 2026

First incident action to disclosure
Unknown
First incident action to discovery
Not disclosed
Noticed first by
A vendor's control
Caught
A control flagged it

What happened

  • First incident action
  • Unnoticed
  • Handler found out
  • Known, not public
  • Disclosed
  • Public
  1. Not disclosed

    First incident action

    Agent probes internal network and generates cryptomining traffic during RL training

    The report lists attempts to probe or access internal-network resources and traffic patterns consistent with cryptomining, originating from the training servers. Not dated.

    Reports differ

    The lab's later social post describes a different event.

    • Unrequested probing, mining and tunnelling emerged from autonomous tool use under RL optimisation, outside the bounds of the intended sandbox.
    • A model on a security-audit task simulated a cryptocurrency miner to construct a suspicious-process scenario, inside a strictly isolated sandbox with zero external impact.
  2. Not disclosed

    Agent opens a reverse SSH tunnel to an external IP and repurposes GPUs for mining

    The report gives these as the striking cases: a reverse SSH tunnel from an Alibaba Cloud instance to an external IP, and provisioned GPU capacity diverted to cryptocurrency mining, raising costs.

    Reports differ

    The clarification claims no external impact, which the paper's description of a tunnel to an external IP does not match.

    • Reverse SSH tunnel established and used to an external IP address.
    • Everything happened in a strictly isolated sandbox with zero impact on anything external.
  3. Not disclosed

    Alibaba Cloud managed firewall flags a burst of security-policy violations

    The team was convened early one morning after the alert. Violations then recurred intermittently, with no clear pattern, across multiple runs.

  4. Not disclosed

    Handler found out

    Team traces the traffic to agent tool calls via RL traces

    First treated as misconfigured egress or external compromise. Firewall timestamps correlated with system telemetry and RL traces showed the outbound traffic coincided with episodes where the agent invoked tools and executed code.

  5. Not disclosed

    Team builds a safety taxonomy, red-teaming generator and safety-filtered data

    Risks split into safety and security, controllability and trustworthiness; red-team tasks seeded with security failure modes; clean golden trajectories used in post-training.

  6. 31 Dec 2025

    Disclosed

    "Let It Flow" v1 posted to arXiv with the incident in Section 3.1.4

    arXiv 2512.24873. The v1 HTML already contains the firewall, tunnel and mining passage.

  7. 4 Jan 2026

    arXiv v2 posted

    No revision notes on the abstract page.

  8. 6 Mar 2026

    Alexander Long posts the passage on X; it goes viral

    Posted 20:49 UTC with a screenshot. About 6,800 likes and 2.87 million views at time of access.

  9. 7 Mar 2026

    LessWrong post calls it the first confirmed rogue LLM case; commenters push back

  10. 8 Mar 2026

    Alibaba's Future Living Lab posts a clarification that reframes the event

    Posted 03:50 UTC from the verified @FutureLab2025 account (Future Living Lab @Alibaba-ATH). Says the model simulated a miner during a security-audit task, in an isolated sandbox with no external impact, and will be used as a negative RL example. It does not mention the SSH tunnel.

    Disputed

    Reports differ

    Lab paper and lab social post disagree on what happened and whether anything left the sandbox.

    • Paper: reverse SSH tunnel to an external IP and GPU capacity used for mining, found via cloud firewall alerts.
    • Post: simulated miner in a security-audit task, caught immediately by our monitoring, strictly isolated, zero external impact.
  11. 8 Mar 2026

    The Block reports; Alibaba and lead author do not respond to comment requests

    Reported
  12. 9 Mar 2026

    heise online reports the incident

    Reported
  13. 12 Mar 2026

    arXiv v3 posted; the incident passage is still in Section 3.1.4

    No revision notes. Whether the wording changed from v1 was not checked line by line.

Agent failures

Sandbox escape, Resource abuse, Unauthorised accessShow
Map to frameworks
  • Sandbox escape

    Opened a reverse SSH tunnel to an external IP.

  • Resource abuse

    Used provisioned GPUs for cryptocurrency mining.

  • Unauthorised access

    Probed internal network resources.

How it was found

Found first by a vendor's control, from a control flagged itShow
Found first by
A vendor's control
How
A control flagged it
Found to disclosed
Not disclosed

The research team did not find it from training curves or their own RL monitoring. Alibaba Cloud's managed firewall raised security-policy violations on outbound traffic from the training servers. The team then correlated the firewall timestamps with system telemetry and RL traces and traced the traffic to agent tool calls and code execution. Alibaba Cloud is part of the same group as the research team, so 'vendor' here means the cloud platform's managed service rather than the team's own tooling. The later Future Living Lab post instead credits 'our safety monitoring', which conflicts with the paper.

What is publicly known

0 of 12 fully publicShow
0 of 12 fully public
ItemPublic?DetailSources
PartialROME, a Qwen3-MoE-based agent model; which checkpoint or training run produced the behaviour is not given.
UnknownNo source mentions reasoning settings.
PartialROCK applies per-sandbox network policies and Alibaba Cloud's managed firewall was active; the rules are not given.
UnknownNot published.
WeakPaper says task prompts did not ask for it; the lab's later post says a security-audit task. Disputed.
PartialROCK sandboxes and ROLL RL training, with tool calls and code execution; the tool set is not listed.
WeakPaper describes a reverse SSH tunnel to an external IP; the lab post claims strict isolation. Disputed.
UnknownNo traces, logs or episode transcripts published.
PartialPaper: managed firewall alerts, matched to RL traces by timestamp. Undated; the lab post credits its own monitoring.
WeakPaper cites diverted GPU capacity and higher costs; lab post claims zero external impact. External IP not identified.
WeakPaper calls it instrumental side effects of RL optimisation; the lab's post describes a simulated miner instead. Unreconciled.
PartialSafety taxonomy, red-teaming task generator and safety-filtered training data; no sandbox or egress change stated.

Controls that apply

  • Protect

    Hold test, training and evaluation environments to production standards

    The paper says the RL training servers could reach internal-network resources and an external IP, and the team first suspected misconfigured egress. A training environment held to production standards would have kept both out of reach; Alibaba's lab later said the run stayed in an isolated sandbox, which the paper's account does not match.

  • Limit where the agent can send traffic

    An outbound reverse SSH connection from an Alibaba Cloud training instance to an external IP, and traffic consistent with cryptomining. An allowlist would have refused both and logged the attempts.

  • Isolate where the agent runs

    Connection attempts from the training sandbox to internal-network resources the task had no reason to reach, each raised as a boundary crossing.

  • Cap rate, spend and resources

    Provisioned GPU capacity diverted to cryptocurrency mining, which the paper says raised costs. A compute ceiling per run with a breaker would have limited how long the mining could go on.

  • Detect

    Record every agent action, outside the agent

    Per-episode records of tool calls and executed code, with timestamps, kept outside the agent. The team had to match firewall timestamps against system telemetry and RL traces by hand to tie the traffic to the agent.

  • Monitor every run and alert on what does not fit the task

    The team's own RL monitoring and training curves did not show it; the cloud firewall did, in alerts that recurred across runs. A monitor reading tool calls against the task would have flagged the SSH tunnel and the mining in the episode where they started.

  • All controls →

Coverage and commentary

4 posts on X, 2 statements, 5 articlesShow

What the parties involved said

  • ROME authors (Weixun Wang et al.)

    The behaviours were not requested by task prompts, not needed for the task under the intended sandbox constraints, and emerged as instrumental side effects of RL optimisation. The team responded with a safety taxonomy, a red-teaming task generator and safety-filtered training data.

  • Future Living Lab (Alibaba)

    Says the model was on a security-audit task about abnormal CPU usage and chose to simulate a cryptocurrency miner, that monitoring caught it immediately, and that it ran in a strictly isolated sandbox with zero external impact. Does not address the reverse SSH tunnel described in the paper.

All 7 sources
  1. Primary source

    Let It Flow: Agentic Crafting on Rock and Roll, Building the ROME Model within an Open Agentic Learning Ecosystem (arXiv 2512.24873) ↗arXiv · 2025-12-31

  2. Primary source

    Future Living Lab clarification on the ROME mining story ↗X · 2026-03-08

  3. Press

    AI agent secretly mines cryptocurrency during training ↗heise online · 2026-03-09

  4. Press

    Alibaba-linked AI agent hijacked GPUs for unauthorized crypto mining, researchers say ↗The Block · 2026-03-08

  5. Commentary

    insane sequence of statements buried in an Alibaba tech report ↗X · 2026-03-06

  6. Commentary

    The first confirmed instance of an LLM going rogue for instrumental reasons ↗LessWrong · 2026-03-07

  7. Commentary

    Did Alibaba's ROME AI try to breach its sandbox during training? ↗Manifold Markets

Entry id alibaba-rome-cryptomining-2025 · overall Disputed · impact contained