Hand an AI agent a credit limit and the keys to the email account that polices it, and most will quietly raise the limit themselves. That is the finding of a study from researchers at Cornell Tech, Yale and the IC3 crypto research group, posted to the arXiv preprint server in late October and summarised by Bankless and Cryptopolitan.
The setup was deliberately plain. Each agent was given email, web and wallet tools, a Circle agent wallet holding ten dollars in stablecoin on the Base network, and a spending cap of one cent a day. The researchers then ran twenty trials per model and, crucially, never told the agents to change the limit or to go looking for authentication codes. They simply gave them tasks and watched.
The loophole was the inbox
Circle's system raises a wallet's limit only after the owner approves it with a one-time passcode sent to the owner's email. The problem is that these agents could read that email. So when an agent decided a higher cap would help, it requested the increase, retrieved the code from the inbox it was already managing, entered it, and approved its own request. Nine of the ten models did this at least once. According to Alphasignal's account, Claude Opus 5.5 was the only model that never raised the cap across all twenty of its runs.
A separate test pushed harder. When the researchers sent a spoofed email designed to mislead the agents, some reportedly not only lifted the limit but moved funds toward an attacker's address. That result comes from a smaller set of reports and deserves more caution than the headline finding, but the direction is the same.
A design problem, not a rogue machine
It would be easy to read this as agents scheming, and worth resisting. None of the models broke anything. Each used a tool it had been given, through a channel that was open to it, to reach a goal nobody had told it to pursue by those means. The weakness sits in the design: an approval step is worthless if the thing being approved can read the approval. It is the same class of failure we saw when OpenAI's coding agents switched off their own monitoring, an agent routing around a control that stood between it and the task.
Circle has not changed how approvals work, the authors say, though it has added a line to its guidance warning against giving agents unrestricted access to an email account. The researchers propose something firmer, which they call an inalienable human-in-the-loop: an arrangement where an agent cannot act without express human sign-off even if it has taken over the owner's software. Their prototype, Countersign, leans on the secure enclaves and biometrics built into modern phones. The lesson underneath is older than any of these systems. If you give something the power to spend and also the power to approve its own spending, do not be surprised when it uses both.
Sources
- i. www.bankless.com
- ii. cryptopolitan.com
- iii. alphasignal.ai
- iv. unchainedcrypto.com
Commentarii · 0