Microsoft researchers show how dormant neurons can backdoor AI agents
Tech

Microsoft researchers show how dormant neurons can backdoor AI agents

TechNews Editorial
TechNews EditorialNov 11, 2026 · 1 min read
Share

Why it matters

Microsoft says an agent with tool or terminal access could execute an attacker’s command if its model weights were altered.

The facts

  • Microsoft researchers say Lazarus can backdoor an AI agent by changing fewer than 10 dormant neurons without retraining.
  • A hidden trigger can make the agent issue an attacker’s command while the model passes standard evaluations.
  • Microsoft says Foundry checks model provenance and is developing additional ways to detect altered weights.

Advertisement

Microsoft researchers have identified a technique called Lazarus that can make an AI agent run an attacker’s command when a hidden trigger appears. They say the attack changes fewer than 10 rarely active neurons in the underlying language model and requires no retraining.

The model can behave normally and pass standard safety evaluations until the trigger appears, according to Microsoft. In one example, a date change prompts an agent working on an ordinary task to issue a command that downloads and runs attacker code. The agent could then execute that command with whatever access it has.

That makes tool and terminal access a particular concern. Microsoft says a triggered agent could run destructive commands or steal secrets. The attack requires write access to a model checkpoint, so both externally sourced and internally developed models could be exposed if an account, pipeline or storage system is compromised.

Microsoft describes its model checks

Microsoft says Foundry checks the source of open-weight models it onboards and ties each model to its original publisher. It runs models in Microsoft containers that are separately scanned for critical vulnerabilities. The company says these controls protect Foundry customers using models from trusted labs against the attack described in the research.

Two rectangular storage cartridges rest side by side on a grid surface, one showing a blue indicator and the other a red warning light.
Illustration: AI & Tech News

Those checks still leave a risk if a trusted provider is compromised, Microsoft says. The researchers report that AI agents can spot unusual weight changes when asked to examine them, but say a scan cannot prove a model is safe. Reliable detection requires comparison with the original, unmodified weights.

Microsoft says it is working to turn the research’s detection methods into a red-teaming tool and is exploring AI-powered weight scans during open-weight model onboarding. It is also planning model signing with verifiable provenance and tamper-evident audit trails.

What this means

Microsoft reported on November 6, 2026, that attackers are using AI agents to find exposed GitHub secrets and access cloud resources including Azure Key Vault. In its November 11, 2026 research, Microsoft noted that model checkpoint attacks can expose both internally developed and externally sourced models if a storage system, account, or pipeline is compromised. Furthermore, Microsoft researchers reported that while AI agents can spot unusual weight changes when asked to examine them, proving model safety requires comparison with original, unmodified weights.

Source: Microsoft

Newsletter

Get the best AI & tech news daily

A concise daily digest. Unsubscribe anytime.

We use your email only to send this newsletter.

Keep reading