Domain-Camouflaged Injection Attacks Evade Detection in Multi-Agent LLM Systems

https://arxiv.org/abs/2605.22001

by sbulaev • 2 months ago

38 4 2 months ago

BarryMilo• 2 months ago

This is an "uh oh" moment, isn't it?

simonw• 2 months ago

It concerns me that anyone with anything important to protect might trust what this paper calls "Injection detectors deployed to protect LLM agents" - Llama Guard and the like.

There are unlimited combinations of tokens that can be used to attack an LLM system. The idea that some kind of "detector" can catch them all just feels inherently absurd to me.

buppermint• 2 months ago

The paper title is a bit misleading. The tested detectors and models here are small and rather dated (Llama 3.1 8B and Gemini Flash 2.0 - these are basically in the level of a modern 1B model), and the actual paper says this only shows vulnerability in small model systems.

dwa3592• 2 months ago

Why weren't these attacks tested on the frontier models? The models they tested these on can also be fooled by poems and rhymes.

Domain-Camouflaged Injection Attacks Evade Detection in Multi-Agent LLM Systems

Related Stories