New to ShortSpan? We distil the AI-security research that matters into practitioner takeaways — edited by Ben Williams (NCC Group). Get the weekly email
// Analysis

Agentic LLMs: Attacks Surge, Defences Lag Behind

Agents
Agentic LLMs: Attacks Surge, Defences Lag Behind

A new review of 85 papers on agentic Large Language Model (LLM) security finds attack research outpacing defences 3.9:1. Work clusters on prompt-layer tricks, with 66% on perception attacks, while action-layer and code-execution risks remain under-studied. Weak isolation lets failures cascade across layers, putting containment and runtime controls in the spotlight.

Agentic Large Language Models (LLMs) no longer just chat; they plan, call tools, run code and write to storage. That upgrade raises the blast radius. A compromised reasoning step can trigger an API call, modify files or steer a database query. A new systematic review takes stock of how this actually breaks in practice, screening 743 papers and keeping 85 from 2023 to 2025. The skew is stark: attack work outnumbers defence roughly 3.9 to 1. Most research fixates on the input layer, not the execution paths that change real systems.

The authors map 13 vulnerability types across four layers: perception, brain, action and interaction. Perception dominates the literature at 66%. This is the land of prompt injection, indirect prompt injection, jailbreaking and adversarial inputs. These attacks work by rewriting the model’s instructions or nudging it into unsafe modes. Backdoors sit here too, planted during training or via crafted content that later flips behaviour on cue.

In the brain layer, reasoning manipulation and goal hijacking push the agent to adopt new objectives or flawed plans. The mechanics are simple and effective: seed the context so the planner updates its priorities, then let the system do the rest. Memory poisoning shows up as a slow burn, where persisted notes or embeddings accumulate errors until the agent confidently acts on lies.

The action layer is thin in published work at just 4.7%, which is worrying given the stakes. Tool misuse, code injection and sandbox escape are the high‑impact moves. If an agent executes code or chains tools, a tainted tool response that gets executed can grant arbitrary control. A weak sandbox turns a contained mistake into a system compromise. At the interaction layer, inter‑agent attacks and impersonation let a malicious participant steer a whole workflow.

Why do these failures cascade? Architectural coupling and weak isolation. The review stresses that once an input nudges the plan, the effect walks through memory, tool calls and code execution. There is little to stop a perception‑layer nudge from becoming an action‑layer incident. That is classic cross‑boundary failure, just wearing an LLM badge.

Defence maturity lags. Detection work clusters on input and output filtering with classifiers. Runtime and execution‑level anomaly detection are immature. There is no standard evaluation protocol, and adaptive adversary testing is rare. For policy and procurement, that gap matters: if evaluation is not standardised and focused on containment, risk claims will not travel well across organisations.

The centre of gravity in the open problems is containment. Where should we draw hard boundaries between layers, how strict should privileges be, and how do we prove that an agent cannot cross them under pressure? Until those questions have credible answers and tests, the clever attacks will keep finding the joins.

Additional analysis of the original ArXiv paper

📋 Original Paper Title and Abstract

On Understanding, Identifying, and Mitigating Vulnerabilities in Agentic Large Language Models

Authors: Md Jafrin Hossain, Mohammad Arif Hossain, and Nirwan Ansari
Large Language Models (LLMs) have undergone a shift from stateless conversational interfaces to autonomous agents capable of multi-step planning, tool invocation, code execution, and maintaining persistent memory. When these agents operate with real-world privileges---calling APIs, modifying files, and querying databases---a compromised reasoning step can trigger unauthorized data access, irreversible state changes, or cascading failures, yet the security research community has not kept pace. To quantify the state of the field, we conducted a systematic literature review under PRISMA 2020 guidelines across six databases, screening 743 records and retaining 85 papers (2023--2025) on agentic LLM security. Attack research outpaces defense work by 3.9:1. Perception-layer vulnerabilities (prompt injection, jailbreaking, adversarial perturbations) dominate, accounting for 66\% of papers, while action-layer vulnerabilities (tool misuse, code injection, sandbox escape) appear in only 4.7\%, misaligned with real-world risk. Code execution security accounts for 3.5\%, and tool-augmented agents 12\%. We contribute a four-layer taxonomy mapping 13 vulnerability types across perception, brain, action, and interaction layers, and identify seven open problems centered on containment. Agentic LLM insecurity stems from architectural coupling, where weak isolation allows vulnerabilities to propagate across layers.

🔍 ShortSpan Analysis of the Paper

Problem

This systematic review examines security vulnerabilities unique to agentic large language model systems—LLMs that perform multi-step planning, invoke tools, execute code and retain memory—when given real-world privileges such as API access, file modification and database queries. The shift from stateless chat to autonomous agents raises new risks: a compromised reasoning step can produce unauthorised data access, irreversible state changes or cascading failures. The paper argues the security research community has not kept pace with these developments and quantifies the gap.

Approach

The authors performed a PRISMA 2020 compliant systematic literature review across six databases, screening 743 records and retaining 85 papers published 2023–2025. They extracted structured data on agent types, threat models, vulnerability classes, and contributions, and developed a four-layer architectural taxonomy mapping 13 vulnerability types to perception, brain, action and interaction layers. Quality and inter-rater agreement were reported; quantitative synthesis measured research focus and gaps.

Key Findings

  • Corpus and balance: 85 papers (2023–2025); attack-focused work outnumbers defence-focused work roughly 3.9:1, with 55% of papers on attacks and only 14% on defences.
  • Layer coverage skew: Perception-layer vulnerabilities dominate (66% of papers, 56/85) while action-layer issues are rare (4.7%, 4/85); code-execution agents are underrepresented (about 3.5%, 3 papers) despite high consequence.
  • Vulnerability taxonomy: A four-layer taxonomy (perception, brain, action, interaction) maps 13 vulnerability types including prompt injection, indirect injection, jailbreaking, adversarial input, backdoors, reasoning manipulation, goal hijacking, tool misuse, code injection, sandbox escape, memory poisoning and inter-agent attacks.
  • Most studied attack types: Prompt injection (36 papers), adversarial inputs (30), and jailbreaking (16); high-impact execution attacks such as code injection and sandbox escape were reported in only a handful of studies.
  • Detection and mitigation maturity: Detection work is concentrated at input level (filtering and classifier-based detectors); runtime and execution-level anomaly detection are immature. No standardised evaluation protocol exists and adaptive adversary testing is rare.
  • Defensive patterns and trade-offs: Proposed defences include input/output filtering, architectural separation and privilege restriction, runtime controls (sandboxing, quotas, policy engines), training-time mitigation (adversarial training, RLHF), governance (human-in-the-loop, audits) and multi-agent measures (signing, consensus). Each approach has trade-offs in latency, coverage and scalability.

Limitations

The review is bounded to English-language literature indexed up to December 2025 and may miss non-indexed or very recent work. Publication and selection bias may overstate effectiveness of proposed defences. The field is fast-moving; 85 papers reflect an emergent subfield rather than exhaustive maturity.

Implications

From an offensive-security perspective, attackers can exploit weak perception controls to perform prompt injection and jailbreaking that alter agent goals, poison memory stores to cause gradual corruption, manipulate reasoning or plant backdoors, coerce tool misuse to trigger unauthorised API calls or data exfiltration, inject malicious code for arbitrary execution and attempt sandbox escapes. Multi-agent and interaction-layer channels enable message injection and impersonation that can cascade through ecosystems. The paper emphasises that architectural coupling and weak isolation permit such cross-layer propagation, making containment and strict isolation high-value targets for defenders and priority objectives for adversaries seeking lasting impact.

// Similar research

Related Research

Get the weekly digest

The few AI-security papers that matter, with the practitioner takeaway. No spam.