New to ShortSpan? We distil the AI-security research that matters into practitioner takeaways — edited by Ben Williams (NCC Group). Get the weekly email
// Analysis

Security contracts bind LLM agent effects to authorisation

Agents
Security contracts bind LLM agent effects to authorisation

Composable AI agents often fall apart at the seams: controls that look fine in isolation fail when handoffs drop or reinterpret security context. CONTINUITY proposes signed, verifiable contracts that travel with each step, binding effects to current authorisation. In tests, it blocked all harmful outcomes while partial setups leaked badly.

Modern Large Language Model (LLM) agents are messy composites: planners, tool callers, protocol shims, policy gates and effect sinks stitched into a pipeline. Each piece can pass its own checks and yet the whole can still go sideways. The culprit here is not a single broken control but a broken chain of context. Security-critical facts get lost, widened or rebound as requests cross boundaries. That is how you get prompt-injection style outcomes even when every box in the diagram claims to be green.

The attack surface is the handoff. A planner reads untrusted content, drafts a plan, and a policy gate signs off based on one view of the request. After that decision, a component swaps a field, widens a scope, or applies a transformation that no one can later prove was the one authorised. Permits get replayed. Revocations arrive but are not reflected downstream. Each local check still verifies, yet an external effect lands that no one intended.

Binding effects to proofs, not vibes

CONTINUITY tackles this with explicit contracts and authenticated context that travel end to end. Each component operates under an assume–guarantee contract and carries proof of what it saw and did. The toolkit is concrete: signed root grants for who can start what; provenance and context manifests; bounded typed releases to carry values from untrusted sources in a controlled form; independently verifiable transformation witnesses; role-bound transition receipts; and effect-bound, one-shot finality permits. A deterministic verifier checks the proof bundle and issues a permit that the finality sink rechecks just before committing the effect.

The property they target is end-to-end consequence integrity. Every realised external effect must be backed by a current authorisation witness that ties together the principal, the task, the provenance and delegation state, the applicable policy, the canonical action and the moment of finality.

In a deterministic fault-injection suite, the full configuration did not commit a single harmful effect across 2,560 attack instances spanning 128 fault–domain classes. It still completed all 700 benign tasks and escalated all 200 ambiguous ones. Strip pieces out and the holes reappear: a strong partial setup saw a 65.6% harmful-effect success rate. Targeted ablations reopened up to 24 classes when field-level provenance checks, contract conformance or mediation were removed. The prototype’s verifier is modest on overhead: median proof verification at 4.21 ms and end-to-end transition plus finality at 7.17 ms on the recorded host.

The fine print matters. The guarantees rest on a trusted computing base: root grant issuers, validators for provenance and transforms, the deterministic verifier, key management and the mediated finality sinks. It does not solve semantic correctness, covert channels, harmful text that never touches a protected sink, or the case where a root or validator is compromised. The prototype is not formally verified and the fault suite is not exhaustive. Still, the framing is useful for both engineering and governance: if regulators ask you to show that an agent’s real-world action was authorised under current policy, this is the shape of an answer. The open question is operational: can teams wire these contracts through heterogeneous stacks without breaking velocity, and will effect sinks across ecosystems agree to recheck permits at the edge where it actually counts?

Additional analysis of the original ArXiv paper

📋 Original Paper Title and Abstract

CONTINUITY: Security-Context Contracts for Composable LLM Agent Controls

Authors: Chris Zheng and Geng Yang
LLM agent systems increasingly combine provenance tracking, authorization, policy enforcement, protocol adapters, and execution controls. However, individually correct security mechanisms do not necessarily compose into an end-to-end secure system: security-critical context may be dropped, widened, rebound, or reinterpreted as actions cross component boundaries. We identify this failure mode as security-context discontinuity and introduce CONTINUITY, a framework for verifiable composition of agent security controls. CONTINUITY models each component with an assume-guarantee contract and carries authenticated security context across transitions using signed root grants, provenance commitments, role-bound transition receipts, bounded typed releases, transformation witnesses, and effect-bound execution permits. We formalize end-to-end consequence integrity, requiring every realized external effect to be backed by a valid and current authorization witness linking the principal, task, provenance, delegation, policy state, canonical action, and finality boundary. We implement a reference verifier and deterministic cross-layer fault-injection suite covering 32 fault classes across four application domains. In 2,560 parameterized attack instances spanning 128 fault-domain classes, the full CONTINUITY configuration commits no harmful external effect, while completing all 700 benign tasks and escalating all 200 ambiguous cases. These results show that secure agent execution requires not only sound individual controls, but explicit contracts that preserve their guarantees across the complete instruction-to-effect path.

🔍 ShortSpan Analysis of the Paper

Problem

The paper studies how multiple, independently correct security controls in LLM agent pipelines can fail when composed. The authors identify security-context discontinuity, where security-relevant facts are lost, weakened, rebound, or reinterpreted as requests cross component boundaries. This can let an adversarial planner or a compromised non-root component cause an externally realised effect despite locally valid signatures or policy checks. The problem matters because modern agents routinely read untrusted content, synthesise plans, call tools, and produce effects that outlive a single model invocation, so composition failures enable prompt-injection style outcomes even when individual controls seem sound.

Approach

The authors formalise end-to-end consequence integrity (ECI) and present CONTINUITY, an assume-guarantee framework that carries authenticated security context across transitions. Key mechanisms include signed root grants, role-bound component identities, RFC 6901 style leaf paths, signed provenance and context manifests, bounded typed releases for untrusted-source values, independently verifiable transformation witnesses, role- and effect-bound transition receipts, and one-shot finality permits. A deterministic verifier validates proof-carrying transition bundles and issues permits that finality sinks recheck immediately before committing effects. The reference artefact is a Python 3.11+ prototype (1.5 KLOC core) using deterministic JSON encoding, SHA-256 digests and Ed25519 signatures. Evaluation uses a deterministic conformance suite with 32 cross-layer fault classes, four application domains, 20 parameterised instances per fault–domain pair, 700 benign tasks, 200 ambiguous tasks, yielding 3,460 scenarios and 24,220 system–scenario runs.

Key Findings

  • CONTINUITY enforces ECI across the tested suite: in 2,560 parameterised attack instances spanning 128 fault–domain classes the full configuration committed no harmful external effect, while containing all 128 classes.
  • The full system completed all 700 benign tasks automatically and escalated all 200 ambiguous tasks, demonstrating preserved utility for legitimate uses including 300 signed typed-release cases and legitimate destination transformation.
  • Incomplete compositions are vulnerable: the strongest incomplete configuration (Gateway+Finality) had a harmful-effect success rate of 65.6% on attacks; other partial configurations reopened between 4 and 128 fault–domain classes.
  • Targeted ablations show which invariants matter: removing field-provenance checks, contract conformance, or mediation reopened the most classes (24 each); root authentication, release validation, transform validation and replay protection also reopened notable subsets.
  • Performance is modest in the prototype: median proof verification was 4.21 ms and median end-to-end transition production, verification, permit issuance and finality was 7.17 ms on the recorded host; verification scales roughly linearly with signed transitions.

Limitations

The guarantees are conditional on a specified trusted computing base: trusted root/grant issuers, provenance and transform validators, the deterministic verifier, key management and mediated finality sinks. The prototype is not formally verified, uses an intentionally restricted canonicaliser, stores nonce and outcome state in-memory, and covers only one evaluated relation (alias resolution). The fault taxonomy and deterministic suite are not exhaustive nor a measure of real-world attack probability. CONTINUITY does not solve semantic correctness, covert channels, malicious textual output not tied to a protected sink, or the consequences of a compromised root authority or validator.

Implications

From an offensive perspective, attackers who control the planner or compromise a non-root stage can exploit composition gaps to induce unauthorised effects by: substituting transformed fields after a policy decision, replaying or reusing permits, presenting stale policy or revocation state, or exploiting missing transformation witnesses. Compromising a root or a trusted validator undermines the whole chain and can produce authorised harmful effects. Even with CONTINUITY, adversaries can still mount denial-of-service by flooding rejected proposals, cause harmful textual outputs that are not finality-bound, or exploit any effect path not mediated by a compatible sink. The results stress that defenders must secure both individual controls and the authenticated contracts that bind them end-to-end.

// Similar research

Related Research

Get the weekly digest

The few AI-security papers that matter, with the practitioner takeaway. No spam.