Skip to main navigation Skip to search Skip to main content

Certified Multi-Source Integrity for Structured Agent Actions

  • Anmol Pandey
  • , Aditya Jain
  • , Liang Chen
  • , Carsten Maple
  • , Christo Panchev

Research output: Chapter in Book/Report/Conference proceeding › Conference contribution

Abstract

LLM agents increasingly take privileged, often irreversible structured actions, such as paying an invoice. They assemble each action from action-critical fields in documents and tool outputs that an adversary can corrupt, and indirect prompt injection can drive the model itself to extract attacker-chosen values. Current defenses gate on a source’s trust label or certify free-text answer quality. None certifies the integrity of a coupled, policy-bound structured action under a corruption budget that accounts for shared upstream sources. We characterize when such an action is safely certifiable and give the maximally live safe certifier. It admits an action only when each field clears the rule its evidence structure supports: a bounded corruption radius over corruption-distinct evidence classes, counted by a minimum hitting set so that re-publishing or laundered copies cannot manufacture quorum, deterministic reconciliation for complementary fields, and a trusted anchor where the evidence leaves a field single-sourced. We formalize two robustness notions, validate each mechanism by ablation, and measure how often the multi-source precondition holds on sanctions designations (70,966 entities) and software supply-chain provenance (450 packages). Under upper-bound proxies, genuine corroboration is a minority phenomenon in both, and naive attestation counting overstates it, since witnesses that look independent collapse to two corruption-distinct domains once shared origin is counted. Across five current models in a real agent loop, a realistic injection fools every model but one and a naive agent then executes the fraudulent action on most attacks. The certifier admits no unsafe action and recovers the correct value where corroboration permits, while action-gating and provenance baselines are broken in every world of our harness.
Original languageEnglish
Title of host publicationProceedings of the Fourth UK AI Conference 2026
PublisherML Research Press
Publication statusPublished - 30 Sept 2026

Publication series

NameProceedings of Machine Learning Research
ISSN (Print)2640-3498

Fingerprint

Dive into the research topics of 'Certified Multi-Source Integrity for Structured Agent Actions'. Together they form a unique fingerprint.

Cite this