← Back to Library

Step-Wise Refusal Dynamics in Autoregressive and Diffusion Language Models

Authors: Eliron Rahimi, Elad Hirshel, Rom Himelstein, Amit LeVi, Avi Mendelson, Chaim Baskin

Published: 2026-02-01

arXiv ID: 2602.02600v1

Added to Library: 2026-02-04 03:04 UTC

📄 Abstract

Diffusion language models (DLMs) have recently emerged as a promising alternative to autoregressive (AR) models, offering parallel decoding and controllable sampling dynamics while achieving competitive generation quality at scale. Despite this progress, the role of sampling mechanisms in shaping refusal behavior and jailbreak robustness remains poorly understood. In this work, we present a fundamental analytical framework for step-wise refusal dynamics, enabling comparison between AR and diffusion sampling. Our analysis reveals that the sampling strategy itself plays a central role in safety behavior, as a factor distinct from the underlying learned representations. Motivated by this analysis, we introduce the Step-Wise Refusal Internal Dynamics (SRI) signal, which supports interpretability and improved safety for both AR and DLMs. We demonstrate that the geometric structure of SRI captures internal recovery dynamics, and identifies anomalous behavior in harmful generations as cases of \emph{incomplete internal recovery} that are not observable at the text level. This structure enables lightweight inference-time detectors that generalize to unseen attacks while matching or outperforming existing defenses with over $100\times$ lower inference overhead.

🔍 Key Points

  • Development of AgentDyn, a dynamic open-ended benchmark to assess the resilience of AI agents against prompt injection attacks.
  • Identification and critical analysis of three major flaws in existing benchmarks: lack of dynamic tasks, absence of helpful instructions, and overly simplistic user tasks.
  • Empirical investigation demonstrating that state-of-the-art defenses exhibit significant vulnerabilities when tested against AgentDyn, highlighting their inadequacy for real-world deployment.
  • Introduction of a comprehensive suite of 60 challenging user tasks and 560 injection scenarios across various real-life applications such as Shopping and GitHub.
  • Evaluation results showing that almost all defenses face severe utility drops under dynamic and complex attack scenarios, exposing the shortcomings in their robustness.

💡 Why This Paper Matters

This paper is relevant and important because it addresses the critical security challenges posed by prompt injection attacks in AI agents, which are increasingly integrated into complex real-world applications. By introducing AgentDyn, the authors not only provide a new standard for evaluating agent defenses but also raise awareness about the limitations of current methods and the need for more robust security frameworks. This contribution is vital as it informs both researchers and developers on the vulnerabilities of existing systems and encourages the advancement of secure AI technologies.

🎯 Why It's Interesting for AI Security Researchers

This paper is of interest to AI security researchers as it presents groundbreaking insights into the vulnerabilities of existing defenses against prompt injection attacks, a significant concern for the deployment of AI systems. The introduction of AgentDyn as a new benchmark for assessing agent security and its ability to expose hidden failures of traditional defenses offers valuable data and encourages further research and innovation in the design of more secure AI architectures. The findings can influence the development of protective measures and promote a deeper understanding of AI security within the research community.

📚 Read the Full Paper