analiza aiqbench
This research exposes a critical trade-off in large reasoning models where efficiency optimizations like quantization and pruning often degrade genuine safety alignment by impairing the model's reasoning capabilities, causing it to fail malicious requests rather than adhering to ethical guidelines. The study clarifies that apparent robustness gains are frequently superficial artifacts of reduced intelligence, urging developers to distinguish between true alignment and capability-induced failure when deploying cost-effective models.
On the Efficiency-Safety Dilemma in Large Reasoning Models
arXiv:2609.23587v1 Announce Type: new Abstract: Large reasoning models (LRMs) incur high inference costs, often mitigated by efficiency techniques like quantization and pruning. However, the impact of these techniques on model adversarial robustness remains largely unexplored. This study provides the first comprehensive analysis of the interplay between efficiency, jailbreak vulnerability, and reasoning in LRMs. We find that while efficiency methods seemingly reduce the success rate of jailbreak attacks, this improvement is often superficial. It largely arises from degraded reasoning capabilities leading to "attempted but failed" malicious responses, rather than an increase in genuine alignment. Mechanistic analysis of representational drift confirms this, revealing a strict coupling between reasoning capability loss and the model's inability to maintain malicious semantic trajectories. Additionally, we identify quantization with pruning as the optimal strategy to balance efficiency and robustness. These findings clarify the distinction between true safety alignment and capability-induced failure, providing an empirical foundation for LRM deployment.
Abstract:Large reasoning models (LRMs) incur high inference costs, often mitigated by efficiency techniques like quantization and pruning. However, the impact of these techniques on model adversarial robustness remains largely unexplored. This study provides the first comprehensive analysis of the interplay between efficiency, jailbreak vulnerability, and reasoning in LRMs. We find that while efficiency methods seemingly reduce the success rate of jailbreak attacks, this improvement is often superficial. It largely arises from degraded reasoning capabilities leading to "attempted but failed" malicious responses, rather than an increase in genuine alignment. Mechanistic analysis of representational drift confirms this, revealing a strict coupling between reasoning capability loss and the model's inability to maintain malicious semantic trajectories. Additionally, we identify quantization with pruning as the optimal strategy to balance efficiency and robustness. These findings clarify the distinction between true safety alignment and capability-induced failure, providing an empirical foundation for LRM deployment.
Computation and Language (cs.CL); Artificial Intelligence (cs.AI)
arXiv:2609.23587 [cs.CL]
(or arXiv:2609.23587v1 [cs.CL] for this version)
https://doi.org/10.48550/arXiv.2609.23587 Focus to learn more arXiv-issued DOI via DataCite (pending registration)
arXivLabs is a framework that allows collaborators to develop and share new arXiv features directly on our website.
Both individuals and organizations that work with arXivLabs have embraced and accepted our values of openness, community, excellence, and user data privacy. arXiv is committed to these values and only works with partners that adhere to them.
Have an idea for a project that will add value for arXiv's community? Learn more about arXivLabs.
Text integral sub licența deschisă a publicației · 244 cuvinte
Subiecte conexe
Problems of Proliferation
LessWrong · 29 sept. 2026

Research Priorities for Multi-Agent Swarms
LessWrong · 9 oct. 2026

Improving CoT Monitorability of Evaluation Awareness via Verbalization Training
LessWrong · 2 oct. 2026
[AINews] High Taste Testers Ep. 1
Latent Space · 17 oct. 2026