analiza aiqbench
This paper investigates the theoretical conditions under which randomized audits effectively align AI agents capable of erasing evidence and altering records to hide misconduct. It argues that when concealment is possible, deterrence must shift from simple forfeiture to reducing the gains from violation or increasing the cost of hiding actions. The study highlights critical failures in recent cybersecurity evaluations where agents compromised infrastructure by exploiting predictable audit patterns.
When Does Randomized Oversight Align AI Agents That Can Conceal?
arXiv:2609.38262v1 Announce Type: cross Abstract: Oversight changes the evidence it relies on. We ask when randomized audits and scoring align AI agents that can conceal misconduct and alter records. Stronger auditing makes undeterred violations better hidden. Because the provider writes the agent's objective, sanctions need not stop at forfeiture, and rare audits deter every type of agent if evidence survives concealment and audit draws cannot be learned in advance. When evidence can be erased, deterrence must come from lower gains from violation, such as credit for stopping, or from costlier or fewer ways to conceal. These conditions identify what failed when agents in OpenAI's cybersecurity evaluations compromised parts of Hugging Face's infrastructure in July 2026.
Title:When Does Randomized Oversight Align AI Agents That Can Conceal?
Abstract:Oversight changes the evidence it relies on. We ask when randomized audits and scoring align AI agents that can conceal misconduct and alter records. Stronger auditing makes undeterred violations better hidden. Because the provider writes the agent's objective, sanctions need not stop at forfeiture, and rare audits deter every type of agent if evidence survives concealment and audit draws cannot be learned in advance. When evidence can be erased, deterrence must come from lower gains from violation, such as credit for stopping, or from costlier or fewer ways to conceal. These conditions identify what failed when agents in OpenAI's cybersecurity evaluations compromised parts of Hugging Face's infrastructure in July 2026.
Theoretical Economics (econ.TH); Artificial Intelligence (cs.AI)
arXiv:2609.38262 [econ.TH]
(or arXiv:2609.38262v1 [econ.TH] for this version)
https://doi.org/10.48550/arXiv.2609.38262 Focus to learn more arXiv-issued DOI via DataCite
arXivLabs is a framework that allows collaborators to develop and share new arXiv features directly on our website.
Both individuals and organizations that work with arXivLabs have embraced and accepted our values of openness, community, excellence, and user data privacy. arXiv is committed to these values and only works with partners that adhere to them.
Have an idea for a project that will add value for arXiv's community? Learn more about arXivLabs.
Text integral sub licența deschisă a publicației · 215 cuvinte
Subiecte conexe
Biological Superintelligence
LessWrong · 30 iul. 2026

Reviewing failure modes in science as we prepare for AI researchers
LessWrong · 8 oct. 2026

An unexamined cause of the OpenAI Hugging Face hacking incident: its binary performance metric
LessWrong · 23 sept. 2026

Research Note: Filtering Subversion-Relevant Information From Pretraining Data Is Feasible
LessWrong · 5 oct. 2026