aiqbench analysis
This study analyzes over 73,000 user reports on the OpenClaw autonomous agent to identify gaps between task completion and the human values users prioritize during delegation. The findings reveal that while agents often meet expectations regarding their outputs, they frequently fail to uphold critical operating conditions like oversight and affordability when users attempt to supervise them. This research highlights a crucial shift in AI evaluation from mere functionality to "value-sensitive delegation," emphasizing the need to address the broader context of agent usage rather than just final results.
Value-Sensitive Delegation in Everyday AI Agent Use: Evidence from OpenClaw
arXiv:2609.22067v1 Announce Type: cross Abstract: Users increasingly delegate work to autonomous AI agents, yet evaluations typically measure task completion rather than the values users prioritize. Using Value Sensitive Design, we analyzed, with LLM assistance, 73,093 first-person Reddit posts about using OpenClaw, each for its human value, agent aspect, value fulfillment, and user outcome. The 21 values form six value groups, including Autonomous, Dependable, and Affordable Operation, Bounded Reach, Reviewability, and Equitable Access. Relative to each aspect's corpus share, values clustered not at the agent's outputs but at the operating conditions users set around a run. Values were usually met where users described what the agent delivered, in five of six groups, and mostly unmet where users described supervising it, in all six groups. We conceptualize this pattern as value-sensitive delegation. Supporting human values requires attention not only to what an agent accomplishes, but to the conditions users set around delegation, including cost, access, and oversight.
Abstract:Users increasingly delegate work to autonomous AI agents, yet evaluations typically measure task completion rather than the values users prioritize. Using Value Sensitive Design, we analyzed, with LLM assistance, 73,093 first-person Reddit posts about using OpenClaw, each for its human value, agent aspect, value fulfillment, and user outcome. The 21 values form six value groups, including Autonomous, Dependable, and Affordable Operation, Bounded Reach, Reviewability, and Equitable Access. Relative to each aspect's corpus share, values clustered not at the agent's outputs but at the operating conditions users set around a run. Values were usually met where users described what the agent delivered, in five of six groups, and mostly unmet where users described supervising it, in all six groups. We conceptualize this pattern as value-sensitive delegation. Supporting human values requires attention not only to what an agent accomplishes, but to the conditions users set around delegation, including cost, access, and oversight.
Human-Computer Interaction (cs.HC); Artificial Intelligence (cs.AI)
arXiv:2609.22067 [cs.HC]
(or arXiv:2609.22067v1 [cs.HC] for this version)
https://doi.org/10.48550/arXiv.2609.22067 Focus to learn more arXiv-issued DOI via DataCite (pending registration)
arXivLabs is a framework that allows collaborators to develop and share new arXiv features directly on our website.
Both individuals and organizations that work with arXivLabs have embraced and accepted our values of openness, community, excellence, and user data privacy. arXiv is committed to these values and only works with partners that adhere to them.
Have an idea for a project that will add value for arXiv's community? Learn more about arXivLabs.
Full text under the publisher's open licence · 247 words
Related coverage

Presentation: Exploding GPUs
InfoQ · Oct 16, 2026

Podcast: Securing AI Agents: Identity, Authorization, and the DPACT Framework
InfoQ · Sep 21, 2026
[AINews] High Taste Testers Ep. 1
Latent Space · Oct 17, 2026

[AINews] not much happened today
Latent Space · Oct 3, 2026