analiza aiqbench
An agentic system that handled the full research loop, from hypothesis and experiment design to live data collection with 288 participants and manuscript drafting, is a concrete step beyond AI tools that only speed up single tasks. The authors report results comparable to experienced researchers but note weaknesses in conceptual nuance and theoretical interpretation, so the claim is about capability in defined workflows, not replacement of scientific judgment. Readers should watch the open questions the authors raise about attribution and verification of AI-generated findings.
Closing the empirical loop: autonomous AI agents conduct end-to-end research with human participants
De la arXiv
Text integralarXiv:2508.13421v3 Announce Type: replace Abstract: Artificial intelligence systems are transforming scientific discovery by accelerating specific research tasks, from protein structure prediction to materials design, yet remain confined to narrow domains requiring substantial human oversight. Exponential growth of scientific literature and increasing domain specialisation constrain researchers capacity to synthesise knowledge across disciplines and develop unifying theories, motivating exploration of more general-purpose AI systems for science. Here we show that a domain-agnostic, agentic AI system can independently navigate the scientific workflow, from hypothesis generation through data collection to manuscript preparation.
The system autonomously designed and executed three psychological studies on visual working memory, mental rotation, and imagery vividness, executed online data collection with 288 participants, developed analysis pipelines through over 8-hour continuous coding sessions, and produced completed manuscripts. The results demonstrate the capability of AI scientific discovery pipelines to conduct research with theoretical reasoning and methodological rigour comparable to experienced researchers, though with limitations in conceptual nuance and theoretical interpretation.
This is a step toward embodied AI that can test hypotheses through real-world experiments, accelerating discovery by autonomously exploring regions of scientific space that human cognitive and resource constraints might otherwise leave unexplored. It raises important questions about the nature of scientific understanding and attribution of scientific credit.
Abstract:Artificial intelligence systems are transforming scientific discovery by accelerating specific research tasks, from protein structure prediction to materials design, yet remain confined to narrow domains requiring substantial human oversight. Exponential growth of scientific literature and increasing domain specialisation constrain researchers capacity to synthesise knowledge across disciplines and develop unifying theories, motivating exploration of more general-purpose AI systems for science. Here we show that a domain-agnostic, agentic AI system can independently navigate the scientific workflow, from hypothesis generation through data collection to manuscript preparation.
The system autonomously designed and executed three psychological studies on visual working memory, mental rotation, and imagery vividness, executed online data collection with 288 participants, developed analysis pipelines through over 8-hour continuous coding sessions, and produced completed manuscripts. The results demonstrate the capability of AI scientific discovery pipelines to conduct research with theoretical reasoning and methodological rigour comparable to experienced researchers, though with limitations in conceptual nuance and theoretical interpretation.
This is a step toward embodied AI that can test hypotheses through real-world experiments, accelerating discovery by autonomously exploring regions of scientific space that human cognitive and resource constraints might otherwise leave unexplored. It raises important questions about the nature of scientific understanding and attribution of scientific credit.
Artificial Intelligence (cs.AI); Emerging Technologies (cs.ET)
arXiv:2508.13421 [cs.AI]
(or arXiv:2508.13421v3 [cs.AI] for this version)
https://doi.org/10.48550/arXiv.2508.13421 Focus to learn more arXiv-issued DOI via DataCite
https://doi.org/10.1002/advs.76675 Focus to learn more DOI(s) linking to related resources
arXivLabs is a framework that allows collaborators to develop and share new arXiv features directly on our website.
Both individuals and organizations that work with arXivLabs have embraced and accepted our values of openness, community, excellence, and user data privacy. arXiv is committed to these values and only works with partners that adhere to them.
Have an idea for a project that will add value for arXiv's community? Learn more about arXivLabs.
Text integral sub licența deschisă a publicației · 306 cuvinte
Subiecte conexe
SPARK: Low Latency Single-Camera 3D Pose Estimation for Autonomous Racing using Keypoints
arXiv · 17 iun. 2026
Multimodal Socially Aware Framework for Human-Robot Interaction in Virtual Reality
arXiv · 27 oct. 2026
Predictive gains, causal losses: why interventional competence cannot be learned from data alone
arXiv · 5 nov. 2026
Strategic Evaluation of Planning Strategies for LLM Agents in Cyber-Physical Systems
arXiv · 6 aug. 2026