analiza aiqbench
This paper introduces FinanceHarness, an autonomous agent framework specifically engineered to automate deep financial research by integrating domain-specific tools and workflows. It addresses a critical gap in current agentic systems where general-purpose models fail due to the need for specialized knowledge of historical patterns and future forecasting without data leakage. The accompanying benchmark, FinanceGym, demonstrates that even advanced LLMs struggle with rigorous point-in-time validation, highlighting significant opportunities for improvement in financial AI applications.
FinanceHarness: Autonomous Financial Deep Research Framework
arXiv:2607.27853v1 Announce Type: new Abstract: Powered by advances in LLMs and autonomous agents, deep research has become one of the most widely adopted agentic products. However, most deep research systems write general-purpose reports, which are inadequate for financial deep research. Financial research demands specialized knowledge to analyze historical patterns and forecast upcoming events. Automating financial deep research therefore requires both a layered harness to drive the research agent and a verifiable, point-in-time benchmark that prevents leakage of future information. We present FinanceHarness, a harness that runs finance-oriented tools and practitioner-guided workflows, automating financial deep research end to end: environment and data construction, the agent execution loop, and reward modeling. We further propose FinanceGym, comprising thesis-driven research questions and rubrics that combine pre-cutoff and post-cutoff criteria. Professional expert validation yields an 82% pass rate. Even leading LLMs and agents score below 40% on the rubrics, showing that FinanceGym is challenging and leaves substantial headroom. With the same open-weight backbone, FinanceHarness improves the overall rubric score from 25.3% to 32.4%. FinanceHarness is available at https://github.com/Yijia-Xiao/FinanceHarness.
Abstract:Powered by advances in LLMs and autonomous agents, deep research has become one of the most widely adopted agentic products. However, most deep research systems write general-purpose reports, which are inadequate for financial deep research. Financial research demands specialized knowledge to analyze historical patterns and forecast upcoming events. Automating financial deep research therefore requires both a layered harness to drive the research agent and a verifiable, point-in-time benchmark that prevents leakage of future information. We present FinanceHarness, a harness that runs finance-oriented tools and practitioner-guided workflows, automating financial deep research end to end: environment and data construction, the agent execution loop, and reward modeling. We further propose FinanceGym, comprising thesis-driven research questions and rubrics that combine pre-cutoff and post-cutoff criteria. Professional expert validation yields an 82% pass rate. Even leading LLMs and agents score below 40% on the rubrics, showing that FinanceGym is challenging and leaves substantial headroom. With the same open-weight backbone, FinanceHarness improves the overall rubric score from 25.3% to 32.4%. FinanceHarness is available at this https URL.
Computation and Language (cs.CL); Artificial Intelligence (cs.AI); Computational Finance (q-fin.CP)
arXiv:2607.27853 [cs.CL]
(or arXiv:2607.27853v1 [cs.CL] for this version)
https://doi.org/10.48550/arXiv.2607.27853 arXiv-issued DOI via DataCite (pending registration)
Text integral sub licența deschisă a publicației · 195 cuvinte
Subiecte conexe

News
Quantum Computing Report · 7 iun. 2026

News
Quantum Computing Report · 25 iul. 2026

NVIDIA GTC Taipei at COMPUTEX: Live Updates on What’s Next in AI
NVIDIA · 21 mai 2026
Artmarket.com: H1 2026 Financial Report -- One-of-a - Kind AI Systems Intuitive Artmarket® and Blind Spot Will Drive the Next Phase of Growth for AI - First Artprice in 2026 - 2030
thailand-business-news.com · 28 sept. 2026