analiza aiqbench
Composing insight from the full article — this may take a moment.
TSSDA: An Autonomous Agent for Constructing a Time-Series Text-to-SQL Benchmark
arXiv:2611.02132v1 Announce Type: new Abstract: As agents increasingly undertake data querying, Text-to-SQL serves as a foundational capability for database access. However, for text-to-SQL in time-series databases, high-quality benchmarks and large-scale training corpora remain scarce, limiting the systematic evaluation and domain adaptation of existing models and agents. Existing automated SQL generation approaches lack sufficient autonomy, leaving key challenges unresolved. First, numerous combinations of temporal syntax and functions complicate comprehensive coverage of valid queries. Second, as the corpus grows, generating valuable and diverse new data becomes increasingly challenging. Third, schema and data heterogeneity hinder reuse of temporal query structures, limiting generation efficiency. To address these challenges, we propose TSSDA, a Time-Series SQL (TSSQL) Generation Data Agent framework, and construct TERN, a comprehensive Time-sERies text-to-SQL beNchmark. First, to achieve broad coverage of valid queries, we systematically model TSSQL syntax and semantics to construct a data generation space. Next, to explore the space and improve diversity, we develop a Data Agent that autonomously orchestrates data generation. The agent comprises a planning and decision-making module and a query generation module, with online adaptation for continuous self-improvement. Finally, we introduce a temporal-aware memory that enables adaptive reuse of experience across heterogeneous data instances, improving generation efficiency. Comprehensive evaluations on TERN reveal the limitations of existing methods in performing Text-to-TSSQL tasks. Furthermore, extensive experiments demonstrate that TSSDA substantially improves coverage, diversity, and complexity.
Citește articolul complet pe arXivSubiecte conexe
FinCUABuild: Can Agents Build Reliable Benchmarks for Dynamic Financial Computer Use?
arXiv · 9 sept. 2026
Autoware in Construction: Gap Analysis and LiDAR Perception Toward Off-Road Autonomous Driving
arXiv · 6 oct. 2026
Large language model and reinforcement learning based autonomous construction and progress updates
arXiv · 21 oct. 2026
Autonomous Quantum Memories from Classical Stochastic Processes
arXiv · 6 oct. 2026