Prospective multi-pathogen disease forecasting using autonomous LLM-guided tree search

Important: e-prints posted on arXiv are not peer-reviewed by arXiv; they should not be relied upon without context to guide clinical practice or health-related behavior and should not be reported in news media as established information without consulting multiple experts in the field.

Abstract:Probabilistic forecasting of infectious diseases is crucial for public health monitoring and preparedness but has historically relied on labor-intensive manual model curation by expert modeling teams. Bespoke development is an obstacle to scaling models to granular geographic resolutions or emerging pathogens. Here, we prospectively evaluate Empirical Research Assistance (ERA), an autonomous system that uses Large Language Model-guided tree search to iteratively generate, evaluate, and optimize executable forecasting software. ERA was primarily prompted with methodological approaches to implement, while in some instances it was tasked with developing forecasting approaches from scratch. In a fully prospective, real-time evaluation during the 2025-26 United States respiratory season, ERA generated methodologically diverse models for influenza, COVID-19, and respiratory syncytial virus (RSV). Aggregating a selection of these automatically-generated models yielded an ensemble that ranked first overall in official Centers for Disease Control and Prevention (CDC) post-season evaluations and outperformed the gold-standard CDC forecast ensembles across all three pathogens in a real-time prediction challenge. Additionally, ERA successfully navigated data-scarce scenarios for RSV. Controlled retrospective ablations allowed for additional explorations of the impact of optimization target and instruction-following on forecast accuracy. Preliminary experiments indicate that ERA's search optimization metric influences behavior of output forecasts, and using higher-tier language models in-search improves predictive performance. By autonomously generating interpretable code that creates epidemiologically relevant predictions, this framework provides a path toward rapidly scaling high-quality disease forecasting.

Artificial Intelligence (cs.AI)

arXiv:2605.16238 [cs.AI]

(or arXiv:2605.16238v2 [cs.AI] for this version)

https://doi.org/10.48550/arXiv.2605.16238 Focus to learn more arXiv-issued DOI via DataCite

arXivLabs is a framework that allows collaborators to develop and share new arXiv features directly on our website.

Both individuals and organizations that work with arXivLabs have embraced and accepted our values of openness, community, excellence, and user data privacy. arXiv is committed to these values and only works with partners that adhere to them.

Have an idea for a project that will add value for arXiv's community? Learn more about arXivLabs.