aiqbench analysis
This paper provides a critical benchmark of time series foundation models for short-term load forecasting, specifically evaluating their robustness against noisy covariate data in power systems. The findings highlight a trade-off where Chronos-2 excels with accurate inputs but degrades under uncertainty, whereas TimesNet offers superior resilience when future covariates are unreliable. This analysis is vital for developers deploying AI models in grid operations where input data quality cannot be guaranteed.
Benchmarking Time Series Foundation Models for Load Forecasting Under Covariate Uncertainty
arXiv:2610.07232v1 Announce Type: new Abstract: Accurate short-term load forecasting (STLF) is essential for the reliable and efficient operation of modern power systems. While time series foundation models (TSFMs) have recently demonstrated remarkable performance across a wide range of forecasting tasks, their effectiveness for STLF under realistic operational conditions remains largely unexplored. In this paper, we present a comprehensive benchmark of four trained-from-scratch (TFS) models and four TSFMs across three real-world load forecasting datasets under operational scenarios that differ in the availability and quality of future covariate information. Our results show that Chronos-2 consistently achieves state-of-the-art performance in both zero-shot and fine-tuned settings when future covariates are available or accurately forecast. However, its performance degrades as covariate forecasts become increasingly noisy, whereas TimesNet exhibits greater robustness under severe covariate uncertainty. These findings demonstrate the effectiveness of covariate-informed TSFMs for STLF while highlighting the critical role of robust covariate modeling in real-world forecasting applications.
Abstract:Accurate short-term load forecasting (STLF) is essential for the reliable and efficient operation of modern power systems. While time series foundation models (TSFMs) have recently demonstrated remarkable performance across a wide range of forecasting tasks, their effectiveness for STLF under realistic operational conditions remains largely unexplored. In this paper, we present a comprehensive benchmark of four trained-from-scratch (TFS) models and four TSFMs across three real-world load forecasting datasets under operational scenarios that differ in the availability and quality of future covariate information. Our results show that Chronos-2 consistently achieves state-of-the-art performance in both zero-shot and fine-tuned settings when future covariates are available or accurately forecast. However, its performance degrades as covariate forecasts become increasingly noisy, whereas TimesNet exhibits greater robustness under severe covariate uncertainty. These findings demonstrate the effectiveness of covariate-informed TSFMs for STLF while highlighting the critical role of robust covariate modeling in real-world forecasting applications.
5 pages, 1 figure, 5 tables. Accepted to the 2027 IEEE PES Grid Edge Conference & Expo, Salt Lake City, UT, USA, 19-22 April 2027
Machine Learning (cs.LG); Systems and Control (eess.SY)
arXiv:2610.07232 [cs.LG]
(or arXiv:2610.07232v1 [cs.LG] for this version)
https://doi.org/10.48550/arXiv.2610.07232 Focus to learn more arXiv-issued DOI via DataCite (pending registration)
arXivLabs is a framework that allows collaborators to develop and share new arXiv features directly on our website.
Both individuals and organizations that work with arXivLabs have embraced and accepted our values of openness, community, excellence, and user data privacy. arXiv is committed to these values and only works with partners that adhere to them.
Have an idea for a project that will add value for arXiv's community? Learn more about arXivLabs.
Full text under the publisher's open licence · 270 words
Related coverage
FETS Benchmark: Foundation Models Enable Scalable and Generalizable Energy Time Series Forecasting
arXiv · Jul 21, 2026

Prophet vs NeuralProphet vs TimeGPT vs Chronos: A Practical Comparison
Analytics Vidhya · Jun 9, 2026

IBM releases SOTA Granite Time Series PatchTST-FM-r2 model with commercial-friendly license
Hugging Face · Sep 9, 2026

News
Quantum Computing Report · Jul 25, 2026