aiqbench analysis
Timer-M1 advances multivariate time series forecasting by introducing a primitive-based pretraining pipeline that synthesizes shared temporal patterns across domains. By adapting gated 2D Transformer blocks to dynamically allocate attention, the model achieves top-tier performance on major benchmarks like FEV and TIME for zero-shot generalization. This work establishes a robust framework for handling complex real-world scenarios where existing foundation models often struggle with domain transfer.
Timer-M1: A Multivariate Time Series Foundation Model via Learning Primitives
arXiv:2610.11734v1 Announce Type: cross Abstract: We introduce Timer-M1, a pretrained multivariate time series foundation model that learns with primitives for zero-shot forecasting. Across domains, time series share elementary temporal and relational patterns, termed primitives, yet differ in how these primitives manifest and evolve across different contexts. Despite progress in zero-shot and task-general forecasting, existing foundation models may still struggle to generalize to complex real-world scenarios. To this end, we develop a primitive-based data synthesis and pretraining pipeline. The synthesis pipeline generates series with temporal primitives shared across domains and then assembles real and generated series into multivariate samples using relational primitives. Afterwards, samples are organized into episodes by assigning distinct channel roles as target variates, past-only covariates, and known-future covariates, ensuring that the model is optimized on predictable variates using available exogenous information. Technically, Timer-M1 further adapts gated two-dimensional Transformer blocks that dynamically allocate cross-variate attention across layers. Across three large-scale forecasting benchmarks, Timer-M1 ranks first on both FEV and TIME and second on GIFT-Eval among most recent time series foundation models. These results support effective primitive-based pretraining as a route to robust general forecasting technique across domains and task settings.
Abstract:We introduce Timer-M1, a pretrained multivariate time series foundation model that learns with primitives for zero-shot forecasting. Across domains, time series share elementary temporal and relational patterns, termed primitives, yet differ in how these primitives manifest and evolve across different contexts. Despite progress in zero-shot and task-general forecasting, existing foundation models may still struggle to generalize to complex real-world scenarios. To this end, we develop a primitive-based data synthesis and pretraining pipeline. The synthesis pipeline generates series with temporal primitives shared across domains and then assembles real and generated series into multivariate samples using relational primitives. Afterwards, samples are organized into episodes by assigning distinct channel roles as target variates, past-only covariates, and known-future covariates, ensuring that the model is optimized on predictable variates using available exogenous information. Technically, Timer-M1 further adapts gated two-dimensional Transformer blocks that dynamically allocate cross-variate attention across layers. Across three large-scale forecasting benchmarks, Timer-M1 ranks first on both FEV and TIME and second on GIFT-Eval among most recent time series foundation models. These results support effective primitive-based pretraining as a route to robust general forecasting technique across domains and task settings.
Machine Learning (cs.LG); Artificial Intelligence (cs.AI)
arXiv:2610.11734 [cs.LG]
(or arXiv:2610.11734v1 [cs.LG] for this version)
https://doi.org/10.48550/arXiv.2610.11734 Focus to learn more arXiv-issued DOI via DataCite (pending registration)
arXivLabs is a framework that allows collaborators to develop and share new arXiv features directly on our website.
Both individuals and organizations that work with arXivLabs have embraced and accepted our values of openness, community, excellence, and user data privacy. arXiv is committed to these values and only works with partners that adhere to them.
Have an idea for a project that will add value for arXiv's community? Learn more about arXivLabs.
Full text under the publisher's open licence · 283 words
Related coverage
WxFM-XL: Adapting Univariate Foundation Models to Multi-Station Weather Forecasting
arXiv · Oct 8, 2026
News
Quantum Computing Report · Jun 7, 2026
Foundations without Fundamentals: Zero-Shot Blind Spots in Time Series FMs
arXiv · Oct 2, 2026
7 Steps to Mastering Time Series Analysis with Python
KDnuggets · Jun 4, 2026