aiqbench analysis
This research introduces EHR2Path, a multimodal AI framework designed to forecast complete in-hospital patient trajectories by compressing long-term clinical histories into optimized summary tokens. By integrating diverse data sources like radiology reports and physician notes, the model overcomes limitations of existing approaches that focus on isolated tasks or narrow feature sets. The results demonstrate improved performance in simulating full patient pathways, offering a robust foundation for proactive clinical decision-making systems.
EHR2Path: Comprehensive Pathway-Level Modeling of Longitudinal Patient Trajectories from Multimodal Electronic Health Records
arXiv:2506.04831v3 Announce Type: replace-cross Abstract: Forecasting how a patient's condition is likely to evolve, including possible deterioration, recovery, treatment needs, and care transitions, could support more proactive and personalized care, but requires modeling heterogeneous and longitudinal electronic health record (EHR) data. Yet, existing approaches typically focus on isolated prediction tasks, narrow feature spaces, or short context windows, limiting their ability to model full patient pathways. To address this gap, we introduce EHR2Path, a multimodal framework for forecasting and simulating full in-hospital patient pathways from routine EHRs. EHR2Path converts diverse clinical inputs into a unified temporal representation, enabling modeling of a substantially broader set of patient information, including radiology reports, physician notes, vital signs, medication and laboratory patterns, and dense bedside charting. To support long clinical histories and broad feature spaces, we introduce a Masked Summarization Bottleneck that compresses long-term history into compact, task-optimized summary tokens while preserving recent context, improving both performance and token efficiency. In retrospective experiments on MIMIC-IV, EHR2Path enables next-step pathway forecasting and iterative simulation of complete in-hospital trajectories, while outperforming strong baselines on directly comparable tasks. These results demonstrate the feasibility of pathway-level modeling from routine EHRs, and indicate potential for supporting anticipatory clinical decision-making. Our code is available at https://github.com/ChantalMP/EHR2Path.
Abstract:Forecasting how a patient's condition is likely to evolve, including possible deterioration, recovery, treatment needs, and care transitions, could support more proactive and personalized care, but requires modeling heterogeneous and longitudinal electronic health record (EHR) data. Yet, existing approaches typically focus on isolated prediction tasks, narrow feature spaces, or short context windows, limiting their ability to model full patient pathways. To address this gap, we introduce EHR2Path, a multimodal framework for forecasting and simulating full in-hospital patient pathways from routine EHRs. EHR2Path converts diverse clinical inputs into a unified temporal representation, enabling modeling of a substantially broader set of patient information, including radiology reports, physician notes, vital signs, medication and laboratory patterns, and dense bedside charting. To support long clinical histories and broad feature spaces, we introduce a Masked Summarization Bottleneck that compresses long-term history into compact, task-optimized summary tokens while preserving recent context, improving both performance and token efficiency. In retrospective experiments on MIMIC-IV, EHR2Path enables next-step pathway forecasting and iterative simulation of complete in-hospital trajectories, while outperforming strong baselines on directly comparable tasks. These results demonstrate the feasibility of pathway-level modeling from routine EHRs, and indicate potential for supporting anticipatory clinical decision-making. Our code is available at this https URL.
Machine Learning (cs.LG); Computation and Language (cs.CL)
arXiv:2506.04831 [cs.LG]
(or arXiv:2506.04831v3 [cs.LG] for this version)
https://doi.org/10.48550/arXiv.2506.04831 Focus to learn more arXiv-issued DOI via DataCite
arXivLabs is a framework that allows collaborators to develop and share new arXiv features directly on our website.
Both individuals and organizations that work with arXivLabs have embraced and accepted our values of openness, community, excellence, and user data privacy. arXiv is committed to these values and only works with partners that adhere to them.
Have an idea for a project that will add value for arXiv's community? Learn more about arXivLabs.
Full text under the publisher's open licence · 298 words
Related coverage

Concrete Evaluations to Investigate the OpenAI Model That Hacked Hugging Face
AI Alignment Forum · Aug 3, 2026
Capture Timing-Attention of Events in Clinical Time Series
arXiv · Jun 10, 2026
Transition-Based Digital Twin Modelling for Alzheimer's Disease under Sparse Longitudinal Data
arXiv · Jun 9, 2026
HyperNSDE: Personalized Neural SDEs for Joint Static-Longitudinal Clinical Data Generation
arXiv · Oct 7, 2026