aiqbench analysis
This research addresses the critical gap in medical large language models by introducing HiMed, a specialized corpus and benchmark designed to enhance reasoning capabilities in Hindi. The study demonstrates that targeted training with decaying scaffolding rewards significantly improves performance on Indian systems of medicine while narrowing the accuracy disparity between English and Hindi models.
HiMed: Incentivizing Hindi Reasoning in Medical LLMs
arXiv:2605.24635v2 Announce Type: replace Abstract: Medical large language models hold promise for reducing healthcare disparities, yet Hindi remains severely underrepresented. While medical LLMs excel in high-resource languages, their performance degrades sharply in Hindi, particularly on Indian systems of medicine. We argue that robust cross-lingual medical transfer requires Hindi reasoning. To this end, we introduce HiMed, a Hindi reasoning medical corpus and benchmark suite covering both Western and Indian medicine. We further propose HiMed-8B, a Hindi-form medical reasoning LLM, through the design of decaying scaffolding reward. Extensive experiments demonstrate improvement in Hindi medical reasoning performance and a reduction in the English-Hindi accuracy gap. Ablation studies validate the contribution of each training stage and reward component. All code, data, and weights are available
Abstract:Medical large language models hold promise for reducing healthcare disparities, yet Hindi remains severely underrepresented. While medical LLMs excel in high-resource languages, their performance degrades sharply in Hindi, particularly on Indian systems of medicine. We argue that robust cross-lingual medical transfer requires Hindi reasoning. To this end, we introduce HiMed, a Hindi reasoning medical corpus and benchmark suite covering both Western and Indian medicine. We further propose HiMed-8B, a Hindi-form medical reasoning LLM, through the design of decaying scaffolding reward. Extensive experiments demonstrate improvement in Hindi medical reasoning performance and a reduction in the English-Hindi accuracy gap. Ablation studies validate the contribution of each training stage and reward component. All code, data, and weights are available
Computation and Language (cs.CL)
arXiv:2605.24635 [cs.CL]
(or arXiv:2605.24635v2 [cs.CL] for this version)
https://doi.org/10.48550/arXiv.2605.24635 Focus to learn more arXiv-issued DOI via DataCite
arXivLabs is a framework that allows collaborators to develop and share new arXiv features directly on our website.
Both individuals and organizations that work with arXivLabs have embraced and accepted our values of openness, community, excellence, and user data privacy. arXiv is committed to these values and only works with partners that adhere to them.
Have an idea for a project that will add value for arXiv's community? Learn more about arXivLabs.
Full text under the publisher's open licence · 209 words
Related coverage

Concrete Evaluations to Investigate the OpenAI Model That Hacked Hugging Face
AI Alignment Forum · Aug 3, 2026
MMTClinic: Multimodal, Multilingual Time Series Question Answering and Reasoning Benchmark for Clinical Domain
arXiv · Sep 7, 2026
AdaThink-Med: Optimizing Inference-Time Compute for Medical Reasoning via Uncertainty Quantification
arXiv · Aug 5, 2026
Links #5: 2026/07
LessWrong · Jul 31, 2026