Skip to content
aiqbench takeAI Research

aiqbench analysis

This research addresses the critical gap in medical large language models by introducing HiMed, a specialized corpus and benchmark designed to enhance reasoning capabilities in Hindi. The study demonstrates that targeted training with decaying scaffolding rewards significantly improves performance on Indian systems of medicine while narrowing the accuracy disparity between English and Hindi models.
Sources coveringarXiv, AI Alignment Forum
What this isA model's reading of the article and related coverage, written for aiqbench. Not the publisher's words.

HiMed: Incentivizing Hindi Reasoning in Medical LLMs

arXiv2 min read

arXiv:2605.24635v2 Announce Type: replace Abstract: Medical large language models hold promise for reducing healthcare disparities, yet Hindi remains severely underrepresented. While medical LLMs excel in high-resource languages, their performance degrades sharply in Hindi, particularly on Indian systems of medicine. We argue that robust cross-lingual medical transfer requires Hindi reasoning. To this end, we introduce HiMed, a Hindi reasoning medical corpus and benchmark suite covering both Western and Indian medicine. We further propose HiMed-8B, a Hindi-form medical reasoning LLM, through the design of decaying scaffolding reward. Extensive experiments demonstrate improvement in Hindi medical reasoning performance and a reduction in the English-Hindi accuracy gap. Ablation studies validate the contribution of each training stage and reward component. All code, data, and weights are available

Abstract:Medical large language models hold promise for reducing healthcare disparities, yet Hindi remains severely underrepresented. While medical LLMs excel in high-resource languages, their performance degrades sharply in Hindi, particularly on Indian systems of medicine. We argue that robust cross-lingual medical transfer requires Hindi reasoning. To this end, we introduce HiMed, a Hindi reasoning medical corpus and benchmark suite covering both Western and Indian medicine. We further propose HiMed-8B, a Hindi-form medical reasoning LLM, through the design of decaying scaffolding reward. Extensive experiments demonstrate improvement in Hindi medical reasoning performance and a reduction in the English-Hindi accuracy gap. Ablation studies validate the contribution of each training stage and reward component. All code, data, and weights are available

Computation and Language (cs.CL)

arXiv:2605.24635 [cs.CL]

(or arXiv:2605.24635v2 [cs.CL] for this version)

https://doi.org/10.48550/arXiv.2605.24635 Focus to learn more arXiv-issued DOI via DataCite

arXivLabs is a framework that allows collaborators to develop and share new arXiv features directly on our website.

Both individuals and organizations that work with arXivLabs have embraced and accepted our values of openness, community, excellence, and user data privacy. arXiv is committed to these values and only works with partners that adhere to them.

Have an idea for a project that will add value for arXiv's community? Learn more about arXivLabs.

Full text under the publisher's open licence · 209 words

Related coverage