Skip to content
aiqbench takeAI Research

aiqbench analysis

This research investigates cross-lingual transfer mechanisms within the Turkic language family, demonstrating that model performance is highly dependent on specific source-target pairs and translation targets rather than just general script alignment. The study provides critical insights for low-resource machine translation by quantifying how fine-tuning strategies vary across closely related languages like Turkish-Azerbaijani versus Kazakh-Kyrgyz using mT5 architectures. These findings are essential for optimizing multilingual models in linguistically dense regions where data scarcity is a primary constraint.
Source coveringarXiv
What this isA model's reading of the article and related coverage, written for aiqbench. Not the publisher's words.

Cross-Lingual Transfer for Machine Translation in Turkic Languages

arXiv2 min read

arXiv:2607.29355v1 Announce Type: new Abstract: Cross-lingual transfer is central to low-resource machine translation, but its behavior within closely related language families remains insufficiently characterized. We study transfer among five Turkic languages; Turkish, Azerbaijani, Uzbek, Kazakh, and Kyrgyz; using pairwise transfer matrices. In this setting, each model is fine-tuned with one transfer source and evaluated on a different transfer target while the translation target remains the same. Across mT5 experiments, we find that transfer is strongest between closely related Turkic pairs, especially Turkish-Azerbaijani and Kazakh-Kyrgyz. We also show that transfer direction matters, and that the same transfer source-transfer target pair can behave differently when the translation target changes. Latinization improves BLEU and chrF in several script-mismatched settings, but its effect is not uniform across metrics. Additional analyses show that transfer sources are mostly stable across different datasets and model settings.

Abstract:Cross-lingual transfer is central to low-resource machine translation, but its behavior within closely related language families remains insufficiently characterized. We study transfer among five Turkic languages; Turkish, Azerbaijani, Uzbek, Kazakh, and Kyrgyz; using pairwise transfer matrices. In this setting, each model is fine-tuned with one transfer source and evaluated on a different transfer target while the translation target remains the same. Across mT5 experiments, we find that transfer is strongest between closely related Turkic pairs, especially Turkish-Azerbaijani and Kazakh-Kyrgyz. We also show that transfer direction matters, and that the same transfer source-transfer target pair can behave differently when the translation target changes. Latinization improves BLEU and chrF in several script-mismatched settings, but its effect is not uniform across metrics. Additional analyses show that transfer sources are mostly stable across different datasets and model settings.

Computation and Language (cs.CL); Artificial Intelligence (cs.AI)

arXiv:2607.29355 [cs.CL]

(or arXiv:2607.29355v1 [cs.CL] for this version)

https://doi.org/10.48550/arXiv.2607.29355 Focus to learn more arXiv-issued DOI via DataCite (pending registration)

arXivLabs is a framework that allows collaborators to develop and share new arXiv features directly on our website.

Both individuals and organizations that work with arXivLabs have embraced and accepted our values of openness, community, excellence, and user data privacy. arXiv is committed to these values and only works with partners that adhere to them.

Have an idea for a project that will add value for arXiv's community? Learn more about arXivLabs.

Full text under the publisher's open licence · 232 words

Related coverage