aiqbench analysis
This study evaluates a LoRA-adapted NileChat-3B model for dialectal Arabic translation, revealing that external pretraining on large multilingual datasets often induces negative transfer rather than improving performance across diverse dialects. The findings highlight the challenges of scaling low-resource language models and underscore the need for targeted fine-tuning strategies over broad pretraining when handling specific linguistic contexts.
Rosetta at AlexandriaX-2026: LoRA-Adapted NileChat for Context-Aware Dialectal Arabic Dialogue Translation
arXiv:2609.10395v1 Announce Type: new Abstract: This paper describes the Rosetta system for Subtask 1 (Context-Aware English-to-Dialectal Arabic Dialogue Translation) of the AlexandriaX shared task, participating in both constrained and unconstrained tracks. The approach fine-tunes a LoRA adapter on NileChat-3B using structured system/user prompts that condition generation on dialect and dialogue context. For the unconstrained track, the adapter is additionally pretrained on MADAR and PADIC. Rosetta ranked 4th in the constrained track (spBLEU 26.10) and 5th in the unconstrained track (spBLEU 25.09). The experimental results demonstrate that external pretraining helps only two of thirteen dialects while slightly hurting overall performance, suggesting negative transfer.
Abstract:This paper describes the Rosetta system for Subtask 1 (Context-Aware English-to-Dialectal Arabic Dialogue Translation) of the AlexandriaX shared task, participating in both constrained and unconstrained tracks. The approach fine-tunes a LoRA adapter on NileChat-3B using structured system/user prompts that condition generation on dialect and dialogue context. For the unconstrained track, the adapter is additionally pretrained on MADAR and PADIC. Rosetta ranked 4th in the constrained track (spBLEU 26.10) and 5th in the unconstrained track (spBLEU 25.09). The experimental results demonstrate that external pretraining helps only two of thirteen dialects while slightly hurting overall performance, suggesting negative transfer.
Computation and Language (cs.CL)
arXiv:2609.10395 [cs.CL]
(or arXiv:2609.10395v1 [cs.CL] for this version)
https://doi.org/10.48550/arXiv.2609.10395 Focus to learn more arXiv-issued DOI via DataCite (pending registration)
arXivLabs is a framework that allows collaborators to develop and share new arXiv features directly on our website.
Both individuals and organizations that work with arXivLabs have embraced and accepted our values of openness, community, excellence, and user data privacy. arXiv is committed to these values and only works with partners that adhere to them.
Have an idea for a project that will add value for arXiv's community? Learn more about arXivLabs.
Full text under the publisher's open licence · 192 words
Related coverage

Reflections on unlearning and inoculation
LessWrong · Sep 20, 2026
[AINews] High Taste Testers Ep. 1
Latent Space · Oct 17, 2026

Evaluating task vectors, unlearning and inoculation
LessWrong · Sep 20, 2026
What's Continual Learning, and Why Might We Expect To See It In Advanced LLM Agents?
LessWrong · Jun 12, 2026