analiza aiqbench
This paper presents a significant contribution to low-resource machine translation by establishing an open corpus and models for Nheengatu, addressing critical gaps in legal and spontaneous speech domains. The study highlights specific technical challenges, such as the plateauing of model performance on legal terminology regardless of scale and the distinct register gap between written constitutional text and spoken conversation. These findings offer valuable insights into the limitations of current large language models when applied to endangered languages with limited parallel data.
The Constitution Speaks Nheengatu: An Open MT System and Reproducible Corpus Pipeline for the Amazonian L\'ingua Geral
arXiv:2610.14760v1 Announce Type: new Abstract: Nheengatu (yrl), the Amazonian L\'ingua Geral, has 6--10 thousand speakers and is co-official in S\~ao Gabriel da Cachoeira (Brazil), yet remains poorly served by evaluated Portuguese--Nheengatu MT resources. We present the largest parallel corpus assembled for the language (14.5k Portuguese--Nheengatu pairs), anchored by the 2023 official translation of the Brazilian Federal Constitution; the first MT evaluation set built from transcribed spontaneous speech; and, to our knowledge, the first open-weight MT models dedicated to bidirectional Portuguese--Nheengatu translation. Three findings organize the paper. First, translation into Nheengatu on held-out constitutional articles plateaus on development data regardless of training length or model size, and much of the remaining error sits in conventional legal terms that the written sources do not attest consistently; a terminology success rate over a frozen lexicon shows that glossary mechanisms at training time and lexical constraints at decoding each raise term realization, the latter at a cost in repetitive output that chrF++ barely registers. Second, a corpus expansion that adds transcribed conversation raises speech chrF++ by 24--27 points while leaving written domains unchanged, a register gap that written-only benchmarks cannot see. Third, a larger NLLB model helps translation into Portuguese but not into Nheengatu on legal or speech text. For Portuguese-to-Nheengatu translation, our final systems reach 31.7--32.8 chrF++ on article-disjoint constitutional text, 64.1--64.5 on the near-domain set (62.1 after removing items with target-side content overlap), and 45.2--47.5 on speech.
Abstract:Nheengatu (yrl), the Amazonian Língua Geral, has 6--10 thousand speakers and is co-official in São Gabriel da Cachoeira (Brazil), yet remains poorly served by evaluated Portuguese--Nheengatu MT resources. We present the largest parallel corpus assembled for the language (14.5k Portuguese--Nheengatu pairs), anchored by the 2023 official translation of the Brazilian Federal Constitution; the first MT evaluation set built from transcribed spontaneous speech; and, to our knowledge, the first open-weight MT models dedicated to bidirectional Portuguese--Nheengatu translation. Three findings organize the paper. First, translation into Nheengatu on held-out constitutional articles plateaus on development data regardless of training length or model size, and much of the remaining error sits in conventional legal terms that the written sources do not attest consistently; a terminology success rate over a frozen lexicon shows that glossary mechanisms at training time and lexical constraints at decoding each raise term realization, the latter at a cost in repetitive output that chrF++ barely registers. Second, a corpus expansion that adds transcribed conversation raises speech chrF++ by 24--27 points while leaving written domains unchanged, a register gap that written-only benchmarks cannot see. Third, a larger NLLB model helps translation into Portuguese but not into Nheengatu on legal or speech text. For Portuguese-to-Nheengatu translation, our final systems reach 31.7--32.8 chrF++ on article-disjoint constitutional text, 64.1--64.5 on the near-domain set (62.1 after removing items with target-side content overlap), and 45.2--47.5 on speech.
17 pages, 2 figures. Published in WMT 2026
Computation and Language (cs.CL)
arXiv:2610.14760 [cs.CL]
(or arXiv:2610.14760v1 [cs.CL] for this version)
https://doi.org/10.48550/arXiv.2610.14760 Focus to learn more arXiv-issued DOI via DataCite (pending registration)
Proceedings of the Eleventh Conference on Machine Translation (WMT), pp. 47-63, 2026
arXivLabs is a framework that allows collaborators to develop and share new arXiv features directly on our website.
Both individuals and organizations that work with arXivLabs have embraced and accepted our values of openness, community, excellence, and user data privacy. arXiv is committed to these values and only works with partners that adhere to them.
Have an idea for a project that will add value for arXiv's community? Learn more about arXivLabs.
Text integral sub licența deschisă a publicației · 345 cuvinte
Subiecte conexe
Artmarket.com: H1 2026 Financial Report -- One-of-a - Kind AI Systems Intuitive Artmarket® and Blind Spot Will Drive the Next Phase of Growth for AI - First Artprice in 2026 - 2030
thailand-business-news.com · 28 sept. 2026

Artmarket.com: H1 2026 Financial Report -- One-of-a - Kind AI Systems Intuitive Artmarket and Blind Spot Will Drive the Next Phase of Growth for
australiannews.net · 29 sept. 2026
The Open ASR Leaderboard Adds Its First Global South Language
Hugging Face · 28 aug. 2026
The Continual Constitutional Convention: How language models revise the documents that govern them
AI Alignment Forum · 13 oct. 2026