Omnilingual MT: Machine Translation for 1,600 Languages
Oct 27, 2026·
,,,,,,,,,,,,,,,,,,,,,,·
0 min read
Belen Alastruey
Core contributor
,Niyati Bafna
Core contributor
,Andrea Caciolai
Core contributor
,Kevin Heffernan
Core contributor
,Artyom Kozhevnikov
Core contributor
,Christophe Ropers
Core contributor
,Eduardo Sánchez
Core contributor
,Charles-Éric Saint-James
Core contributor
,Ioannis Tsiamas
Core contributor
,Xiang Tony Cao
Chierh Cheng
Joe Chuang
Paul-Ambroise Duquenne
Mark Duppenthaler
Cynthia Gao
Pere-Lluís Huguet Cabot
João Maria Janeiro
Jean Maillard
Gabriel Eduardo Mejia-Gonzalez
Holger Schwenk
Edan Toledo
Arina Turkatenko
Albert Ventayol-Boada
Ravi Arikapudi
Nathanial Paul Ekberg
Rashel Moritz
Alexandre Mourachko
Surya Parimi
Mary Williamson
Shireen Yates
David Dale
Marta R. Costa-Jussà

Abstract
We introduce Omnilingual MT, a family of multilingual translation (MT) systems covering more than 1,600 languages—the broadest benchmarked coverage of any MT system to date. We make contributions in several key research questions in the field: strategies for the use of monolingual data, curating seed training data, tokenization and suitable architectures, the competitiveness of small specialized MT models as opposed to general purpose large models, and evaluation protocols. Our data strategy combines large-scale multilingual corpora with backtranslation for 2,000+ languages and MeDLEy, a grammatically-diverse seed dataset for 109 low-resource languages. We explore two complementary architectures: OMT-LLAMA, a decoder-only model (1B/3B/8B) built on LLAMA3 with multilingual continual pretraining, and OMT-NLLB, a 3B encoder-decoder model with a novel three-stage training strategy exploiting non-parallel data via autoencoding. For evaluation, we extend the BOUQuET benchmark to 275 languages, develop Met-BOUQuET with human annotations of machine quality in 161 directions, and BLASER 3, a reference-free quality estimation metric. Our specialized 1B–8B models match or exceed 70B general-purpose LLMs, demonstrating that specialization is a more reliable path to multilingual translation than scale alone. Omnilingual MT achieves “passable” translation quality as judged by human annotators for over 440 languages, doubling it over the previous state of the field at ∼200 languages, and translates in zero-shot mode into ∼1,200 languages versus 300–400 for the baselines. With Omnilingual MT, we showcase a path encompassing the full pipeline of data and system development towards designing models that are multilingual from the onset.
Type
Publication
In Proceedings of the 2026 Conference on Empirical Methods in Natural Language Processing (🏆 Outstanding Paper Award)