Evaluation

Omnilingual MT: Machine Translation for 1,600 Languages featured image

Omnilingual MT: Machine Translation for 1,600 Languages

Outstanding Paper Award at EMNLP 2026. We present Omnilingual MT, the first MT system benchmarked on more than 1,600 languages, where 1B–8B parameter specialized models match or …

Belen Alastruey
•
Read more
BOUQuET: dataset, Benchmark and Open initiative for Universal Quality Evaluation in Translation featured image

BOUQuET: dataset, Benchmark and Open initiative for Universal Quality Evaluation in Translation

We introduce BOUQuET, a multi-way, multicentric, multi-domain, paragraph-level dataset and benchmark for machine translation evaluation, designed for crowd-sourced expansion to …

Pierre Andrews
•
Read more
Speech Is More than Words: Do Speech-to-Text Translation Systems Leverage Prosody? featured image

Speech Is More than Words: Do Speech-to-Text Translation Systems Leverage Prosody?

We investigate whether speech-to-text translation systems utilize prosody by introducing a new benchmark, ContraProSt. Our findings show that while models represent prosody …

Ioannis Tsiamas
•
Read more