Benchmarking

BOUQuET: dataset, Benchmark and Open initiative for Universal Quality Evaluation in Translation featured image
Machine Translation

BOUQuET: dataset, Benchmark and Open initiative for Universal Quality Evaluation in Translation

We introduce BOUQuET, a multi-way, multicentric, multi-domain, paragraph-level dataset and benchmark for machine translation evaluation, designed for crowd-sourced expansion to …

Pierre Andrews
•
Read more
Speech Is More than Words: Do Speech-to-Text Translation Systems Leverage Prosody? featured image
Speech Translation

Speech Is More than Words: Do Speech-to-Text Translation Systems Leverage Prosody?

We investigate whether speech-to-text translation systems utilize prosody by introducing a new benchmark, ContraProSt. Our findings show that while models represent prosody …

Ioannis Tsiamas
•
Read more