Cross-Modal Alignment

Robust and Data-Efficient End-to-End Speech Translation: Segmentation, Cross-Modal Alignment, and Prosody-Aware Evaluation

My PhD thesis (Excellent, cum laude): robust segmentation, data augmentation, zero-shot cross-modal alignment, and prosody-aware evaluation for end-to-end speech translation.

Ioannis Tsiamas
•
Read more
Omnilingual SONAR: Cross-Lingual and Cross-Modal Sentence Embeddings Bridging Massively Multilingual Text and Speech featured image

Omnilingual SONAR: Cross-Lingual and Cross-Modal Sentence Embeddings Bridging Massively Multilingual Text and Speech

We introduce OmniSONAR, a family of omnilingual cross-lingual and cross-modal sentence embedding models spanning 4,000+ language varieties and natively supporting text, speech, …

The Omnilingual SONAR Team
•
Read more