HyperAIHyperAI

Command Palette

Search for a command to run...

3 months ago

End-to-End Offline Speech Translation System for IWSLT 2020 using Modality Agnostic Meta-Learning

{Sangha Kim Sathish Reddy Indurthi Mohd Abbas Zaidi Nikhil Kumar Lakumarapu Hou Jeung Han Beomseok Lee}

End-to-End Offline Speech Translation System for IWSLT 2020 using Modality Agnostic Meta-Learning

Abstract

In this paper, we describe the system submitted to the IWSLT 2020 Offline Speech Translation Task. We adopt the Transformer architecture coupled with the meta-learning approach to build our end-to-end Speech-to-Text Translation (ST) system. Our meta-learning approach tackles the data scarcity of the ST task by leveraging the data available from Automatic Speech Recognition (ASR) and Machine Translation (MT) tasks. The meta-learning approach combined with synthetic data augmentation techniques improves the model performance significantly and achieves BLEU scores of 24.58, 27.51, and 27.61 on IWSLT test 2015, MuST-C test, and Europarl-ST test sets respectively.

Benchmarks

BenchmarkMethodologyMetrics
speech-to-text-translation-on-must-c-en-deTransformer + Meta Learning(ASR/MT) + Data Augmentation
Case-sensitive sacreBLEU: 27.51

Build AI with AI

From idea to launch — accelerate your AI development with free AI co-coding, out-of-the-box environment and best price of GPUs.

AI Co-coding
Ready-to-use GPUs
Best Pricing
Get Started

Hyper Newsletters

Subscribe to our latest updates
We will deliver the latest updates of the week to your inbox at nine o'clock every Monday morning
Powered by MailChimp
End-to-End Offline Speech Translation System for IWSLT 2020 using Modality Agnostic Meta-Learning | Papers | HyperAI