HyperAIHyperAI

Command Palette

Search for a command to run...

3 months ago

NeurST: Neural Speech Translation Toolkit

Chengqi Zhao Mingxuan Wang Qianqian Dong Rong Ye Lei Li

NeurST: Neural Speech Translation Toolkit

Abstract

NeurST is an open-source toolkit for neural speech translation. The toolkit mainly focuses on end-to-end speech translation, which is easy to use, modify, and extend to advanced speech translation research and products. NeurST aims at facilitating the speech translation research for NLP researchers and building reliable benchmarks for this field. It provides step-by-step recipes for feature extraction, data preprocessing, distributed training, and evaluation. In this paper, we will introduce the framework design of NeurST and show experimental results for different benchmark datasets, which can be regarded as reliable baselines for future research. The toolkit is publicly available at https://github.com/bytedance/neurst/ and we will continuously update the performance of NeurST with other counterparts and studies at https://st-benchmark.github.io/.

Code Repositories

Benchmarks

BenchmarkMethodologyMetrics
speech-to-text-translation-on-libri-transTransformer + ASR Pretrain + SpecAug
Case-insensitive sacreBLEU: 17.2
Case-insensitive tokenized BLEU: 18.7
Case-sensitive sacreBLEU: 16.3
Case-sensitive tokenized BLEU: 17.8
speech-to-text-translation-on-libri-transTransformer + ASR Pretrain
Case-insensitive sacreBLEU: 16.5
Case-insensitive tokenized BLEU: 17.9
Case-sensitive sacreBLEU: 15.5
Case-sensitive tokenized BLEU: 16.9
speech-to-text-translation-on-must-c-en-deTransformer + ASR Pretrain
Case-sensitive sacreBLEU: 22.8
speech-to-text-translation-on-must-c-en-esTransformer + ASR Pretrain + SpecAug
Case-sensitive sacreBLEU: 27.4
speech-to-text-translation-on-must-c-en-esTransformer + ASR Pretrain
Case-sensitive sacreBLEU: 26.8
speech-to-text-translation-on-must-c-en-frTransformer + ASR Pretrain
Case-sensitive sacreBLEU: 32.3
speech-to-text-translation-on-must-c-en-frTransformer + ASR Pretrain + SpecAug
Case-sensitive sacreBLEU: 33.3

Build AI with AI

From idea to launch — accelerate your AI development with free AI co-coding, out-of-the-box environment and best price of GPUs.

AI Co-coding
Ready-to-use GPUs
Best Pricing
Get Started

Hyper Newsletters

Subscribe to our latest updates
We will deliver the latest updates of the week to your inbox at nine o'clock every Monday morning
Powered by MailChimp
NeurST: Neural Speech Translation Toolkit | Papers | HyperAI