HyperAIHyperAI

Command Palette

Search for a command to run...

3 months ago

Glow-TTS: A Generative Flow for Text-to-Speech via Monotonic Alignment Search

Jaehyeon Kim Sungwon Kim Jungil Kong Sungroh Yoon

Glow-TTS: A Generative Flow for Text-to-Speech via Monotonic Alignment Search

Abstract

Recently, text-to-speech (TTS) models such as FastSpeech and ParaNet have been proposed to generate mel-spectrograms from text in parallel. Despite the advantage, the parallel TTS models cannot be trained without guidance from autoregressive TTS models as their external aligners. In this work, we propose Glow-TTS, a flow-based generative model for parallel TTS that does not require any external aligner. By combining the properties of flows and dynamic programming, the proposed model searches for the most probable monotonic alignment between text and the latent representation of speech on its own. We demonstrate that enforcing hard monotonic alignments enables robust TTS, which generalizes to long utterances, and employing generative flows enables fast, diverse, and controllable speech synthesis. Glow-TTS obtains an order-of-magnitude speed-up over the autoregressive model, Tacotron 2, at synthesis with comparable speech quality. We further show that our model can be easily extended to a multi-speaker setting.

Code Repositories

ankurdhuriya/multispeaker-glow-tts
pytorch
Mentioned in GitHub
supertone-inc/super-monotonic-align
pytorch
Mentioned in GitHub
revsic/tf-glow-tts
tf
Mentioned in GitHub
coqui-ai/TTS
pytorch
Mentioned in GitHub
jaywalnut310/glow-tts
Official
pytorch
Mentioned in GitHub

Benchmarks

BenchmarkMethodologyMetrics
text-to-speech-synthesis-on-ljspeechGlow-TTS + HiFiGAN
Audio Quality MOS: 4.34

Build AI with AI

From idea to launch — accelerate your AI development with free AI co-coding, out-of-the-box environment and best price of GPUs.

AI Co-coding
Ready-to-use GPUs
Best Pricing
Get Started

Hyper Newsletters

Subscribe to our latest updates
We will deliver the latest updates of the week to your inbox at nine o'clock every Monday morning
Powered by MailChimp
Glow-TTS: A Generative Flow for Text-to-Speech via Monotonic Alignment Search | Papers | HyperAI