HyperAIHyperAI

Command Palette

Search for a command to run...

3 months ago

BigVSAN: Enhancing GAN-based Neural Vocoders with Slicing Adversarial Network

Takashi Shibuya Yuhta Takida Yuki Mitsufuji

BigVSAN: Enhancing GAN-based Neural Vocoders with Slicing Adversarial Network

Abstract

Generative adversarial network (GAN)-based vocoders have been intensively studied because they can synthesize high-fidelity audio waveforms faster than real-time. However, it has been reported that most GANs fail to obtain the optimal projection for discriminating between real and fake data in the feature space. In the literature, it has been demonstrated that slicing adversarial network (SAN), an improved GAN training framework that can find the optimal projection, is effective in the image generation task. In this paper, we investigate the effectiveness of SAN in the vocoding task. For this purpose, we propose a scheme to modify least-squares GAN, which most GAN-based vocoders adopt, so that their loss functions satisfy the requirements of SAN. Through our experiments, we demonstrate that SAN can improve the performance of GAN-based vocoders, including BigVGAN, with small modifications. Our code is available at https://github.com/sony/bigvsan.

Code Repositories

sony/bigvsan
Official
pytorch
Mentioned in GitHub
sony/bigvsan_eval
Official
pytorch
Mentioned in GitHub

Benchmarks

BenchmarkMethodologyMetrics
speech-synthesis-on-librittsBigVSAN
M-STFT: 0.7881
MCD: 0.3381
PESQ: 4.116
Periodicity: 0.0935
V/UV F1: 0.9635
speech-synthesis-on-librittsBigVSAN (w/ snakebeta)
M-STFT: 0.7992
MCD: 0.4129
PESQ: 4.120
Periodicity: 0.0924
V/UV F1: 0.9644

Build AI with AI

From idea to launch — accelerate your AI development with free AI co-coding, out-of-the-box environment and best price of GPUs.

AI Co-coding
Ready-to-use GPUs
Best Pricing
Get Started

Hyper Newsletters

Subscribe to our latest updates
We will deliver the latest updates of the week to your inbox at nine o'clock every Monday morning
Powered by MailChimp
BigVSAN: Enhancing GAN-based Neural Vocoders with Slicing Adversarial Network | Papers | HyperAI