HyperAIHyperAI

Command Palette

Search for a command to run...

3 months ago

Automatic speaker verification spoofing and deepfake detection using wav2vec 2.0 and data augmentation

Hemlata Tak Massimiliano Todisco Xin Wang Jee-weon Jung Junichi Yamagishi Nicholas Evans

Automatic speaker verification spoofing and deepfake detection using wav2vec 2.0 and data augmentation

Abstract

The performance of spoofing countermeasure systems depends fundamentally upon the use of sufficiently representative training data. With this usually being limited, current solutions typically lack generalisation to attacks encountered in the wild. Strategies to improve reliability in the face of uncontrolled, unpredictable attacks are hence needed. We report in this paper our efforts to use self-supervised learning in the form of a wav2vec 2.0 front-end with fine tuning. Despite initial base representations being learned using only bona fide data and no spoofed data, we obtain the lowest equal error rates reported in the literature for both the ASVspoof 2021 Logical Access and Deepfake databases. When combined with data augmentation,these results correspond to an improvement of almost 90% relative to our baseline system.

Code Repositories

Ashigarg123/ShiftySpeech
pytorch
Mentioned in GitHub
liu-tianchi/nes2net
pytorch
Mentioned in GitHub
takhemlata/ssl_anti-spoofing
pytorch
Mentioned in GitHub

Benchmarks

BenchmarkMethodologyMetrics
audio-deepfake-detection-on-asvspoof-2021XLSR+AASIST
21DF EER: 3.69
21LA EER: 1.0

Build AI with AI

From idea to launch — accelerate your AI development with free AI co-coding, out-of-the-box environment and best price of GPUs.

AI Co-coding
Ready-to-use GPUs
Best Pricing
Get Started

Hyper Newsletters

Subscribe to our latest updates
We will deliver the latest updates of the week to your inbox at nine o'clock every Monday morning
Powered by MailChimp
Automatic speaker verification spoofing and deepfake detection using wav2vec 2.0 and data augmentation | Papers | HyperAI