HyperAIHyperAI

Command Palette

Search for a command to run...

5 months ago

aTENNuate: Optimized Real-time Speech Enhancement with Deep SSMs on Raw Audio

Pei Yan Ru ; Shrivastava Ritik ; Sidharth FNU

aTENNuate: Optimized Real-time Speech Enhancement with Deep SSMs on Raw
  Audio

Abstract

We present aTENNuate, a simple deep state-space autoencoder configured forefficient online raw speech enhancement in an end-to-end fashion. The network'sperformance is primarily evaluated on raw speech denoising, with additionalassessments on tasks such as super-resolution and de-quantization. We benchmarkaTENNuate on the VoiceBank + DEMAND and the Microsoft DNS1 synthetic test sets.The network outperforms previous real-time denoising models in terms of PESQscore, parameter count, MACs, and latency. Even as a raw waveform processingmodel, the model maintains high fidelity to the clean signal with minimalaudible artifacts. In addition, the model remains performant even when thenoisy input is compressed down to 4000Hz and 4 bits, suggesting general speechenhancement capabilities in low-resource environments. Try it out by pipinstall attenuate

Benchmarks

BenchmarkMethodologyMetrics
speech-enhancement-on-deep-noise-suppressionaTENNuate
PESQ-WB: 2.98
speech-enhancement-on-demandaTENNuate
CBAK: 2.85
COVL: 3.96
CSIG: 4.57
PESQ (wb): 3.27
SI-SDR: 15.04

Build AI with AI

From idea to launch — accelerate your AI development with free AI co-coding, out-of-the-box environment and best price of GPUs.

AI Co-coding
Ready-to-use GPUs
Best Pricing
Get Started

Hyper Newsletters

Subscribe to our latest updates
We will deliver the latest updates of the week to your inbox at nine o'clock every Monday morning
Powered by MailChimp
aTENNuate: Optimized Real-time Speech Enhancement with Deep SSMs on Raw Audio | Papers | HyperAI