HyperAIHyperAI

Command Palette

Search for a command to run...

Self-Attention for Audio Super-Resolution

Nathanaël Carraz Rakotonirina

Abstract

Convolutions operate only locally, thus failing to model global interactions.Self-attention is, however, able to learn representations that capturelong-range dependencies in sequences. We propose a network architecture foraudio super-resolution that combines convolution and self-attention.Attention-based Feature-Wise Linear Modulation (AFiLM) uses self-attentionmechanism instead of recurrent neural networks to modulate the activations ofthe convolutional model. Extensive experiments show that our model outperformsexisting approaches on standard benchmarks. Moreover, it allows for moreparallelization resulting in significantly faster training.


Build AI with AI

From idea to launch — accelerate your AI development with free AI co-coding, out-of-the-box environment and best price of GPUs.

AI Co-coding
Ready-to-use GPUs
Best Pricing

HyperAI Newsletters

Subscribe to our latest updates
We will deliver the latest updates of the week to your inbox at nine o'clock every Monday morning
Powered by MailChimp