HyperAIHyperAI

Command Palette

Search for a command to run...

3 months ago

Transfer Learning with Jukebox for Music Source Separation

W. Zai El Amri O. Tautz H. Ritter A. Melnik

Transfer Learning with Jukebox for Music Source Separation

Abstract

In this work, we demonstrate how a publicly available, pre-trained Jukebox model can be adapted for the problem of audio source separation from a single mixed audio channel. Our neural network architecture, which is using transfer learning, is quick to train and the results demonstrate performance comparable to other state-of-the-art approaches that require a lot more compute resources, training data, and time. We provide an open-source code implementation of our architecture (https://github.com/wzaielamri/unmix)

Code Repositories

wzaielamri/unmix
Official
pytorch
Mentioned in GitHub

Benchmarks

BenchmarkMethodologyMetrics
music-source-separation-on-musdb18-hqUnmix
SDR (avg): 4.188
SDR (bass): 4.073
SDR (drums): 4.925
SDR (others): 2.695
SDR (vocals): 5.06

Build AI with AI

From idea to launch — accelerate your AI development with free AI co-coding, out-of-the-box environment and best price of GPUs.

AI Co-coding
Ready-to-use GPUs
Best Pricing
Get Started

Hyper Newsletters

Subscribe to our latest updates
We will deliver the latest updates of the week to your inbox at nine o'clock every Monday morning
Powered by MailChimp
Transfer Learning with Jukebox for Music Source Separation | Papers | HyperAI