HyperAIHyperAI

Command Palette

Search for a command to run...

3 months ago

Open-Unmix - A Reference Implementation for Music Source Separation

{and YukiMitsufuji Fabian-Robert Stöter Stefan Uhlich Antoine Liutkus}

Open-Unmix - A Reference Implementation for Music Source Separation

Abstract

Music source separation is the task of decomposing music into its constitutive components,e.g., yielding separated stems for the vocals, bass, and drums. Such a separation has manyapplications ranging from rearranging/repurposing the stems (remixing, repanning, upmixing)to full extraction (karaoke, sample creation, audio restoration). Music separation has a longhistory of scientific activity as it is known to be a very challenging problem. In recent years,deep learning-based systems - for the first time - yielded high-quality separations that alsolead to increased commercial interest. However, until now, no open-source implementationthat achieves state-of-the-art results is available.Open-Unmixcloses this gap by providinga reference implementation based on deep neural networks. It serves two main purposes.Firstly, to accelerate academic research asOpen-Unmixprovides implementations for themost popular deep learning frameworks, giving researchers a flexible way to reproduce results.Secondly, we provide a pre-trained model for end users and even artists to try and use sourceseparation. Furthermore, we designedOpen-Unmixto be one core component in an openecosystem on music separation, where we already provide open datasets, software utilities,and open evaluation to foster reproducible research as the basis of future development.

Benchmarks

BenchmarkMethodologyMetrics
music-source-separation-on-musdb18UMXL
SDR (avg): 6.316
SDR (bass): 6.015
SDR (drums): 7.148
SDR (other): 4.889
SDR (vocals): 7.213
music-source-separation-on-musdb18UMX
SDR (avg): 5.33
SDR (bass): 5.23
SDR (drums): 5.73
SDR (other): 4.02
SDR (vocals): 6.32

Build AI with AI

From idea to launch — accelerate your AI development with free AI co-coding, out-of-the-box environment and best price of GPUs.

AI Co-coding
Ready-to-use GPUs
Best Pricing
Get Started

Hyper Newsletters

Subscribe to our latest updates
We will deliver the latest updates of the week to your inbox at nine o'clock every Monday morning
Powered by MailChimp