HyperAIHyperAI

Command Palette

Search for a command to run...

5 months ago

CoverHunter: Cover Song Identification with Refined Attention and Alignments

Feng Liu; Deyi Tuo; Yinan Xu; Xintong Han

CoverHunter: Cover Song Identification with Refined Attention and Alignments

Abstract

Abstract: Cover song identification (CSI) focuses on finding the same music with different versions in reference anchors given a query track. In this paper, we propose a novel system named CoverHunter that overcomes the shortcomings of existing detection schemes by exploring richer features with refined attention and alignments. CoverHunter contains three key modules: 1) A convolution-augmented transformer (i.e., Conformer) structure that captures both local and global feature interactions in contrast to previous methods mainly relying on convolutional neural networks; 2) An attention-based time pooling module that further exploits the attention in the time dimension; 3) A novel coarse-to-fine training scheme that first trains a network to roughly align the song chunks and then refines the network by training on the aligned chunks. At the same time, we also summarize some important training tricks used in our system that help achieve better results. Experiments on several standard CSI datasets show that our method significantly improves over state-of-the-art methods with an embedding size of 128 (2.3% on SHS100K-TEST and 17.7% on DaTacos).

Code Repositories

Liu-Feng-deeplearning/CoverHunter
Official
pytorch
Mentioned in GitHub

Benchmarks

BenchmarkMethodologyMetrics
cover-song-identification-on-shs100k-testCoverHunter-128
mAP: 0.858
cover-song-identification-on-shs100k-testCoverHunter-256
mAP: 0.875

Build AI with AI

From idea to launch — accelerate your AI development with free AI co-coding, out-of-the-box environment and best price of GPUs.

AI Co-coding
Ready-to-use GPUs
Best Pricing
Get Started

Hyper Newsletters

Subscribe to our latest updates
We will deliver the latest updates of the week to your inbox at nine o'clock every Monday morning
Powered by MailChimp
CoverHunter: Cover Song Identification with Refined Attention and Alignments | Papers | HyperAI