HyperAIHyperAI

Command Palette

Search for a command to run...

3 months ago

Speeding up Word Mover's Distance and its variants via properties of distances between embeddings

Matheus Werner Eduardo Laber

Speeding up Word Mover's Distance and its variants via properties of distances between embeddings

Abstract

The Word Mover's Distance (WMD) proposed by Kusner et al. is a distance between documents that takes advantage of semantic relations among words that are captured by their embeddings. This distance proved to be quite effective, obtaining state-of-art error rates for classification tasks, but is also impracticable for large collections/documents due to its computational complexity. For circumventing this problem, variants of WMD have been proposed. Among them, Relaxed Word Mover's Distance (RWMD) is one of the most successful due to its simplicity, effectiveness, and also because of its fast implementations. Relying on assumptions that are supported by empirical properties of the distances between embeddings, we propose an approach to speed up both WMD and RWMD. Experiments over 10 datasets suggest that our approach leads to a significant speed-up in document classification tasks while maintaining the same error rates.

Code Repositories

matwerner/fast-wmd
Official
Mentioned in GitHub

Benchmarks

BenchmarkMethodologyMetrics
document-classification-on-amazonREL-RWMD k-NN
Accuracy: 93.03
document-classification-on-bbcsportREL-RWMD k-NN
Accuracy: 95.18
document-classification-on-classicREL-RWMD k-NN
Accuracy: 96.85
document-classification-on-recipeREL-RWMD k-NN
Accuracy: 56.80
document-classification-on-reuters-21578REL-RWMD k-NN
Accuracy: 95.61
document-classification-on-twitterREL-RWMD k-NN
Accuracy: 71.05
text-classification-on-20newsREL-RWMD k-NN
Accuracy: 74.78
text-classification-on-ohsumedREL-RWMD k-NN
Accuracy: 58.74

Build AI with AI

From idea to launch — accelerate your AI development with free AI co-coding, out-of-the-box environment and best price of GPUs.

AI Co-coding
Ready-to-use GPUs
Best Pricing
Get Started

Hyper Newsletters

Subscribe to our latest updates
We will deliver the latest updates of the week to your inbox at nine o'clock every Monday morning
Powered by MailChimp
Speeding up Word Mover's Distance and its variants via properties of distances between embeddings | Papers | HyperAI