HyperAIHyperAI

Command Palette

Search for a command to run...

3 months ago

SPLADE-v3: New baselines for SPLADE

Carlos Lassance Hervé Déjean Thibault Formal Stéphane Clinchant

SPLADE-v3: New baselines for SPLADE

Abstract

A companion to the release of the latest version of the SPLADE library. We describe changes to the training structure and present our latest series of models -- SPLADE-v3. We compare this new version to BM25, SPLADE++, as well as re-rankers, and showcase its effectiveness via a meta-analysis over more than 40 query sets. SPLADE-v3 further pushes the limit of SPLADE models: it is statistically significantly more effective than both BM25 and SPLADE++, while comparing well to cross-encoder re-rankers. Specifically, it gets more than 40 MRR@10 on the MS MARCO dev set, and improves by 2% the out-of-domain results on the BEIR benchmark.

Code Repositories

Benchmarks

BenchmarkMethodologyMetrics
passage-retrieval-on-peerqaSPLADEv3
MRR: 0.4536
Recall@10: 0.6851

Build AI with AI

From idea to launch — accelerate your AI development with free AI co-coding, out-of-the-box environment and best price of GPUs.

AI Co-coding
Ready-to-use GPUs
Best Pricing
Get Started

Hyper Newsletters

Subscribe to our latest updates
We will deliver the latest updates of the week to your inbox at nine o'clock every Monday morning
Powered by MailChimp
SPLADE-v3: New baselines for SPLADE | Papers | HyperAI