HyperAIHyperAI

Command Palette

Search for a command to run...

3 months ago

SLURP: A Spoken Language Understanding Resource Package

Emanuele Bastianelli Andrea Vanzo Pawel Swietojanski Verena Rieser

SLURP: A Spoken Language Understanding Resource Package

Abstract

Spoken Language Understanding infers semantic meaning directly from audio data, and thus promises to reduce error propagation and misunderstandings in end-user applications. However, publicly available SLU resources are limited. In this paper, we release SLURP, a new SLU package containing the following: (1) A new challenging dataset in English spanning 18 domains, which is substantially bigger and linguistically more diverse than existing datasets; (2) Competitive baselines based on state-of-the-art NLU and ASR systems; (3) A new transparent metric for entity labelling which enables a detailed error analysis for identifying potential areas of improvement. SLURP is available at https: //github.com/pswietojanski/slurp.

Code Repositories

Benchmarks

BenchmarkMethodologyMetrics
intent-classification-on-slurpMulti-SLURP
Accuracy (%): 78.33
slot-filling-on-slurpMulti-SLURP
F1: 0.642

Build AI with AI

From idea to launch — accelerate your AI development with free AI co-coding, out-of-the-box environment and best price of GPUs.

AI Co-coding
Ready-to-use GPUs
Best Pricing
Get Started

Hyper Newsletters

Subscribe to our latest updates
We will deliver the latest updates of the week to your inbox at nine o'clock every Monday morning
Powered by MailChimp
SLURP: A Spoken Language Understanding Resource Package | Papers | HyperAI