Command Palette
Search for a command to run...
Emanuele Bastianelli Andrea Vanzo Pawel Swietojanski Verena Rieser

Abstract
Spoken Language Understanding infers semantic meaning directly from audio data, and thus promises to reduce error propagation and misunderstandings in end-user applications. However, publicly available SLU resources are limited. In this paper, we release SLURP, a new SLU package containing the following: (1) A new challenging dataset in English spanning 18 domains, which is substantially bigger and linguistically more diverse than existing datasets; (2) Competitive baselines based on state-of-the-art NLU and ASR systems; (3) A new transparent metric for entity labelling which enables a detailed error analysis for identifying potential areas of improvement. SLURP is available at https: //github.com/pswietojanski/slurp.
Code Repositories
Benchmarks
| Benchmark | Methodology | Metrics |
|---|---|---|
| intent-classification-on-slurp | Multi-SLURP | Accuracy (%): 78.33 |
| slot-filling-on-slurp | Multi-SLURP | F1: 0.642 |
Build AI with AI
From idea to launch — accelerate your AI development with free AI co-coding, out-of-the-box environment and best price of GPUs.