HyperAIHyperAI

Command Palette

Search for a command to run...

5 months ago

A Slot Is Not Built in One Utterance: Spoken Language Dialogs with Sub-Slots

Sai Zhang; Yuwei Hu; Yuchuan Wu; Jiaman Wu; Yongbin Li; Jian Sun; Caixia Yuan; Xiaojie Wang

A Slot Is Not Built in One Utterance: Spoken Language Dialogs with Sub-Slots

Abstract

A slot value might be provided segment by segment over multiple-turn interactions in a dialog, especially for some important information such as phone numbers and names. It is a common phenomenon in daily life, but little attention has been paid to it in previous work. To fill the gap, this paper defines a new task named Sub-Slot based Task-Oriented Dialog (SSTOD) and builds a Chinese dialog dataset SSD for boosting research on SSTOD. The dataset includes a total of 40K dialogs and 500K utterances from four different domains: Chinese names, phone numbers, ID numbers and license plate numbers. The data is well annotated with sub-slot values, slot values, dialog states and actions. We find some new linguistic phenomena and interactive manners in SSTOD which raise critical challenges of building dialog agents for the task. We test three state-of-the-art dialog models on SSTOD and find they cannot handle the task well on any of the four domains. We also investigate an improved model by involving slot knowledge in a plug-in manner. More work should be done to meet the new challenges raised from SSTOD which widely exists in real-life applications. The dataset and code are publicly available via https://github.com/shunjiu/SSTOD.

Code Repositories

shunjiu/sstod
Official
pytorch
Mentioned in GitHub

Benchmarks

BenchmarkMethodologyMetrics
sstod-on-automataUBAR+
Dialogue Success Rate: 45.8
sstod-on-ssd-nameUBAR+
Dialogue Success Rate: 57.73
Joint Acc: 84.96
Slot Acc: 93.12

Build AI with AI

From idea to launch — accelerate your AI development with free AI co-coding, out-of-the-box environment and best price of GPUs.

AI Co-coding
Ready-to-use GPUs
Best Pricing
Get Started

Hyper Newsletters

Subscribe to our latest updates
We will deliver the latest updates of the week to your inbox at nine o'clock every Monday morning
Powered by MailChimp
A Slot Is Not Built in One Utterance: Spoken Language Dialogs with Sub-Slots | Papers | HyperAI