HyperAIHyperAI

Command Palette

Search for a command to run...

5 months ago

Time Masking: Leveraging Temporal Information in Spoken Dialogue Systems

Rylan Conway; Lambert Mathias

Time Masking: Leveraging Temporal Information in Spoken Dialogue Systems

Abstract

In a spoken dialogue system, dialogue state tracker (DST) components track the state of the conversation by updating a distribution of values associated with each of the slots being tracked for the current user turn, using the interactions until then. Much of the previous work has relied on modeling the natural order of the conversation, using distance based offsets as an approximation of time. In this work, we hypothesize that leveraging the wall-clock temporal difference between turns is crucial for finer-grained control of dialogue scenarios. We develop a novel approach that applies a {\it time mask}, based on the wall-clock time difference, to the associated slot embeddings and empirically demonstrate that our proposed approach outperforms existing approaches that leverage distance offsets, on both an internal benchmark dataset as well as DSTC2.

Benchmarks

BenchmarkMethodologyMetrics
video-salient-object-detection-on-mclTIMP
AVERAGE MAE: 0.113
MAX E-MEASURE: 0.760
S-Measure: 0.642
video-salient-object-detection-on-segtrack-v2TIMP
AVERAGE MAE: 0.116
S-Measure: 0.644
max E-measure: 0.768

Build AI with AI

From idea to launch — accelerate your AI development with free AI co-coding, out-of-the-box environment and best price of GPUs.

AI Co-coding
Ready-to-use GPUs
Best Pricing
Get Started

Hyper Newsletters

Subscribe to our latest updates
We will deliver the latest updates of the week to your inbox at nine o'clock every Monday morning
Powered by MailChimp
Time Masking: Leveraging Temporal Information in Spoken Dialogue Systems | Papers | HyperAI