Command Palette
Search for a command to run...
Sequential Matching Network: A New Architecture for Multi-turn Response Selection in Retrieval-based Chatbots
Yu Wu; Wei Wu; Chen Xing; Ming Zhou; Zhoujun Li

Abstract
We study response selection for multi-turn conversation in retrieval-based chatbots. Existing work either concatenates utterances in context or matches a response with a highly abstract context vector finally, which may lose relationships among utterances or important contextual information. We propose a sequential matching network (SMN) to address both problems. SMN first matches a response with each utterance in the context on multiple levels of granularity, and distills important matching information from each pair as a vector with convolution and pooling operations. The vectors are then accumulated in a chronological order through a recurrent neural network (RNN) which models relationships among utterances. The final matching score is calculated with the hidden states of the RNN. An empirical study on two public data sets shows that SMN can significantly outperform state-of-the-art methods for response selection in multi-turn conversation.
Code Repositories
Benchmarks
| Benchmark | Methodology | Metrics |
|---|---|---|
| conversational-response-selection-on-douban-1 | SMN | MAP: 0.529 MRR: 0.569 P@1: 0.397 R10@1: 0.233 R10@2: 0.396 R10@5: 0.724 |
| conversational-response-selection-on-e | SMN | R10@1: 0.453 R10@2: 0.654 R10@5: 0.886 |
| conversational-response-selection-on-rrs | SMN | MAP: 0.487 MRR: 0.501 P@1: 0.309 R10@1: 0.281 R10@2: 0.442 R10@5: 0.723 |
| conversational-response-selection-on-ubuntu-1 | SMN | R10@1: 0.726 R10@2: 0.822 R10@5: 0.960 R2@1: 0.926 |
Build AI with AI
From idea to launch — accelerate your AI development with free AI co-coding, out-of-the-box environment and best price of GPUs.