HyperAIHyperAI

Command Palette

Search for a command to run...

4 months ago

Deep Learning for Answer Sentence Selection

Lei Yu; Karl Moritz Hermann; Phil Blunsom; Stephen Pulman

Deep Learning for Answer Sentence Selection

Abstract

Answer sentence selection is the task of identifying sentences that contain the answer to a given question. This is an important problem in its own right as well as in the larger context of open domain question answering. We propose a novel approach to solving this task via means of distributed representations, and learn to match questions with answers by considering their semantic encoding. This contrasts prior work on this task, which typically relies on classifiers with large numbers of hand-crafted syntactic and semantic features and various external resources. Our approach does not require any feature engineering nor does it involve specialist linguistic data, making this model easily applicable to a wide range of domains and languages. Experimental results on a standard benchmark dataset from TREC demonstrate that---despite its simplicity---our model matches state of the art performance on the answer sentence selection task.

Code Repositories

brmson/dataset-sts
Mentioned in GitHub

Benchmarks

BenchmarkMethodologyMetrics
question-answering-on-qasentBigram-CNN
MAP: 0.5693
MRR: 0.6613
question-answering-on-qasentBigram-CNN (lexical overlap + dist output)
MAP: 0.7113
MRR: 0.7846
question-answering-on-trecqaCNN
MAP: 0.711
MRR: 0.785
question-answering-on-wikiqaBigram-CNN (lexical overlap + dist output)
MAP: 0.6520
MRR: 0.6652
question-answering-on-wikiqaBigram-CNN
MAP: 0.6190
MRR: 0.6281

Build AI with AI

From idea to launch — accelerate your AI development with free AI co-coding, out-of-the-box environment and best price of GPUs.

AI Co-coding
Ready-to-use GPUs
Best Pricing
Get Started

Hyper Newsletters

Subscribe to our latest updates
We will deliver the latest updates of the week to your inbox at nine o'clock every Monday morning
Powered by MailChimp
Deep Learning for Answer Sentence Selection | Papers | HyperAI