HyperAIHyperAI

Command Palette

Search for a command to run...

4 months ago

End-to-End Open-Domain Question Answering with BERTserini

Wei Yang; Yuqing Xie; Aileen Lin; Xingyu Li; Luchen Tan; Kun Xiong; Ming Li; Jimmy Lin

End-to-End Open-Domain Question Answering with BERTserini

Abstract

We demonstrate an end-to-end question answering system that integrates BERT with the open-source Anserini information retrieval toolkit. In contrast to most question answering and reading comprehension models today, which operate over small amounts of input text, our system integrates best practices from IR with a BERT-based reader to identify answers from a large corpus of Wikipedia articles in an end-to-end fashion. We report large improvements over previous results on a standard benchmark test collection, showing that fine-tuning pretrained BERT with SQuAD is sufficient to achieve high accuracy in identifying answer spans.

Code Repositories

rsvp-ai/bertserini
Official
pytorch

Benchmarks

BenchmarkMethodologyMetrics
open-domain-question-answering-on-squad1-1BERTserini
EM: 38.6

Build AI with AI

From idea to launch — accelerate your AI development with free AI co-coding, out-of-the-box environment and best price of GPUs.

AI Co-coding
Ready-to-use GPUs
Best Pricing
Get Started

Hyper Newsletters

Subscribe to our latest updates
We will deliver the latest updates of the week to your inbox at nine o'clock every Monday morning
Powered by MailChimp
End-to-End Open-Domain Question Answering with BERTserini | Papers | HyperAI