Command Palette
Search for a command to run...
UniK-QA: Unified Representations of Structured and Unstructured Knowledge for Open-Domain Question Answering
Barlas Oguz Xilun Chen Vladimir Karpukhin Stan Peshterliev Dmytro Okhonko Michael Schlichtkrull Sonal Gupta Yashar Mehdad Scott Yih

Abstract
We study open-domain question answering with structured, unstructured and semi-structured knowledge sources, including text, tables, lists and knowledge bases. Departing from prior work, we propose a unifying approach that homogenizes all sources by reducing them to text and applies the retriever-reader model which has so far been limited to text sources only. Our approach greatly improves the results on knowledge-base QA tasks by 11 points, compared to latest graph-based methods. More importantly, we demonstrate that our unified knowledge (UniK-QA) model is a simple and yet effective way to combine heterogeneous sources of knowledge, advancing the state-of-the-art results on two popular question answering benchmarks, NaturalQuestions and WebQuestions, by 3.5 and 2.6 points, respectively. The code of UniK-QA is available at: https://github.com/facebookresearch/UniK-QA.
Code Repositories
Benchmarks
| Benchmark | Methodology | Metrics |
|---|---|---|
| knowledge-base-question-answering-on-1 | UniK-QA (T5-base) | Hits@1: 76.7 |
| knowledge-base-question-answering-on-1 | UniK-QA (T5-large) | Hits@1: 79.1 |
| open-domain-question-answering-on | UniK-QA | Exact Match: 57.7 |
| open-domain-question-answering-on-natural | UniK-QA | Exact Match: 54.9 |
| open-domain-question-answering-on-tqa | UniK-QA | Exact Match: 65.5 |
| question-answering-on-natural-questions-long | UniK-QA | EM: 54.9 |
| question-answering-on-tiq | Unik-Qa | P@1: 42.5 |
Build AI with AI
From idea to launch — accelerate your AI development with free AI co-coding, out-of-the-box environment and best price of GPUs.