HyperAIHyperAI

Command Palette

Search for a command to run...

3 months ago

Answering Any-hop Open-domain Questions with Iterative Document Reranking

Ping Nie Yuyu Zhang Arun Ramamurthy Le Song

Answering Any-hop Open-domain Questions with Iterative Document Reranking

Abstract

Existing approaches for open-domain question answering (QA) are typically designed for questions that require either single-hop or multi-hop reasoning, which make strong assumptions of the complexity of questions to be answered. Also, multi-step document retrieval often incurs higher number of relevant but non-supporting documents, which dampens the downstream noise-sensitive reader module for answer extraction. To address these challenges, we propose a unified QA framework to answer any-hop open-domain questions, which iteratively retrieves, reranks and filters documents, and adaptively determines when to stop the retrieval process. To improve the retrieval accuracy, we propose a graph-based reranking model that perform multi-document interaction as the core of our iterative reranking framework. Our method consistently achieves performance comparable to or better than the state-of-the-art on both single-hop and multi-hop open-domain QA datasets, including Natural Questions Open, SQuAD Open, and HotpotQA.

Benchmarks

BenchmarkMethodologyMetrics
question-answering-on-hotpotqaDDRQA
ANS-EM: 0.625
ANS-F1: 0.759
JOINT-EM: 0.360
JOINT-F1: 0.639
SUP-EM: 0.510
SUP-F1: 0.789

Build AI with AI

From idea to launch — accelerate your AI development with free AI co-coding, out-of-the-box environment and best price of GPUs.

AI Co-coding
Ready-to-use GPUs
Best Pricing
Get Started

Hyper Newsletters

Subscribe to our latest updates
We will deliver the latest updates of the week to your inbox at nine o'clock every Monday morning
Powered by MailChimp
Answering Any-hop Open-domain Questions with Iterative Document Reranking | Papers | HyperAI