Question Answering On Webquestions

评估指标

EM

评测结果

各个模型在此基准测试上的表现结果

Paper TitleRepository
CoA70.7Chain-of-Action: Faithful and Multimodal Question Answering through Large Language Models
CoA w/o actions64.7Chain-of-Action: Faithful and Multimodal Question Answering through Large Language Models
DSP59.4Chain-of-Action: Faithful and Multimodal Question Answering through Large Language Models
DSP59.4DSPy: Compiling Declarative Language Model Calls into Self-Improving Pipelines
FiE+PAQ56.3FiE: Building a Global Probability Space by Leveraging Early Fusion in Encoder for Open-Domain Question Answering-
FiE52.4FiE: Building a Global Probability Space by Leveraging Early Fusion in Encoder for Open-Domain Question Answering-
FiDO51.1FiDO: Fusion-in-Decoder optimized for stronger performance and faster inference-
RAG45.2Retrieval-Augmented Generation for Knowledge-Intensive NLP Tasks
Few-shot44.7Language Models are Few-Shot Learners
Few-shot44.7Chain-of-Action: Faithful and Multimodal Question Answering through Large Language Models
PaLM-540B (Few-Shot)43.5PaLM: Scaling Language Modeling with Pathways
Zero-shot43Chain-of-Action: Faithful and Multimodal Question Answering through Large Language Models
Zero-shot43Language Models are Unsupervised Multitask Learners-
T5.1.1-XXL+SSM42.8Exploring the Limits of Transfer Learning with a Unified Text-to-Text Transformer
CoT42.5Chain-of-Thought Prompting Elicits Reasoning in Large Language Models
CoT42.5Chain-of-Action: Faithful and Multimodal Question Answering through Large Language Models
DPR42.4Dense Passage Retrieval for Open-Domain Question Answering
GPT-3-175B (Few-Shot)41.5Language Models are Few-Shot Learners
REALM40.7REALM: Retrieval-Augmented Language Model Pre-Training
React38.3ReAct: Synergizing Reasoning and Acting in Language Models
0 of 37 row(s) selected.
Question Answering On Webquestions | SOTA | HyperAI超神经