Command Palette
Search for a command to run...
Don't Give Me the Details, Just the Summary! Topic-Aware Convolutional Neural Networks for Extreme Summarization
Shashi Narayan; Shay B. Cohen; Mirella Lapata

Abstract
We introduce extreme summarization, a new single-document summarization task which does not favor extractive strategies and calls for an abstractive modeling approach. The idea is to create a short, one-sentence news summary answering the question "What is the article about?". We collect a real-world, large-scale dataset for this task by harvesting online articles from the British Broadcasting Corporation (BBC). We propose a novel abstractive model which is conditioned on the article's topics and based entirely on convolutional neural networks. We demonstrate experimentally that this architecture captures long-range dependencies in a document and recognizes pertinent content, outperforming an oracle extractive system and state-of-the-art abstractive approaches when evaluated automatically and by humans.
Code Repositories
Benchmarks
| Benchmark | Methodology | Metrics |
|---|---|---|
| text-summarization-on-x-sum | Baseline : Extractive Oracle | ROUGE-1: 29.79 ROUGE-2: 8.81 ROUGE-3: 22.66 |
| text-summarization-on-x-sum | T-ConvS2S | ROUGE-1: 31.89 ROUGE-2: 11.54 ROUGE-3: 25.75 |
| text-summarization-on-x-sum | Seq2Seq | ROUGE-1: 28.42 ROUGE-2: 8.77 ROUGE-3: 22.48 |
| text-summarization-on-x-sum | PtGen-Covg | ROUGE-1: 28.10 ROUGE-2: 8.02 ROUGE-3: 21.72 |
| text-summarization-on-x-sum | Baseline : Random | ROUGE-1: 15.16 ROUGE-2: 1.78 ROUGE-3: 11.27 |
| text-summarization-on-x-sum | Baseline : Lead-3 | ROUGE-1: 16.30 ROUGE-2: 1.60 ROUGE-3: 11.95 |
| text-summarization-on-x-sum | PtGen | ROUGE-1: 29.70 ROUGE-2: 9.21 ROUGE-3: 23.24 |
Build AI with AI
From idea to launch — accelerate your AI development with free AI co-coding, out-of-the-box environment and best price of GPUs.