| Top Down Transformer (AdaPool) (464M) | 51.05 | 23.26 | 46.47 | Long Document Summarization with Top-down and Bottom-up Inference | |
| Lodoss-full-large (extractive) | 49.38 | 23.89 | 44.84 | Toward Unifying Text Segmentation and Long Document Summarization | |
| Lodoss-full-base (extractive) | 48.93 | 23.51 | 44.40 | Toward Unifying Text Segmentation and Long Document Summarization | |
| BigBird-Pegasus | 46.32 | 20.65 | 42.33 | Big Bird: Transformers for Longer Sequences | |