
摘要
知识图谱到文本生成的数据收集成本高昂,因此近年来无监督模型的研究成为活跃领域。然而,大多数无监督模型不得不依赖现有小型监督数据集的非平行版本,这在很大程度上限制了其潜力。本文提出一个大规模、通用领域的数据集——GenWiki。该无监督数据集分别包含130万条文本和图谱样本。同时,我们构建了一个人工标注的测试集,为未来基于知识图谱的无监督文本生成研究提供了一个新的基准数据集。
基准测试
| 基准 | 方法 | 指标 |
|---|---|---|
| unsupervised-kg-to-text-generation-on-genwiki | CycleGT_Warm | BLEU: 41.35 CIDEr: 3.45 METEOR: 35.20 ROUGE-L: 63.01 |
| unsupervised-kg-to-text-generation-on-genwiki | Rule-Based | BLEU: 13.45 CIDEr: 1.26 METEOR: 30.72 ROUGE-L: 40.93 |
| unsupervised-kg-to-text-generation-on-genwiki | NoisySupervised | BLEU: 30.12 CIDEr: 2.52 METEOR: 28.12 ROUGE-L: 56.96 |
| unsupervised-kg-to-text-generation-on-genwiki | CycleGT_Base | BLEU: 41.59 CIDEr: 3.57 METEOR: 35.72 ROUGE-L: 63.31 |
| unsupervised-kg-to-text-generation-on-genwiki | DirectTransfer | BLEU: 13.89 CIDEr: 1.26 METEOR: 25.76 ROUGE-L: 39.75 |
| unsupervised-kg-to-text-generation-on-genwiki-1 | CycleGT_Warm | BLEU: 40.47 CIDEr: 3.48 METEOR: 34.84 ROUGE-L: 63.40 |
| unsupervised-kg-to-text-generation-on-genwiki-1 | CycleGT_Base | BLEU: 41.29 CIDEr: 3.53 METEOR: 35.39 ROUGE-L: 63.73 |
| unsupervised-kg-to-text-generation-on-genwiki-1 | DirectTransfer | BLEU: 13.89 CIDEr: 1.26 METEOR: 25.76 ROUGE-L: 39.75 |
| unsupervised-kg-to-text-generation-on-genwiki-1 | Rule-Based | BLEU: 13.45 CIDEr: 1.26 METEOR: 30.72 ROUGE-L: 40.93 |
| unsupervised-kg-to-text-generation-on-genwiki-1 | NoisySupervised | BLEU: 35.03 CIDEr: 2.63 METEOR: 33.45 ROUGE-L: 58.14 |