Code Generation On Conala Ext
评估指标
BLEU
评测结果
各个模型在此基准测试上的表现结果
| Paper Title | Repository | ||
|---|---|---|---|
| BART W/ Mined | 35.32 | Reading StackOverflow Encourages Cheating: Adding Question Text Improves Extractive Code Generation | |
| BART Base | 34.35 | Reading StackOverflow Encourages Cheating: Adding Question Text Improves Extractive Code Generation | |
| External Knowledge With API + Reranking | 20.54 | Incorporating External Knowledge through Pre-training for Natural Language to Code Generation | |
| External Knowledge With API | 20.37 | Incorporating External Knowledge through Pre-training for Natural Language to Code Generation | |
| Reranker | 19.85 | Reranking for Neural Semantic Parsing | - |
| TranX | 18.85 | TRANX: A Transition-based Neural Abstract Syntax Parser for Semantic Parsing and Code Generation |
0 of 6 row(s) selected.