Vulnerability Detection On Vulscriber

评估指标

F1 Score

评测结果

各个模型在此基准测试上的表现结果

Paper TitleRepository
Reveal Model - Tested on Reveal (Training on Devign + VulScribeR 20K + Extra Cleans)26.18VulScribeR: Exploring RAG-based Vulnerability Augmentation with LLMs
Devign Model - Tested on Reveal (Training on Devign + VulScribeR 20K + Extra Cleans)24.99--
Reveal Model - Tested on Bigvul (Training on Devign + VulScribeR 20K + Extra Cleans)18.98--
Devign Model - Tested on Bigvul (Training on Devign + VulScribeR 20K + Extra Cleans)18.51--
LineVul - Tested on Reveal (Training on Devign + VulScribeR 20K + Extra Cleans)17.38--
LineVul - Tested on BigVul (Training on Devign + VulScribeR 20K+ Extra Cleans)16.23--
0 of 6 row(s) selected.
Vulnerability Detection On Vulscriber | SOTA | HyperAI超神经