CVE-Bench

CVE-Bench: testing LLM agents on real-world vulnerability patches

CVE-Bench claims to improve solve rates by 3–7 points per model, an advantage in the security benchmarking arena. However, community sentiment remains skeptical due to identified flaws in the original benchmarks.