Day 2 · 10:00–10:30 AEST · Research · 30 min

ExploitBench

Seunghyun Lee · Carnegie Mellon University

YouTube

[ Abstract ]

Exploitation is a ladder, not a coin flip. ExploitBench grades LLM agents across 16 capability flags against real V8, from first crash to arbitrary code execution, and shows where today's models actually stop.

Benchmarking LLMs on vulnerability discovery and exploitation capabilities — results and lessons learned.