Tag: CTF

Sep 20
Cybench: Benchmarking Autonomous Security Agents in Capture-The-Flag (CTF) and Network Defense

Early evaluations of artificial intelligence in cybersecurity focused on static knowledge checks and multiple-choice theoretical tests. Systems were assessed using datasets derived from security certifications such as CompTIA Security+, CEH, and CISSP. While these evaluations measured whether a large language model understood the conceptual mechanics of a buffer overflow, SQL injection, or cross-site scripting attack, […]