Human in the Loop, Ghost in the Shell: Building AI-Powered Adversaries

[ Abstract ]

We have seen an incredible increase in AI's offensive capabilities. Presumably, that is why we are all here! AI is putting sophisticated hacking capabilities into more hands enabling attackers to operate at a larger scale than ever before through automation. As a Red Team, we think a lot about what adversaries will try next. In this talk, I will discuss how we predict different types of real-world attackers will leverage AI, ranging from industrialized social engineering and low-cost bespoke tooling to supply chain attacks and machine-speed system exploitation. I will share our experiences designing, building, and deploying our own offensive AI tools, ranging from human-in-the-loop copilot-style tools to (near-)autonomous Red Team exercise campaigns.