What Is GPT-Red? OpenAI Built an AI Hacker to Attack Its Own Models
TL;DR: GPT-Red in 30 Seconds GPT-Red is an automated red-teaming model OpenAI trained to break its own models; it is not public and never will be. It was trained with self-play: attacker GPT-Red and defender models played against each other, both getting stronger over time. In scenarios where human red-teamers succeeded only 13% of the time, GPT-Red hit 84%. GPT-5.6 was trained against GPT-Red, making it OpenAI’s most robust model against prompt injections (only a 0.05% failure rate). OpenAI just announced something unusual: not a model for users, but an “AI hacker” trained to break its own models. Meet GPT-Red! According to the research publication “Unlocking Self-Improvement for Robustness” released today, GPT-Red automates the work of human security testers (red teams) and does it far better than humans. ...