Brockman describes OpenAI using Astra to hunt its own security holes
OpenAI pulled 25% of its production engineers to use models like Astra to find P0 vulnerabilities in its own systems, and aims to automate this "defense factory."
Greg Brockman of @OpenAI on the new security loop: point every model release at your own systems, find the vulnerabilities, automate it. "We took 25% of our production engineers and said, 'Sorry, all your projects are on hold. You are now defending. You are now up-leveling our security architecture. You're going to use the models to find all the holes.' And we found a number of serious issues, and we fixed them." "We found some new problems, but eventually it saturated. We basically have found, to our knowledge, all of the P0s, all of the critical problems that Astra is smart enough to find. And of course, there will be a new model, there will be a new round." "You want to be in this tight loop of new cyber capability drops, you deploy it against your systems, you find the new holes, and ideally, you've managed to automate this, what we call defense factory. That's what we're building internally." @gdb @bhorowitz
This post quotes another post: x.com/64844802/status/2107557839795613979