So, at the end of the year, my institute, the Cybersecurity Institute, will set up the AI Evaluation and Certification Center, the AIECC. And beginning next year, there will be a strong social eval component. And I’m happy to see that you’re also having this preparedness challenge, which goes beyond open red teaming, because open red teaming mostly talks about the model and the deployment and API design, the surface area, right? It’s more traditional cybersecurity, whereas preparedness now directly talk about a cult using it to synthesize novel bio attack resources, but combining it with the resource that only this cult has, and so on. So, it goes beyond product assessment and is much closer to societal evaluation that we have in mind.

Keyboard shortcuts

j previous speech k next speech