The AI Security Institute is the first state-backed organisation dedicated to advancing this goal.
We are conducting research and building infrastructure to understand the capabilities and impacts of advanced AI and to develop and test risk mitigations.
We are also working with the wider research community, AI developers and other governments to affect how AI is developed and to shape global policymaking on this issue.
A comprehensive benchmark to detect emerging replication abilities in AI systems and provide a quantifiable understanding of potential risks
Our new paper outlines how AI control methods can mitigate misalignment risks as capabilities of AI systems increase
20 Systemic Safety Grant Awardees Announced
Monitoring the fast-moving landscape of AI development
Evaluating the risks AI poses to national security and public safety
Advancing the field of systemic safety to improve national resilience
Working with AI developers to ensure responsible development
Informing policymakers about current and emerging risks from AI
Promoting global coordination on AI governance
For our ambitious and urgent mission, we need top talent. We have built a unique structure within the government so we can operate like a startup. We have recruited over 50 technical staff, including senior alumni from OpenAI, Google DeepMind and the University of Oxford, and we are scaling rapidly. Our staff are supported by substantial funding and computing resources, priority access to top models, partnerships with leading research organisations and an incredibly talented, close-knit and driven team.
