Careers

This application is for those without a preference for a team. We prefer you apply to team-specific RE roles below. /// Design and build evaluations to assess the capabilities and safety of advanced AI systems. Candidates should have relevant experience in machine learning.

This application is for those without a preference for a team. We prefer that you applying team-specific RS roles below. /// Lead research projects to improve our ability to assess the capabilities and safety of advanced AI systems. Candidates should have relevant experience in machine learning.

Design experiments and build evaluations to assess the cyber offensive capabilities of advanced AI systems. Candidates should have relevant experience in machine learning and cybersecurity.

Drive projects to understand advanced AI systems' vulnerability to misuse. Candidates should bring experience in ML research, ML engineering, or in security (e.g. redteaming in other domains).

Lead research projects to improve our ability to assess the cyber offensive capabilities of advanced AI systems. Candidates should have relevant experience in machine learning and cybersecurity.

As a team manager, you'll be heading up a multi-disciplinary team including scientists, engineers and domain experts on the capabilities that we are evaluations. These include autonomous replication, AI R&D, manipulation and deception.

Build large-scale experiments, to empirically evaluate risks such as uncontrolled self-improvement, autonomous replication, manipulation and deception. Collaborate with others to push forward the state of the science on model evaluations.‍

Research risks such as uncontrolled self-improvement, autonomous replication, manipulation and deception. Improve the science of model evaluations with things like scaling laws for dangerous capabilities.

Advance our understanding of AI risk scenarios involving AI research & development, autonomous replication, deception, and resource acquisition. Candidates should have a deep understanding of machine learning.

As an interpretability research scientist or engineer, you'll lead early work to push forward the science on detecting scheming and white-box evaluations.

Drive research to develop our understanding of how safety cases could be developed for advanced AI. You'll work closely with Geoffrey Irving to build out safety cases as a new pillar of AISI's work.

You will be a part of the Testing Team, which is responsible for our overall testing strategy, and the end-to-end preparation and delivery of individual testing exercises. You will collaborate closely with researchers and engineers from our evaluations workstreams, as well as policy and delivery teams. Your role will be broad and cross-cutting, involving project management, strategy, and scientific and policy communication.

As workstream lead of a novel team, you will build a team to evaluate and mitigate some of the pressing societal-level risks that Frontier AI systems may exacerbate, including radicalization, misinformation, fraud, and social engineering.

As workstream lead for this novel team, you will build and lead a multidisciplinary team to evaluate and mitigate the behavioural and psychological risks that emerge from AI systems. Your teams’ work will address how human interaction with advanced AI can impact human users, with a focus on identifying and preventing negative outcomes.

AISI is expanding our Systemic Safety team. This team is focussed on identifying and catalyzing interventions which could advance the field of AI safety and strengthen the systems and infrastructure in which AI systems are deployed. As the Workstream Lead for this team, you will build and lead a multidisciplinary team focussed on pushing systemic safety forward as an agenda and creating the global environment for responsible innovation.

We are starting up a new team whose objective is to develop technically informed best practice for companies to develop frontier AI safely. This role may involve leading on the technical advice for producing best practice guidance for companies operationalising these commitments in the form of AI safety frameworks, working closely with the safety cases team.

We are advertising for two Deputy Director roles to lead the research unit. We envisage one role focused on national security relevant evaluations, and the other focused on our grant programmes, research into the societal impacts of AI and our academic collaborations. These Deputy Directors will first and foremost be leaders of the Research Unit, focused on project delivery, managing the team and delivering timely research.

This is a fast-paced role responsible for enabling AISI’s continued growth and ensuring structures are in place as AISI begins planning for being placed onto a statutory footing. This Deputy Director will be at the heart of scaling this fast-paced start up in government, exercising vision and leadership in growing the organisation’s core operations functions from zero to one. They will also lead on an ambitious set of operational special projects, such as opening a new office in San Francisco.

As the Head of Security at the AI Safety Institute (AISI), you will lead on building a cyber resilient AISI. This will include efforts to harden our systems and protect our people, information and technologies. You think big picture about organisational risk based on mission objectives and a calibrated understanding of existing and potential attacks. You want to combine meaningful security with creative solutions rather than being limited to the compliance playbook.

The primary goal of this function is to manage all active recruitment for those looking to join the Institute and ensure a high standard of care for our hiring managers. Your aim will be to build the world’s leading AI safety team, acting as a key pillar in the world’s response to rapidly advancing technology. With direct lines into the highest seats of government we can influence significant change and protection for the citizens it will affect