Recent research
We analyze what AI evaluations can and cannot do for preventing catastrophic risks. While they can help determine lower bounds on AI capabilities, evaluations face fundamental limitations and cannot be solely relied upon to ensure safety.
Mechanisms to Verify International Agreements About AI Development
In this research report we provide an in-depth overview of the mechanisms that could be used to verify adherence to international agreements about AI development.
Response to BIS AI Reporting Requirements RFC
We respond to the BIS Request for Comment on the Proposed Rule for Establishment of Reporting Requirements for the Development of Advanced Artificial Intelligence Models and Computing Clusters.
Technical Governance Team Mission
AI systems are rapidly becoming more capable, and fundamental safety problems remain unsolved. Our goal is to increase the probability that humanity can safely navigate the transition to a world with smarter-than-human AI, focusing on technical research in service of governance goals.
governance goals:
Coordination
Strengthen international coordination to allow for effective international agreements and reduce dangerous race dynamics.
Security
Establish robust security standards and practices for frontier AI development, to reduce harms from model misalignment, misuse, and proliferation.
Development Safeguards
Ensure that dangerous AI development could be shut down, if there was broad international agreement on the need for this.
Regulation
Improve and develop domestic and international regulation of frontier AI, to prepare for coming risks, and identify when current safety plans are likely to fail.
Frequently asked questions