AI Wiki

Centre for the Governance of AI (GovAI)

AI Policy & RegulationResearch Organizations
23 min read
Updated
Suggest editHistoryTalk
RawGraph

Last edited

Fact-checked

In review queue

Sources

No citations yet

Revision

v4 · 4,597 words

Fact-checks are independent of edits: a reviewer re-verifies the article against its sources and stamps the date. How we verify

This article needs citations. It does not cite its sources inline yet. You can help: suggest an edit that adds references.

The Centre for the Governance of AI (GovAI) is an independent nonprofit research organisation whose stated mission is "to help institutions make better AI governance decisions" as the world transitions to advanced artificial intelligence.[17][44] It grew out of ai governance research groups founded by political scientist Allan Dafoe at Yale University in 2016 and at the University of Oxford's future of humanity institute (FHI) in 2017, was operating under the name Center for the Governance of AI by 2018, and spun out of FHI as a separate nonprofit in 2021.[1][2][43] Following the closure of FHI by Oxford in April 2024, GovAI continued as a stand-alone organisation with staff across the United Kingdom, United States, and European Union; its UK arm is registered at 20 Old Bailey in London, and in 2025 it opened an office in Washington, DC, near Dupont Circle.[3][4][45][51] The centre is led by Executive Director Ben Garfinkel, with Allan Dafoe as founder and president and Markus Anderljung as Director of Policy and Research.[5][6][7][49] GovAI has produced influential reports on frontier-model regulation, compute governance, biosecurity, and international AI agreements; its researchers helped frame the 2023 UK AI Safety Summit at Bletchley Park and co-led the safety chapter of the European Union's 2025 General-Purpose AI Code of Practice.[8][9][10][46][47]

History

Founding inside the Future of Humanity Institute (2016 to 2018)

GovAI dates its origins to two research groups founded by political scientist Allan Dafoe: the Global Politics of AI Research Group at Yale University in 2016 (the year of DeepMind's AlphaGo victory, which sharpened his focus on the policy implications of AI), and the Governance of AI Program he set up at the University of Oxford's Future of Humanity Institute in 2017.[43] The Oxford seed was a small AI governance research group inside FHI, an interdisciplinary research centre in the Faculty of Philosophy directed by philosopher nick bostrom.[11] Dafoe, then an associate professor of the International Politics of AI at Oxford with a position in the Department of Politics and International Relations, joined FHI in the late 2010s and formalised the AI governance work as a programme during 2017 to 2018.[1][2] FHI's 2018 annual report identifies the unit as the "Center for the Governance of AI" and lists Dafoe as its director.[1] The same year Dafoe published a 75-page document titled "AI Governance: A Research Agenda", a foundational text that mapped the field into questions about strategic competition, international cooperation, technical landscape, and governance institutions for advanced AI.[2]

The unit's early staff and affiliates produced one of the most cited reports in the field, "The Malicious Use of Artificial Intelligence: Forecasting, Prevention, and Mitigation", led by Miles Brundage of FHI and Shahar Avin of the Centre for the Study of Existential Risk, with contributors from OpenAI, the Electronic Frontier Foundation, and other institutions.[12] The report was released in February 2018 and helped frame public debate about misuse risks from machine learning systems.[12]

Growth as an FHI programme (2018 to 2021)

Between 2018 and 2021 the Centre for the Governance of AI expanded as the AI governance research programme inside FHI. It built up a network of research affiliates across political science, law, economics, and computer science, and ran the Governance of AI Fellowship, an early summer research programme that recruited junior researchers into the field.[13] Output during this period included Dafoe's 2018 research agenda; commentary on the international AI landscape; work on AI capability forecasting; and contributions to safety-related publications by collaborators inside OpenAI, DeepMind, and other labs.[2][14]

By 2020 the centre had grown to around a dozen researchers and affiliates. Within FHI itself, however, administrative tensions with the Faculty of Philosophy were intensifying. From 2020 the Faculty imposed a freeze on FHI's fundraising and hiring, a constraint that the institute's eventual final report described as having gradually suffocated its operations.[4][15]

Spin-off as an independent nonprofit (2021)

In September 2021 GovAI announced that it would spin out of FHI and operate as an independent organisation, citing a desire for greater operational flexibility, the ability to expand its field-building activities, and the bureaucratic constraints affecting its parent institute.[16] The transition was completed in October 2021. A blog post on the GovAI site dated 29 October 2021 announced the relaunch, naming Ben Garfinkel as acting director and Allan Dafoe as president.[5] At that point Dafoe had also taken up a position leading a long-term AI strategy and governance team at DeepMind, with the GovAI presidency held in a part-time capacity.[5]

The new organisation was structured around two legal entities: a UK company limited by guarantee, the Centre for the Governance of AI Ltd., and a US 501(c)(3) nonprofit, Centre for the Governance of AI, Inc.[17] Both entities operate under the GovAI brand, with most staff based in Oxford and a smaller cohort in the San Francisco Bay Area and other locations.[17][18]

FHI closure and GovAI continuation (2024 onwards)

On 16 April 2024 the University of Oxford formally closed the Future of Humanity Institute. The official statement cited "increasing administrative headwinds within the Faculty of Philosophy" as a primary cause; the closure was preceded by a 2023 decision by the Faculty not to renew the contracts of remaining FHI staff.[3][4] FHI's final report, published on the EA Forum, framed the wind-down as the result of a long-running clash between the institute's flexible operating style and the rules of its host faculty.[4]

Because GovAI had already become a separate legal entity in 2021, the FHI closure did not directly terminate its operations. Coverage of the FHI closure in Asterisk magazine and the LessWrong forum identified GovAI as one of the most significant continuing offshoots of FHI's AI governance work, alongside the broader Oxford research community.[15][19] GovAI continued to operate and announced expanded hiring and fellowship rounds in 2024 and 2025, including a 2026 Summer Fellowship with research and applied tracks.[18][20]

In August 2024 GovAI's UK arm was incorporated at Companies House as a private company limited by guarantee, the Centre for the Governance of AI, with a registered office at 20 Old Bailey in London, reflecting a shift of the centre's day-to-day UK base toward London.[45] GovAI's 2024 annual report set out priorities for 2025 of growing the team, accelerating its research and policy work, and maturing the organisation's infrastructure, and stated that demand for its work "has never been greater".[44] During 2025 GovAI opened a Washington, DC office near Dupont Circle and began a substantial US buildout, recruiting a Head of US Policy to direct federal policy research and launching DC-based fellowships and a US AI Policy Program.[51][52]

Who leads GovAI?

Allan Dafoe

Allan Dafoe is the founder and president of GovAI. He completed a PhD in political science at the University of California, Berkeley, and held faculty positions at Yale University before moving to Oxford. At Oxford he was associate professor of the International Politics of AI, with a position in the Department of Politics and International Relations and at FHI, where he founded and directed the AI governance unit that became GovAI.[1][2] Dafoe's earlier academic work focused on causes of war, the democratic peace, and methodology in international relations, with awards including the Kenneth E. Boulding Award.[21] Since 2020 he has worked at google deepmind, where he now serves as Director of Frontier Safety and Governance, and he remains GovAI's founder, president, and a board member.[49][21]

Ben Garfinkel

Ben Garfinkel is the executive director of GovAI, named acting director at the 2021 relaunch and confirmed as executive director thereafter; the organisation describes him as responsible for "setting the direction of the organisation and making key decisions".[5][6] He holds undergraduate degrees in Physics and in Mathematics and Philosophy from Yale University, and a DPhil in International Relations from Oxford. His thesis examined the role of economic growth in international security.[6] Garfinkel's research has focused on the security implications of AI, the causes of war, and forecasting methodology for emerging technologies; he has been a research fellow at FHI alongside his GovAI work, and has commented publicly on the design of global AI safety summits and AGI safety research agendas.[6]

Markus Anderljung

Markus Anderljung is Director of Policy and Research at GovAI. His research focuses on frontier AI regulation, compute governance, third-party auditing of AI systems, and international AI policy.[7][22] Anderljung was seconded to the UK Cabinet Office as a Senior AI Policy Specialist during the lead-up to the 2023 AI Safety Summit at Bletchley Park, and has served as an adjunct fellow at the Center for a New American Security and as a member of the OECD AI Policy Observatory's Expert Group on AI Futures.[7][22] For the European Union's General-Purpose AI Code of Practice, published on 10 July 2025, he served as one of the Vice-Chairs leading the drafting of its Safety and Security Chapter, focused on frontier AI.[46][47] On the Code's release he wrote that it is "a lean but effective framework for frontier AI companies to comply with the AI Act".[48]

Other senior staff and affiliates

GovAI's senior staff include international governance lead Robert Trager, who is also co-director of the Oxford Martin AI Governance Initiative and a senior research fellow at the Blavatnik School of Government.[23] Toby Shevlane, a researcher with positions at GovAI and Google DeepMind, has led work on model evaluations for extreme risks and on structured access to powerful AI models.[24][25] Helen Toner, formerly of Georgetown's Center for Security and Emerging Technology, has been listed among GovAI's senior staff and advisory roles, and is a member of the advisory board.[26][16]

Advisory board

The advisory board, formalised at the 2021 relaunch, has included Ajeya Cotra of Open Philanthropy, Allan Dafoe in a board capacity, Helen Toner, Tasha McCauley, and Toby Ord, with composition updated periodically. Toby Ord, a senior research fellow at Oxford and a co-founder of Giving What We Can, is one of the longest-serving advisers.[16][27]

What does GovAI research?

GovAI's research programme covers a set of overlapping ai governance topics, generally organised into policy and regulation, technical governance, AI economics, biosecurity, and the broader AI landscape.[28]

Frontier model regulation

Frontier model regulation has been a flagship area since 2022. Anderljung, Garfinkel, Shevlane, Trager, and others have argued that highly capable foundation models pose distinctive policy challenges because dangerous capabilities can emerge unexpectedly, misuse is difficult to prevent after deployment, and models can proliferate widely once released.[8][29] GovAI has proposed regulatory components including standard-setting processes, registration and reporting requirements, and compliance mechanisms for frontier model forum participants and other frontier developers.[8] The work has fed into uk aisi and us aisi policy discussions and the design of the eu ai act general-purpose AI provisions.[7][9]

Compute governance

Work on compute governance has been led by Anderljung, Lennart Heim, Robert Trager, and collaborators across multiple institutions. The February 2024 paper "Computing Power and the Governance of AI" co-authored by 19 researchers including Yoshua Bengio, Diane Coyle, and Gillian Hadfield argued that compute is detectable, excludable, and quantifiable across a concentrated supply chain, making it a tractable lever for governance.[29] The paper outlined uses of compute governance for visibility into AI development, allocation toward beneficial uses, and restriction of harmful uses, while warning of risks to privacy and power concentration.[29]

Model evaluation and dangerous capabilities

Shevlane led the 2023 paper "Model evaluation for extreme risks", co-authored with 20 collaborators including Yoshua Bengio, Paul Christiano, Allan Dafoe, and researchers at Google DeepMind, OpenAI, Anthropic, and academic institutions.[25] The paper proposed that frontier developers run two complementary types of evaluation: dangerous capability evaluations to detect harmful functionalities such as offensive cyber, autonomous replication, or persuasion, and alignment evaluations to assess whether models would apply those capabilities for harm.[25] The framework has been cited in evaluation protocols at apollo research, redwood research, and metr, and in policy commentary by AI safety institutes.[25]

Biosecurity and dual-use risks

Biosecurity became a distinct workstream from 2024 onwards, reflecting concern that frontier models could lower barriers to biological and cyber attacks. In the 2025 report "Dual-Use AI Capabilities and the Risk of Bioterrorism: Converting Capability Evaluations to Risk Assessments", GovAI researcher Luca Righetti set out a method for converting model capability evaluations into quantitative risk assessments, drawing on historical case studies, expert elicitation, and reference-class forecasting.[50] The report estimated that if AI systems increased the share of STEM graduates able to synthesize a pathogen as complex as influenza by 10 percentage points and also helped them design workable operational plans, the annual probability of an epidemic caused by a lone actor could rise from 0.15% to 1.0%, which the report translated to roughly 12,000 additional expected deaths per year.[50] Related GovAI analysis has examined coding agents as a biosecurity risk amplifier and, in a 2026 report by John Halstead and Luca Righetti, the risk of AI-enabled computer worms.[53]

International AI agreements

The international governance workstream is led by Robert Trager and Allison Carnegie, with Lewis Ho, Lennart Heim, and others as co-authors. A flagship paper, "International governance of civilian AI: a jurisdictional certification approach", drew analogies to the International Civil Aviation Organization, the International Maritime Organization, and the Financial Action Task Force, arguing that a network of national regulators could certify jurisdictions rather than firms directly.[23] Other work covers verification of international AI commitments, treaty design, and risks from unconstrained competition between states and labs.[23]

AI strategy and capability forecasting

GovAI has continued the strand of forecasting work begun under FHI, addressing AGI timelines, race dynamics, and broader strategy questions. Garfinkel and Dafoe have written on the dynamics of strategic competition and the conditions under which cooperative governance is feasible, and the organisation has hosted workshops on capability forecasting jointly with collaborators inside major labs.[2][14]

AI economics

The economics workstream, with contributors including Anton Korinek (an affiliate and frequent co-author) and Diane Coyle, has examined labour-market impacts of large language models, the macroeconomics of transformative AI, and benefit-sharing arrangements.[28] A January 2026 report by Sam Manning and Tomas Aguirre, "How Adaptable Are American Workers to AI-Induced Job Displacement?", extended this work into empirical labour-market analysis.[54] GovAI co-hosts the Brookings/GovAI Conference on the Governance of Transformative AI with Brookings researchers.[30]

Notable publications

  • "AI Governance: A Research Agenda" by Allan Dafoe, Governance of AI Program, Future of Humanity Institute, University of Oxford, August 2018. A foundational research agenda that frames the field around AI strategy, ideal governance, and policy levers.[2]
  • "The Malicious Use of Artificial Intelligence: Forecasting, Prevention, and Mitigation" by Miles Brundage, Shahar Avin, Jack Clark, and 23 co-authors, February 2018. Examines digital, physical, and political misuse risks from advanced AI and proposes research and policy responses.[12] Available at arXiv:1802.07228.
  • "Frontier AI Regulation: Managing Emerging Risks to Public Safety" by Markus Anderljung, Joslyn Barnhart, Anton Korinek, Jade Leung, Cullen O'Keefe, Jess Whittlestone, and 18 others, July 2023, arXiv:2307.03718. Proposes building blocks for the regulation of highly capable foundation models, including standard-setting, registration and reporting, and compliance mechanisms.[8]
  • "Model evaluation for extreme risks" by Toby Shevlane and 20 co-authors, May 2023, arXiv:2305.15324. Introduces a framework for dangerous capability and alignment evaluations targeted at extreme risks from frontier systems.[25]
  • "Computing Power and the Governance of Artificial Intelligence" by Girish Sastry, Lennart Heim, Haydn Belfield, Markus Anderljung, Miles Brundage, and 14 co-authors, February 2024, arXiv:2402.08797. Analyses how computing power can serve as a governance lever, with applications to visibility, allocation, and enforcement.[29]
  • "International governance of civilian AI: a jurisdictional certification approach" by Robert Trager, Ben Harack, Anka Reuel, Allison Carnegie, Lennart Heim, Lewis Ho, Sarah Kreps, Ranjit Lall, Owen Larter, Sean O hEigeartaigh, Simon Staffell, and Jose Jaime Villalobos, 2023. Proposes a certification regime for jurisdictions modelled on existing international regulatory bodies.[23]
  • "Dual-Use AI Capabilities and the Risk of Bioterrorism: Converting Capability Evaluations to Risk Assessments" by Luca Righetti, Centre for the Governance of AI, 2025. Introduces a method for turning model capability evaluations into quantitative bioterrorism risk estimates using historical base rates and expert elicitation.[50]

GovAI also publishes shorter analysis pieces and policy briefs through its website and through outlets such as Lawfare, Foreign Affairs, and the Financial Times.[17][31]

What fellowships does GovAI offer?

GovAI runs a Summer Fellowship that has operated annually since the FHI period and has become one of the principal entry routes into the AI governance research community.[13][20] The contemporary version of the programme, branded the GovAI Summer Fellowship, has both a Research Track and an Applied Track. The 2026 edition ran from 8 June to 28 August 2026, was based in London for the in-person cohort, and paid a stipend of GBP 12,000 over the three-month period.[20] Fellows in the Research Track spend the opening weeks exploring the landscape before settling on an independent research proposal with mentorship from GovAI staff; outputs include policy briefs, journal articles, and white papers.[20]

By 2025 GovAI had expanded this into a set of Seasonal Fellowships offered twice a year, in summer and winter, and across two locations. Alongside the London summer 2026 tracks, GovAI ran a DC Summer Fellowship based in Washington, DC over the same 8 June to 28 August dates, paying a stipend of USD 21,000 and focusing on how AI policy is made within the US political system.[20][52] Winter fellowships in London and Washington, DC were scheduled for 18 January to 9 April 2027.[52] Separately, GovAI runs a part-time, bipartisan U.S. AI Policy Program for working professionals in government and think tanks, delivered from its Washington, DC office near Dupont Circle over roughly twelve weeks each autumn.[51]

GovAI also runs longer-term roles for early-career researchers, including a Research Scholar programme that can lead to staff Research Fellow positions, and offers one-year research fellowships in defined policy and technical governance areas.[32][33] The organisation supports affiliates based at universities, think tanks, and AI labs as part of its broader field-building activities.[32]

How is GovAI funded?

GovAI is funded by philanthropic grants and donations. The 2021 spin-off announcement listed Open Philanthropy, the Center for Emerging Risk Research, and Effective Altruism Funds as principal funders.[16] In subsequent years open philanthropy has been GovAI's largest disclosed funder. Open Philanthropy's grant database records a USD 2,537,600 two-year grant to support field-building activities in AI governance research, made via the Centre for Effective Altruism, and at least two further general-support grants of USD 2,800,000 and USD 1,000,000 to GovAI directly, along with a smaller compute strategy workshop grant.[34][35][36]

GovAI is associated with the effective altruism philanthropic ecosystem through its funders and the prior affiliations of its founders and advisers, though as an independent registered charity it sets its own research priorities.[16][17]

Reception and influence

GovAI research has been cited in official government documents, multilateral processes, and major news coverage of AI policy. The UK government's 2023 AI Safety Summit at Bletchley Park drew on GovAI-affiliated researchers, and Anderljung's secondment to the Cabinet Office contributed directly to the summit's policy framing.[9][7] The Bletchley Declaration and the chair's statement from the summit referenced frontier AI risks in ways that overlap closely with the categories proposed in the "Frontier AI Regulation" paper.[9][10]

Within the European Union, GovAI staff and affiliates have provided input to consultations on the AI Act, including the design of the Code of Practice for general-purpose AI. The European Union's General-Purpose AI Code of Practice, published on 10 July 2025, was drafted by a group of thirteen independent experts with input from more than 1,000 stakeholders; Anderljung served as one of the Vice-Chairs leading its Safety and Security Chapter, which sets out how providers of the most capable general-purpose models can comply with the eu ai act.[46][47] In the United States, GovAI work has been cited in policy commentary around the 2023 White House ai executive order on AI and subsequent administration AI policies, and in materials produced by the us aisi and the uk aisi.[7][25]

GovAI's writing appears in academic journals, think-tank reports, and outlets including Foreign Affairs, The Economist, the Financial Times, Lawfare, Nature Machine Intelligence, and Science.[17][7]

How does GovAI differ from other AI governance organisations?

OrganisationFoundedHeadquartersPrimary focusStructure
Centre for the Governance of AI (GovAI)2016 (spun out 2021)London, UK and Washington, DC, USAI governance research and policyIndependent nonprofit[17][45]
center for ai safety2022San Francisco, USAI safety research and field-buildingIndependent nonprofit[37]
apollo research2023London, UKModel evaluations and deceptive alignmentIndependent nonprofit[38]
metr2022Berkeley, USAutonomy and capability evaluationsIndependent nonprofit[39]
uk aisi2023London, UKNational AI safety instituteUK government body[40]
us aisi2023Gaithersburg, USNational AI safety instituteUS government body within NIST[41]
frontier model forum2023USIndustry forum for frontier developersIndustry nonprofit[42]

GovAI is distinct from the AI Safety Institutes in that it is non-governmental, and from organisations such as apollo research and metr in that it focuses on governance research and policy rather than running model evaluations directly. Its work intersects with center for ai safety in field-building and policy commentary, though CAIS places greater emphasis on technical safety research. Compared to industry coordination bodies such as the frontier model forum, GovAI is independent of AI developers, though its researchers frequently co-author papers with personnel at frontier labs.[17][29] GovAI should not be confused with the "GovAI Coalition", a separate US-based network of local and state governments focused on the responsible public-sector use of AI.

See also

References

  1. Future of Humanity Institute, "Annual Report 2018: Center for the Governance of AI", University of Oxford, 2018. https://www.fhi.ox.ac.uk/annual-report-2018-center-for-the-governance-of-ai/. Accessed 2026-05-26. ↩
  2. Allan Dafoe, "AI Governance: A Research Agenda", Governance of AI Program, Future of Humanity Institute, University of Oxford, 2018-08-27. https://cdn.governance.ai/GovAI-Research-Agenda.pdf. Accessed 2026-05-26. ↩
  3. Daily Nous, "The End of the Future of Humanity Institute (updated)", 2024-04-18. https://dailynous.com/2024/04/18/end-future-of-humanity-institute/. Accessed 2026-05-26. ↩
  4. Future of Humanity Institute, "Future of Humanity Institute 2005-2024: Final Report", EA Forum, 2024. https://forum.effectivealtruism.org/posts/uK27pds7J36asqJPt/future-of-humanity-institute-2005-2024-final-report. Accessed 2026-05-26. ↩
  5. Centre for the Governance of AI, "The Centre for the Governance of AI Has Relaunched", GovAI Blog, 2021-10-29. https://www.governance.ai/post/the-centre-for-the-governance-of-ai-has-relaunched. Accessed 2026-05-26. ↩
  6. Centre for the Governance of AI, "Ben Garfinkel", GovAI Team Page, 2025. https://www.governance.ai/team/ben-garfinkel. Accessed 2026-05-26. ↩
  7. Centre for the Governance of AI, "Markus Anderljung", GovAI Team Page, 2025. https://www.governance.ai/team/markus-anderljung. Accessed 2026-05-26. ↩
  8. Markus Anderljung et al., "Frontier AI Regulation: Managing Emerging Risks to Public Safety", arXiv:2307.03718, 2023-07-06 (revised 2023-11-07). https://arxiv.org/abs/2307.03718. Accessed 2026-05-26. ↩
  9. UK Government, "Chair's Summary of the AI Safety Summit 2023, Bletchley Park", GOV.UK, 2023-11-02. https://www.gov.uk/government/publications/ai-safety-summit-2023-chairs-statement-2-november/chairs-summary-of-the-ai-safety-summit-2023-bletchley-park. Accessed 2026-05-26. ↩
  10. UK Government, "The Bletchley Declaration by Countries Attending the AI Safety Summit, 1-2 November 2023", GOV.UK, 2023-11-01. https://www.gov.uk/government/publications/ai-safety-summit-2023-the-bletchley-declaration/the-bletchley-declaration-by-countries-attending-the-ai-safety-summit-1-2-november-2023. Accessed 2026-05-26. ↩
  11. Future of Humanity Institute, "About FHI", University of Oxford, archived 2024. https://www.fhi.ox.ac.uk/. Accessed 2026-05-26. ↩
  12. Miles Brundage, Shahar Avin, Jack Clark et al., "The Malicious Use of Artificial Intelligence: Forecasting, Prevention, and Mitigation", arXiv:1802.07228, 2018-02-20. https://arxiv.org/abs/1802.07228. Accessed 2026-05-26. ↩
  13. Future of Humanity Institute, "Governance of AI Fellowship", University of Oxford, archived 2021. https://www.fhi.ox.ac.uk/governance-of-ai-fellowship/. Accessed 2026-05-26. ↩
  14. Future of Humanity Institute, "New report on the malicious use of AI", University of Oxford, 2018-02-20. https://www.fhi.ox.ac.uk/new-report-malicious-use-ai/. Accessed 2026-05-26. ↩
  15. Tom Davidson and contributors, "Looking Back at the Future of Humanity Institute", Asterisk Magazine, issue 8, 2024. https://asteriskmag.com/issues/08/looking-back-at-the-future-of-humanity-institute. Accessed 2026-05-26. ↩
  16. Centre for the Governance of AI, "The Centre for the Governance of AI is Becoming a Nonprofit", EA Forum, 2021-09. https://forum.effectivealtruism.org/posts/zcAxoAHcSECyewr2t/the-centre-for-the-governance-of-ai-is-becoming-a-nonprofit. Accessed 2026-05-26. ↩
  17. Centre for the Governance of AI, "About GovAI", governance.ai homepage, 2025. https://www.governance.ai/. Accessed 2026-05-26. ↩
  18. Centre for the Governance of AI, "Opportunities", GovAI website, 2025. https://www.governance.ai/opportunities. Accessed 2026-05-26. ↩
  19. LessWrong, "FHI (Future of Humanity Institute) has shut down (2005-2024)", 2024-04. https://www.lesswrong.com/posts/tu3CH22nFLLKouMKw/fhi-future-of-humanity-institute-has-shut-down-2005-2024. Accessed 2026-05-26. ↩
  20. Centre for the Governance of AI, "Summer Fellowship 2026, Research Track", GovAI Blog, 2025-12. https://www.governance.ai/post/summer-fellowship-2026-research-track. Accessed 2026-05-26. ↩
  21. Allan Dafoe, "Research", personal website, 2025. https://www.allandafoe.com/research. Accessed 2026-05-26. ↩
  22. Markus Anderljung, "Research", personal website, 2025. https://www.markusanderljung.com/research.html. Accessed 2026-05-26. ↩
  23. Robert Trager et al., "International Governance of Civilian AI: A Jurisdictional Certification Approach", SSRN working paper, 2023. https://papers.ssrn.com/sol3/papers.cfm?abstract_id=4579899. Accessed 2026-05-26. ↩
  24. Centre for the Governance of AI, "Toby Shevlane", GovAI Team Page, 2025. https://www.governance.ai/team/toby-shevlane. Accessed 2026-05-26. ↩
  25. Toby Shevlane et al., "Model Evaluation for Extreme Risks", arXiv:2305.15324, 2023-05-24 (revised 2023-09-22). https://arxiv.org/abs/2305.15324. Accessed 2026-05-26. ↩
  26. Centre for the Governance of AI, "Helen Toner", GovAI Team Page, 2025. https://www.governance.ai/team/helen-toner. Accessed 2026-05-26. ↩
  27. Centre for the Governance of AI, "GovAI Annual Report 2021", EA Forum, 2022. https://forum.effectivealtruism.org/posts/cecf9mGdqtxbfEt7z/govai-annual-report-2021-2. Accessed 2026-05-26. ↩
  28. Centre for the Governance of AI, "Research", GovAI website, 2025. https://www.governance.ai/research. Accessed 2026-05-26. ↩
  29. Girish Sastry, Lennart Heim, Haydn Belfield, Markus Anderljung et al., "Computing Power and the Governance of Artificial Intelligence", arXiv:2402.08797, 2024-02-13. https://arxiv.org/abs/2402.08797. Accessed 2026-05-26. ↩
  30. Anton Korinek, "Brookings/GovAI Conference on the Governance of Transformative AI", korinek.com, 2024. https://www.korinek.com/TAIgovernance. Accessed 2026-05-26. ↩
  31. Markus Anderljung, "Contributor profile", Lawfare, 2025. https://www.lawfaremedia.org/contributors/manderljung. Accessed 2026-05-26. ↩
  32. Centre for the Governance of AI, "People", GovAI website, 2025. https://www.governance.ai/people. Accessed 2026-05-26. ↩
  33. Global South Opportunities, "One-Year Research Fellowship at the Centre for the Governance of AI", 2025-06-26. https://www.globalsouthopportunities.com/2025/06/26/govai-3/. Accessed 2026-05-26. ↩
  34. Open Philanthropy, "Centre for the Governance of AI: AI Field Building", grants database, 2022. https://www.openphilanthropy.org/grants/centre-for-the-governance-of-ai-ai-field-building/. Accessed 2026-05-26. ↩
  35. Open Philanthropy, "Centre for the Governance of AI: General Support", grants database, 2023. https://www.openphilanthropy.org/grants/centre-for-the-governance-of-ai-general-support-2/. Accessed 2026-05-26. ↩
  36. Open Philanthropy, "Centre for the Governance of AI: Compute Strategy Workshop", grants database, 2023. https://www.openphilanthropy.org/grants/centre-for-the-governance-of-ai-compute-strategy-workshop/. Accessed 2026-05-26. ↩
  37. Center for AI Safety, "About CAIS", safe.ai, 2024. https://safe.ai/. Accessed 2026-05-26. ↩
  38. Apollo Research, "About Apollo Research", apolloresearch.ai, 2024. https://www.apolloresearch.ai/about. Accessed 2026-05-26. ↩
  39. METR, "About METR", metr.org, 2024. https://metr.org/about. Accessed 2026-05-26. ↩
  40. UK Government, "AI Security Institute", GOV.UK, 2024. https://www.aisi.gov.uk/. Accessed 2026-05-26. ↩
  41. NIST, "U.S. AI Safety Institute (Center for AI Standards and Innovation)", nist.gov, 2024. https://www.nist.gov/aisi. Accessed 2026-05-26. ↩
  42. Frontier Model Forum, "About the Frontier Model Forum", frontiermodelforum.org, 2023. https://www.frontiermodelforum.org/. Accessed 2026-05-26. ↩
  43. Centre for the Governance of AI, "About Us", governance.ai, 2026. https://www.governance.ai/about-us. Accessed 2026-07-08. ↩
  44. Centre for the Governance of AI, "Annual Report 2024", GovAI Blog, 2025. https://www.governance.ai/post/annual-report-2024. Accessed 2026-07-08. ↩
  45. Companies House, "CENTRE FOR THE GOVERNANCE OF AI, company number 15883729", GOV.UK, incorporated 2024-08-07. https://find-and-update.company-information.service.gov.uk/company/15883729. Accessed 2026-07-08. ↩
  46. European Commission, "General-Purpose AI Code of Practice now available", press release IP/25/1787, 2025-07-10. https://ec.europa.eu/commission/presscorner/detail/en/ip_25_1787. Accessed 2026-07-08. ↩
  47. European Commission, "Meet the Chairs leading the development of the first General-Purpose AI Code of Practice", Shaping Europe's digital future, 2024. https://digital-strategy.ec.europa.eu/en/news/meet-chairs-leading-development-first-general-purpose-ai-code-practice. Accessed 2026-07-08. ↩
  48. Markus Anderljung, post on X (formerly Twitter), 2025-07-10. https://x.com/Manderljung/status/1943271870880522259. Accessed 2026-07-08. ↩
  49. Centre for the Governance of AI, "Allan Dafoe", GovAI Team Page, 2026. https://www.governance.ai/team/allandafoe. Accessed 2026-07-08. ↩
  50. Luca Righetti, "Dual-Use AI Capabilities and the Risk of Bioterrorism: Converting Capability Evaluations to Risk Assessments", Centre for the Governance of AI, 2025. https://www.governance.ai/research-paper/dual-use-ai-capabilities-and-the-risk-of-bioterrorism-converting-capability-evaluations-to-risk-assessments. Accessed 2026-07-08. ↩
  51. Centre for the Governance of AI, "GovAI U.S. AI Policy Program", GovAI Blog, 2026. https://www.governance.ai/post/govai-u-s-ai-policy-program. Accessed 2026-07-08. ↩
  52. Centre for the Governance of AI, "Open Positions", GovAI website, 2026. https://www.governance.ai/opportunities. Accessed 2026-07-08. ↩
  53. John Halstead and Luca Righetti, "Assessing the Risk of AI-Enabled Computer Worms", Centre for the Governance of AI, 2026. https://www.governance.ai/research-paper/assessing-the-risk-of-ai-enabled-computer-worms. Accessed 2026-07-08. ↩
  54. Sam Manning and Tomas Aguirre, "How Adaptable Are American Workers to AI-Induced Job Displacement?", Centre for the Governance of AI, 2026. https://www.governance.ai/research. Accessed 2026-07-08. ↩

Improve this article

Add missing citations, update stale details, or suggest a clearer explanation. Every suggestion is reviewed for sourcing before it goes live.

3 revisions by 1 contributors · full history

Suggest edit