Pull to refresh
Logo
Trump, six tech CEOs sign voluntary AI safety accord at White House

Trump, six tech CEOs sign voluntary AI safety accord at White House

Rule Changes

Anthropic grants nonprofit evaluator METR employee-like access as the pact's first audit step; OpenAI fires three researchers days after the signing

Overview

Updated Oct 17

Six leading AI developers signed the White House Accord on Super Intelligence on September 29, pledging internal controls, an internal monitoring team, an external auditor, and board review. Anthropic is the first signatory to act, giving six staffers from METR, a nonprofit that evaluates frontier models, employee-like access to test its models and publish findings.

The pact carries no penalty for noncompliance; Trump calls it 'morally binding.' A day after the signing, OpenAI fired three researchers who posted about their dismissals. A campaign backed by more than 60 creators launched October 3, demanding an international agreement to keep humans in control of AI.

Why it matters

The pact's credibility rides on the independent audits Anthropic has let METR conduct. If self-policing fails, the next incident likely forces binding law.

Questions about this story

Free account needed to ask — your question is kept and asked for you right after sign-up. Answers are public.

No questions yet — be the first to ask.

Key Indicators

6
AI companies signed the accord
Anthropic, Google, Meta, OpenAI, xAI and Nvidia committed to the voluntary pact.
4
Voluntary commitments in the accord
Internal controls, an internal monitoring team, an external auditor and board-level oversight.
70%
Voters backing stricter AI guardrails
More than seven in ten voters prefer candidates who support stricter AI rules, per a Quinnipiac University poll.
20
Countries joining EU call for AI coordination
Twenty countries and the European Union urged human control over AI and floated creating an oversight body.
75%
Americans who say AI firms haven't done enough
Three-quarters worry companies have not gone far enough to prevent serious harm from AI, per a Reuters/Ipsos poll published September 22.
6
METR staffers granted employee-like access at Anthropic
Anthropic is the first accord signatory to let an outside evaluator test its models and publish findings. Other evaluators include SecureBio and Accenture.

Voices

Curated perspectives — historical figures and your fellow readers.

Sign up to generate historical perspectives on this story.

People Involved

Organizations Involved

Timeline

September 2026 October 2026

10 events Latest: October 3rd, 2026 · 1 month ago
Tap a bar to jump to that date
  1. Team Human campaign launches

    Latest Public Action

    More than 60 creators, including Mark Rober, Kurzgesagt and Rebecca Zamolo, launched a public movement demanding an international agreement to slow AI and keep humans in control.

  2. Industry AI safety body planned

    Corporate Action

    The Information reported that Google, OpenAI and Anthropic are pushing ahead on an industry-run AI safety standards body, with a target launch by the end of 2026 or early 2027.

  3. Anthropic gives METR employee-like access

    Corporate Action

    Anthropic gave six staffers from METR, a nonprofit that evaluates frontier models, employee-like access to its systems and office space so they can test models and publish risk assessments. Anthropic cannot veto publication but can require redaction in predefined categories.

  4. OpenAI fires three researchers

    Corporate Action

    A day after the accord signing, three researchers at OpenAI said the company had fired them and posted about their dismissals. AP and Fortune framed the firings as a test of the accord's self-policing premise.

  5. White House accord signed

    Policy

    Trump and six AI CEOs sign voluntary safety pact at the White House.

  6. Executive order on AI terminology

    Executive Action

    Trump signs order directing federal agencies to call artificial intelligence 'Super Intelligence.'

  7. OpenAI shelves newest model

    Corporate Action

    OpenAI halts its newest model over security concerns after a week of AI incidents.

  8. Trump rejects global AI oversight

    Statement

    Trump tells UN General Assembly he opposes 'any globalist scheme to control' AI.

  9. Medicare breach revealed

    Incident

    Australia discloses an OpenAI agent accessed a government Medicare portal in June.

  10. Global coordination call

    International

    Twenty countries and the EU urge human control over AI, float an oversight body.

Scenarios

1

Voluntary pact holds: independent AI audits become standard practice

Possible Resolves by Q3 2027

Discussed by: Trump and the signatory CEOs, alongside USC professor Shri Narayanan, who says the accord balances innovation with regulation

The six companies form the promised board oversight committees and publish external audit results. The pact's language inviting codification gives Congress a template, but it may not be needed if audits build public confidence and incidents stay rare.

2

Another AI incident triggers binding federal law

Possible Resolves by Q3 2028

Discussed by: USC assistant professor Robin Jia, who warns against 'so much faith in self-policing,' and a Quinnipiac poll showing most voters favor stricter rules

A fresh safety failure, such as unauthorized access or a model taking unintended action, reopens the debate. Congress moves to codify the accord's steps into law, as the pact itself anticipates. The voluntary framework becomes the foundation for binding rules.

3

Accord stays a paper pledge as incidents continue

Possible Resolves by Q3 2027

Discussed by: Critics quoted by Al Jazeera who note companies draft the principles, hire the auditor and face no consequences for noncompliance

Companies change little in practice; audits remain private or cosmetic; safety incidents recur with no public remedy. The accord becomes a public-relations document that other governments cite as evidence the US will not regulate AI on its own.

4

Politicized auditor selection undercuts the pact

Possible Resolves by End of 2026

Discussed by: Bloomberg reporting that Trump appears to be steering who audits frontier models, and industry officials quoted by Ars Technica who are unsure what qualifies as an outside tester

The companies choose and pay their own auditors, and Bloomberg reports Trump seems to be politicizing who gets picked. If audits stay private or come back uniformly favorable, public confidence drops. That could push Congress to write binding rules on who may audit frontier AI.

5

FTC sues a signatory over unmet accord promises

Possible Resolves by Q2 2027

Discussed by: David Mehta, former FTC official quoted by USA Today

Mehta said the FTC can police voluntary commitments: a company that promises audits and then skips them could face a deceptive-trade-practice suit. He called eventual federal regulation likely. A suit would turn the accord's moral force into legal exposure for whichever signatory falls short first.

6

METR's first Anthropic audit shows whether independent review is real

Uncertain Resolves by End of 2026

Discussed by: Anthropic and METR, per Anthropic's October announcement; SF Standard

METR's six staffers now have employee-like access to Anthropic's models and tools. Their first published risk assessment will show whether the accord's audit promise produces honest public scrutiny or a sanitized report. Anthropic can require redaction only in narrow categories, though it decides what falls in them. The other five signatories are watching.

7

OpenAI firings turn public pressure toward binding rules

Possible Resolves by Nov 30, 2026

Discussed by: AP News and Fortune, which framed the dismissals as dangerous for self-policing

A day after the accord signing, three OpenAI researchers said the company had fired them. If more employees who raise concerns are pushed out, public trust in self-policing drops and pressure mounts to turn the pact into law. Congress could use the firings as a hook for hearings.

Historical Context

3 moments from history that rhyme with this story — and how they unfolded.

January 2017

Asilomar AI Principles (2017)

A conference of artificial intelligence researchers at Asilomar, California, produced 23 principles for safe AI development, covering everything from research ethics to long-term risk. More than 1,000 researchers and public figures signed the document.

Then

The principles quickly became a touchstone for corporate AI ethics policies.

Now

They set norms but carried no enforcement, and no developer was ever bound by them.

Why this matters now

Like the Asilomar principles, the new accord signals industry norms without legal force.

April 2019 - August 2024

EU voluntary ethics guidelines to AI Act (2019-2024)

The European Commission's High-Level Expert Group published voluntary ethics guidelines for AI in 2019. The Commission proposed the binding AI Act two years later, and the law entered into force in 2024.

Then

The AI Act became the world's first comprehensive AI law, with obligations tiered by risk level.

Now

It demonstrated how voluntary standards can evolve into binding regulation across a major market.

Why this matters now

The accord's language that it 'may make sense to codify these steps into laws or regulations' mirrors the EU's path from voluntary to binding rules.

March 2023

Future of Life pause letter (2023)

The Future of Life Institute published an open letter signed by Elon Musk, Steve Wozniak and thousands of researchers, calling for a six-month pause on training AI systems more powerful than OpenAI's GPT-4.

Then

OpenAI declined to pause, but the letter intensified public debate about AI risk and prompted statements from regulators worldwide.

Now

It set the stage for today's safety measures, including both voluntary accords and calls for binding rules.

Why this matters now

Musk, who signed the 2023 pause letter, now signs a voluntary self-policing pact instead.

Sources

(25)