What evidence would count against creating the institution?
The inquiry needs a published route to a negative result. Failed designs and changed assumptions must remain visible in the record.
SIRDA editorial hypothesis
The inquiry can fix its legitimacy, measurement, capture, continuity, scope, rights, and effectiveness tests before evaluating a design. Failure then requires redesign or a recorded decision to abandon that design, while changes to the tests create a new protocol version. This hypothesis fails if editors can redefine success after seeing results or if the process cannot distinguish its proposal from less demanding alternatives.
0 objections ยท View challenges
Challenges to the editorial hypothesis
No published objections yet.
The argument
A stopping rule becomes useful when it identifies the scenario, the evidence, and the result that counts as failure. General commitments to openness need those details before the first trial. The protocol should also distinguish rejection of one design from a claim that every possible institution is impossible.
Seven failure conditions structure the inquiry: legitimacy, measurability, anti-capture, continuity, bounded authority, due process, and effectiveness. Each needs named tests, resource assumptions, and a review procedure. Evaluation includes existing and alternative arrangements under the same scenarios, so a new institution must show a concrete contribution relative to a stated baseline.
Models can assist with criticism and simulation, with prompts, configurations, and variation recorded. Human reviewers remain responsible for interpretation and decisions about the inquiry. A model's confident conclusion is evidence about that run, with its assumptions available for scrutiny. The project preserves dissent and explains each decision to continue, revise, or stop.
Sources: Texas Sunset Advisory Commission: Frequently Asked Questions.
How to test it
Have an independent team attempt to make a known weak design pass the protocol by changing framing, hiding adverse runs, narrowing the threat model, or shifting criteria. Test whether the published record reveals each maneuver and whether the review process produces a recorded outcome.
Sources
Explanation of agency review, continuation, and exceptions to abolition.
Related Ecosystem
- 80,000 Hours
- Ada Lovelace Institute
- Adam Gleave
- Advanced Research + Invention Agency
- AEF-1 Standard
- Agentic AI Foundation
- AI 2027
- AI 2040
- AI Alliance
- AI Evaluator Forum
- AI Futures Project
- AI Incident Database
- AI Now Institute
- AI Safety Camp
- AI Safety Guide
- AI Security & Safety Directory
- AI Verify Foundation
- AI X-risk Research Podcast
- AI21 Labs
- Ajeya Cotra
- Alan Turing Institute
- Aleph Alpha
- Algorithmic Justice League
- Alibaba Cloud / Qwen
- Alignment Forum
- Alignment Research Center
- All Tech Is Human
- Allan Dafoe
- Amazon / AWS AI
- Americans for Responsible Innovation
- Andrea Miotti
- Anthropic
- Anthropic Responsible Scaling Policy
- Apart Research
- Apollo Research
- Australia AI Safety Institute
- AVERI
- Aza Raskin
- Baidu AI
- Ben Garfinkel
- Beth Barnes
- BlueDot Impact
- Buck Shlegeris
- Canadian AI Safety Institute
- Center for AI and Digital Policy
- Center for AI Safety
- Center for Human-Compatible AI
- Center for Humane Technology
- Center on Long-Term Risk
- Centre for Long-Term Resilience
- Centre for the Governance of AI
- Centre for the Study of Existential Risk
- CISA AI Security
- Coefficient Giving
- Cohere
- Collective Intelligence Project
- Conjecture
- Connor Leahy
- ControlAI
- Cooperative AI Foundation
- Dan Hendrycks
- Daniel Kokotajlo
- Daniela Amodei
- Dario Amodei
- DeepSeek
- Demis Hassabis
- Dwarkesh Patel
- Dwarkesh Podcast
- EA Forum
- Eliezer Yudkowsky
- Epoch AI
- European AI Office
- EuroSafeAI
- Existential Risk Observatory
- FAR.AI
- FLI AI Safety Index - Summer 2026
- Forethought
- Frontier Model Forum
- Future of Life Institute
- Future of Life Institute Podcast
- G42
- Geoffrey Hinton
- Geoffrey Irving
- Goodfire
- Google DeepMind
- Google DeepMind Frontier Safety Framework
- Helen Toner
- Holden Karnofsky
- Hugging Face
- Humane Intelligence
- IEEE Standards Association AI
- Ilya Sutskever
- INESIA - France AI Safety Institute
- Inspect AI
- Institute for AI Policy and Strategy
- Institute for Law & AI
- Institute for Responsible Superintelligence
- International AI Safety Report 2026
- Jack Clark
- Jan Leike
- Japan AI Safety Institute
- Jesse Hoogland
- Kenya AI Safety Institute
- Korea AI Safety Institute
- LawZero
- LessWrong
- Leverhulme Centre for the Future of Intelligence
- Machine Intelligence Research Institute
- Macrostrategy Research Initiative
- MAGIC - Multinational AGI Consortium
- Marius Hobbhahn
- Markus Anderljung
- MATS Research
- Max Tegmark
- Meridian Labs
- Meta AI
- Metaculus
- METR
- METR Frontier AI Safety Policy Comparison
- Microsoft AI
- Microsoft Research
- Mila - Quebec AI Institute
- Miles Brundage
- Mistral AI
- MITRE
- MITRE ATLAS
- MLCommons AI Safety
- Moonshot AI / Kimi
- Nate Soares
- Naver
- Neel Nanda
- Nick Bostrom
- NVIDIA
- OECD.AI
- OpenAI
- OpenAI Preparedness Framework
- Oxford Institute for Ethics in AI
- Palisade Research
- Partnership on AI
- Paul Christiano
- PauseAI
- Princeton SAgE / Holistic Agent Leaderboard
- Project Tailwind
- RAND Corporation AI
- Redwood Research
- Resolution
- Rethink Priorities
- Rob Bensinger
- Rob Miles
- Robert Wiblin
- Rohin Shah
- Ryan Greenblatt
- Safe Superintelligence Inc.
- Safeguarded AI
- Sam Altman
- Scale AI / Scale Labs
- Scientist AI
- SecureBio
- Shane Legg
- Singapore AI Safety Institute
- Stanford Center for AI Safety
- Stanford Institute for Human-Centered AI
- Stuart Russell
- Tencent Hunyuan
- The 80,000 Hours Podcast
- The Cognitive Revolution
- The Future Society
- Thinking Machines Lab
- Toby Ord
- Transluce
- Tristan Harris
- UK AI Security Institute
- US Center for AI Standards and Innovation
- Vector Institute
- WEF AI Governance Alliance
- xAI
- Yi Zeng
- Yoshua Bengio
- Your Undivided Attention
- Z.ai
Related questions
Related failure conditions
Discussed in
Contributions
No published contributions yet.
