Where would legitimate authority come from?
Agreement among participating organizations creates one relationship. Public authority over risks borne by everyone requires an additional account of representation, authorization, and rights.
SIRDA editorial hypothesis
A founding process can combine explicit accession by participating organizations with independently selected representation of people exposed to the risks. Legitimacy can be tested through accountable selection and removal of officials, rights of challenge, and public authorization of limited powers. This hypothesis fails if the regulated actors' agreement is the institution's entire basis for claiming authority over others.
0 objections ยท View challenges
Challenges to the editorial hypothesis
No published objections yet.
The argument
A constitution has to say who establishes it, whose interests it represents, and who can change or end its authority. These questions apply before a proposed institution makes its first binding decision. Direct accession by developers can supply commitments among signatories; a separate process must address people who never signed but bear the consequences.
The inquiry will compare representation mechanisms, appointment rules, public participation, and protections for minorities. Representation has to remain meaningful when the technically informed actors also control much of the funding and infrastructure. A statement that an institution serves humanity leaves those choices unresolved.
Legitimacy and effectiveness are separate tests. A widely accepted procedure might lack practical influence, while a powerful infrastructure coalition might have little public authorization. The founding design needs an account of both, together with how affected people obtain reasons and challenge decisions.
How to test it
Give proposed founding arrangements to participants representing developers, infrastructure operators, affected communities, smaller research groups, and people outside the initial coalition. Ask who authorizes each power and who can remove its holders. Trace whether one constituency can privately control representation for the others.
Related Ecosystem
- 80,000 Hours
- Ada Lovelace Institute
- AI 2027
- AI 2040
- AI Futures Project
- AI Now Institute
- AI Safety Asia
- AI Safety Camp
- AI Safety Guide
- AI X-risk Research Podcast
- Alan Turing Institute
- Algorithmic Justice League
- All Tech Is Human
- Allan Dafoe
- Americans for Responsible Innovation
- Andrea Miotti
- AVERI
- Aza Raskin
- Ben Garfinkel
- BlueDot Impact
- Center for AI and Digital Policy
- Center for AI Safety
- Center for Human-Compatible AI
- Center for Humane Technology
- Center for Security and Emerging Technology
- Centre for Long-Term Resilience
- Centre for the Governance of AI
- Centre for the Study of Existential Risk
- Collective Intelligence Project
- Concordia AI
- Connor Leahy
- ControlAI
- Dan Hendrycks
- Daniel Kokotajlo
- Daniela Amodei
- Dario Amodei
- Demis Hassabis
- DoD Chief Digital and AI Office
- Dwarkesh Patel
- Dwarkesh Podcast
- EA Forum
- Eliezer Yudkowsky
- European AI Office
- EuroSafeAI
- Existential Risk Observatory
- FLI AI Safety Index - Summer 2026
- Forethought
- Future of Life Institute
- Future of Life Institute Podcast
- Geoffrey Hinton
- Global Partnership on Artificial Intelligence
- Helen Toner
- Holden Karnofsky
- Humane Intelligence
- IEEE Standards Association AI
- Independent International Scientific Panel on AI
- Institute for AI Policy and Strategy
- Institute for Law & AI
- ISO/IEC JTC 1/SC 42
- Jack Clark
- Lennart Heim
- LessWrong
- Leverhulme Centre for the Future of Intelligence
- Machine Intelligence Research Institute
- Macrostrategy Research Initiative
- MAGIC - Multinational AGI Consortium
- Markus Anderljung
- Max Tegmark
- Metaculus
- Metagov
- Microsoft AI
- Miles Brundage
- Nate Soares
- Nick Bostrom
- NIST AI
- NTI | bio (Nuclear Threat Initiative)
- OECD.AI
- Oxford Institute for Ethics in AI
- Partnership on AI
- PauseAI
- RAND Corporation AI
- Responsible AI Institute
- Rethink Priorities
- Rob Bensinger
- Rob Miles
- Robert Wiblin
- Safe AI Forum
- SaferAI
- Sam Altman
- Stanford Institute for Human-Centered AI
- Stop Killer Robots
- Stuart Russell
- The 80,000 Hours Podcast
- The Cognitive Revolution
- The Future Society
- Toby Ord
- Tristan Harris
- WEF AI Governance Alliance
- Yi Zeng
- Yoshua Bengio
- Your Undivided Attention
Required expertise
Kinds of expertise this question draws on, and active Ecosystem organizations already tagged with a matching area. A tag match is not a ranking.
- Collective governance
- Metagov
- Deliberative governance
- Metagov
- International institutional design
- Institute for Law & AI
- Public participation & democratic legitimacy
- Center for Humane Technology
Related questions
- Who resolves a dispute when powerful participants disagree?
- How would this institution relate to existing states?
- Does drafting an AI model's constitution substitute for this institution's jurisdiction?
- Can the implementers prevent capture, including their own collusion?
- What rights would affected parties retain?
- How can decisions reach actors who never joined?
- What evidence would count against creating the institution?
Related failure conditions
Discussed in
Contributions
No published contributions yet.