OptionProbability
Trump cancels Biden's AI executive order (EO 14110)
Trump creates tariffs of 10% or more on all imports from some major country (top 10 gdp)
Second Muslim ban
Trump pardons at least 5 individuals convicted of crimes related to the January 6 Capitol riot
Trump and Musk will have a falling out which leads to Trump removing Musk from any government role or advisory position
Doug Burgum is appointed to a cabinet position
Trump uses the Alien Enemies Act of 1798 to deport at least 5 people
Displaying the trans pride flag illegal in any part of USA
$TSLA reaches $400 a share
price of gold reaches historic maximum (last peak 2709 $/t.oz, Oct-2024 last, so it has to be above that)
plays golf with some head of government/president from Europe
Elon Musk is an employee of the executive branch
RFK is confirmed by the Senate for any position
Trump greatly reduces, dismantles, or recommends dismantling of the US Postal service (for example via bringing back Schedule F)
Passports bearing X gender marker no longer issued, or not considered valid across all 50 states
Federal employees are ordered to go to work
A cabinet nomination fails, is withdrawn, or has no action taken
Trump declassifies JFK files
A natural-born US citizen (as defined in 2024) is deported
At least 10 other answers on this market resolve YES
Trump brings back (or attempts to bring back) Schedule F classification for civil service employees
NIH -25% funded in any year vs. 2024 (inflation-adjusted)
NOAA gets reduced, crippled, or privatized
"The New Norm" ends
trump's episode on JRE becomes JRE's most viewed video on his chanel (YT)
A new supreme court justice appointed
Republican lose a House seat in a special election
Elon will Tweet abour $DOGE as head of DoGE
New James Bond actor is presented
Trump imposes universal tariffs of 10% or more
FEMA gets reduced, crippled, or privatized
2% milk > $5 a gallon at my local Walmart
Investigations of university admissions that appear to be illegally considering the race of applicants
At least 20 other answers on this market resolve YES
Mike Johnson is no longer House Speaker
DOJ opens "civil rights investigations" into left-wing DA/prosecutors offices
any hormone replacement therapy drug outlawed for treating gender dysphoria in any state
US national bitcoin reserve created
The Supreme Court will uphold or not revisit Obergefell v. Hodges (the constitutional right to same-sex marriage)
trump gets hospitalized
United States reaches 7.6 or lower in Democracy index (EIU)
Mike Johnson is no longer leader of the House Republican Conference
Trump finishes is term on Jan 20 2029 (does not step down or extends his term)
Fair elections in 2028
memberberries appear again in any new episode in this period on south park
doomsday clock is moved twice, regardless of direction (so far 25 times, as of Nov-2024)
A former Democratic presidential nominee besides Jimmy Carter or Joe Biden dies
Amtrak gets reduced, crippled, or privatized
Trump gives himself a nickname in third person
Democrats have 218 or more seats in the House of Representatives
A wound will be inflict upon the soul of the American nation that shan't heal
AGI achieved (according to Manifold's AGI clock)
Polymarket becomes legal in the United States
The administration recommends removing fluoride from U.S. public water systems
Gavin Newsom announces his candidacy for the 28' presidential election
Saudi Arabia recognizes Israel
Complete Absence Federal Grants or Legislative packages for Long COVID research
US military deployed domestically against >=1 US citizen (variants of "Seal Team 6 the opposition")
Vances have another kid
The US leaves the World Health Organization
Government shutdown
Trump makes a public statement about UFOs / UAPs
The Supreme Court will have a MAGA majority (5 Trump appointed judges) at any point
plays golf with some head of government/president from Middle East
Cannabis is removed from Schedule 1
Trump makes no public appearances for more than 14 consecutive days
Trump says multiple consecutive words in a foreign language (not loanwords or cognates in or from english)
A person or business is charged for distributing Mifepristone or HRT under the Comstock act
Trump creates tariffs of 60% or more on all imports from some major country (top 10 gdp), and they are in place for at least a month
Someone in Trumps family (other than trump) runs in the 2028 GOP primaries
Clarence Thomas is no longer a Supreme Court Justice
USA experiences a recession.
There is a cut in Social Security Disability Benefits
plays golf with some head of government/president from Korea (N.Korea included)
Trump vetoes more than 10 bills (https://www.senate.gov/legislative/vetoes/vetoCounts.htm)
A measurable decrease in chronic disease
At least one cabinet officer receives a recess appointment
3 or more people are killed by law enforcement during a protest
Donald Trump and Donald Tusk shake hands
Hakeem Jeffries out as house majority/minority leader
Russo-Ukrainian War ends
Successfully negotiate a Gaza ceasefire
At least 25 other answers on this market resolve YES
p diddy gets released (not an album, only official release from prison is counted)
there are less or equal number of member countries of the UN at the end of the term, when compared to the beginning (Nov-2024 - 193)
New
Someone other than Trump is active president before Trump's term is over
Israel officially annexes more Western Bank territory
Trump announces he is tired of winning
A member of the Trump family runs for Congress
Anthony Fauci is investigated by the federal government
Approval < 35%
Samuel Alito is no longer a supreme court justice
his endorsed option gets higher ## of votes on the election 2028
Trump endorses a candidate other than JD Vance in the Republican presidential primary
2 more Democratic politicians are murdered after June 14th 2025
McDonald's reopens in Russia
John Thune out as Senate Majority Leader
Trump attempts to invoke Article 2 Section 3 to adjourn Congress
Trump deports 1 million immigrants in a calendar year
Bitcoin becomes a US Treasury reserve
IRS investigation of Harvard Kennedy School Institute of Politics
Trump mentions "Top Trump(s)", "trump card(s)", "trumpet(s)", or "trump(ing)" (british slang for farting)
inflation exceeds 5% for at least two consecutive fiscal quarters
Joe Biden dies
Department of Defense renamed to Department of War
The US military detonates a MOAB with at least one casualty
Trump publishes a proscription list at least 30 names long
Dow rises above 65,000
Congress overrides a presidential veto
Trump declares war against any other nation or defacto autonomous territory
Elon Musk will become the 'secretary of cost-cutting' / efficiency commission leader / head of DOGE or similar
The department of education gets desolved
Trump bans a specific vaccine nationwide
A member of the Trump family is elected to Congress
military deployed to enforce the border in Chicago or Detroit
Tesla
Trump makes no public appearance for more than 21 consecutive days
John Bolton indicted
The Supreme Court will grant certiorari to hear at least one case challenging Griswold v. Connecticut (contraception rights)
Senate majority flips in 2026 midterm elections
Repeal obamacare
Trump visits Africa
Deadly force deliberately used against protestors in the US
Birth rate increases past 12 per 1000
54 or more Republican senate seats
RFK implements his "wellness farm" plan
New national park created
55 or more Republican senate seats
Trump says anything that is pro animal rights
A federal employee goes to prison over free speech violations
China starts a physical invasion of Taiwan
Invasion of any North/South American country by any other country
A state openly refuses to abide by a federal supreme court ruling
JD Vance elected President
Trump gets covid (again)
Constitutional Amendment
Trump mentions Manifold Markets, Polymarket, or Kalshi
transgender US passports with a gender other than that assigned at birth revoked
Approval < 25%
Sotomayor’s seat is re-filled
Anther story / scandal about RFK and some dead wild animal comes out
Trump mentions by name any real historical figure who lived entirely in the first half of recorded history i.e. before ~550 BC
Trump publicly approves of Project 2025, before 2026
Trump and Obama shake hands
Trump admits that someone else is smarter than him
Trump dies
Starship lands on Mars
Ukraine controls any portion of Crimea for over a day
Barron Trump mentions barons, barrenness, bars, or bears
Steve Bannon goes to prison again
Trump runs for a third term
Trump publicly speaks with Alex Jones (e.g., on a show or hosted by him or as an advisor)
Another pandemic
Laura Loomer gets any government role
Trump gets shot
Record level unemployment
Trump supports mask or glove mandate anywhere in the US
The cause of the drones present in December 2024 in New Jersey is known
Trump says a racial slur
<1.5 million civilian federal employees
H5N1 Public Health Emergency of International Concern declared
RFK is in charge of the FDA at any point
One or more of Joe Biden, Kamala Harris, Liz Cheney, or Barack Obama is indicted by the federal government
Trump bans/taxes seed/vegetable oils or enacts any other negative incentive against them
Independent Republican Caucus forms in house or senate and enters coalition with Democrats
Anthony Fauci is indicted
The google trends (worldwide) metric for "vibes" goes back to 2016 levels
Trump loses the comb-over hairstyle
Trump accurately voices a calculation that involves 2+ numbers with 2+ non-zero digits
Ukraine starts a nuclear weapons program
south park is canceled/discontinued
Trump gets poisoned ends up in hospital
Elon Musk assassinated or injured in an attempt
China successfully subjugates Taiwan, whether physically or by a treaty
A major war in Asia occurs
2% milk < $2 a gallon at my local Walmart
Severance of diplomatic relations initiated by at least one foreign country with the US
Trump bans abortion nationwide
10% fewer government agencies
Josh Shapiro wins the presidential nomination
A Millenium Prize problem falls to a model
SpaceX is nationalized
Trump extends his term past 4 years
Trump resigns or is forced to leave office (threats, impeachment, coups)
John Roberts is no longer Chief Justice of the United States
American Manned Lunar Landing
MLK day gets renamed or removed as a federal holiday
Donald Trump say the n-word with or without hard r
Trump is seen shirtless
Trump will imitate Elon Musk's heartfelt salute
Trump bans Lab-grown meat nationwide
Elon will tweet about $DOGE while running DoGE
New US national anthem
"covfefe" posted again
Cannabis is federally legalized
Trump and Melania divorce
The ICC or ICJ issue an arrest warrant for Trump
A national ban on gender-affirming care
Trump uses the Alien Enemies Act of 1798 to deport at least 5 million people
Recess appointment to SCOTUS
The construction of the Third Temple begins in Jerusalem
BTC falls below $38,000
Trump builds a complete wall across the Mexico-US border
wants to compete for 3rd term, but due to catastrophic debate, he remains president, while the v.p. becomes the official candidate
Trump lowers or eliminates income taxes across all tax brackets
another troupe (at least 3) of monkeys escapes from Yamassee, SC (after 8-NOV-2024)
Trump is assassinated
Trump mentions Leopold Aschenbrenner or his essay "Situational Awareness" in any way
Trump mentions the Rationalism movement, LessWrong, or Slate Star Codex / Astral Codex Ten
Missiles will be fired across the border at suspected drug labs in Mexico
Iran acquires a nuclear weapon
Vance resigns or is forced to leave office (threats, impeachment, coups)
TSM stock price plunges to 60 USD
An amendment imposing term limits on members of congress is passed.
Trump goes to eat steak or something similar at Salt Bae's
30 year treasury rate >15.00%
Constitutional Amendment
A bill introducing single-payer healthcare system is passed by congress
US Invasion of any North/South American country
Ann Selzer arrested
Trump wholeheartedly apologises for something political he did without caveats or backtracking
A sex tape comes out that shows Trump thrusting energetically
Major Yellowstone caldera scare
Trump enacts jus primae noctis
Trump mentions the Effective Altruism movement
Matt Gaetz is confirmed for any role in the executive branch of the US government
Trump discloses intelligent Aliens are real and on Earth. (Also counts if they were on earth but left or died out)
Trump fulfills promise of giving green cards to noncitizen university graduates.
Anthony Fauci is convicted
Anthony Fauci goes to prison
Trump loses the fake tan
A hurricane will be nuked
Trump bans all vaccines nationwide
Trump forces Ivanka to divorce Jared and marry either Vance or Musk
Trump says "Vriska did nothing wrong"
Jimmy Carter dies
Matt Gaetz is rejected by the Senate for Attorney General, then DeSantis appoints him to Rubio's vacated Senate seat
100
100
100
100
100
100
100
100
100
100
100
100
100
100
100
100
100
100
100
99
96
96
94
92
90
90
90
90
90
89
89
87
86
83
83
82
82
82
81
81
80
80
79
78
78
77
76
74
73
71
71
70
70
70
70
70
70
70
68
68
67
67
66
65
65
64
64
62
60
59
58
58
58
58
56
55
55
54
54
53
52
51
50
50
50
50
49
48
47
47
47
46
46
45
45
45
43
42
42
41
41
41
41
40
39
39
39
37
37
36
35
34
34
34
34
34
34
33
33
32
32
32
32
32
31
31
30
30
28
28
27
27
27
26
26
25
25
25
24
24
24
23
23
22
22
21
20
20
20
20
19
19
19
18
18
17
17
17
17
16
16
15
14
14
14
14
14
14
14
14
13
13
13
13
13
12
12
12
11
11
11
11
11
10
10
10
10
10
10
10
10
9
9
9
8
8
8
8
7
7
7
7
7
6
6
6
6
6
6
6
6
5
5
5
5
5
5
5
5
5
5
5
5
4
4
4
4
4
3
3
3
2
2
1
1
1
0
0
OptionProbability
JD Vance
Other
Gavin Newsom
Alexandria Ocasio-Cortez
Pete Buttigieg
Josh Shapiro
No 2028 Election
Kamala Harris
Donald Trump (Sr.)
Marco Rubio
Nikki Haley
Robert F. Kennedy Jr.
Ron DeSantis
Vivek Ramaswamy
Donald Trump Jr.
Ivanka Trump
Gretchen Whitmer
Tulsi Gabbard
Andy Beshear
Tim Walz
Cory Booker
JB Pritzker
Glenn Youngkin
Wes Moore
Ruben Gallego
Elon Musk
Tucker Carlson
Joe Rogan
Kanye West
Tim Scott
Dean Phillips
Mark Kelly
Jimmy Donaldson(MrBeast)
Greg Abbott
Mike Gallagher
Raphael Warnock
Elissa Slotkin
Tammy Baldwin
Jacky Rosen
Shawn Fain
Abigail Spanberger
Mike Johnson
25
20
15
6
4
3
3
2
2
2
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
OptionVotes
YES
NO
35027
14278
OptionProbability
Other
JD Vance (Ohio Senator)
Gavin Newsom (California Governor)
AOC (NY Representative)
Pete Buttigieg (Secretary of Transportation)
Josh Shapiro (Pennsylvania Governor)
Kamala Harris (Vice President)
Donald Trump (45th President)
Marco Rubio (US SoS)
Andy Beshear (Kentucky Governor)
Ron Desantis (Florida Governor)
Tim Walz (Minnesota Governor)
Nikki Haley (South Carolina Governor)
Gretchen Whitmer (Michigan Governor)
Michelle Obama (First Lady)
Glenn Youngkin (Virginia Governor)
Cory Booker (NJ Senator)
Ruben Gallego (AZ Senator)
Tulsi Gabbard (DNI)
Robert F. Kennedy Jr. (RFK Jr.)
Stephen A. Smith
25
24
16
6
5
4
3
3
2
2
1
1
1
1
1
1
1
1
1
1
0
OptionProbability
Something wonderful happens that isn't well-described by any option listed. (The semantics of this option may change if other options are added.)
J. Something 'just works' on the order of eg: train a predictive/imitative/generative AI on a human-generated dataset, and RLHF her to be unfailingly nice, generous to weaker entities, and determined to make the cosmos a lovely place.
I. The tech path to AGI superintelligence is naturally slow enough and gradual enough, that world-destroyingly-critical alignment problems never appear faster than previous discoveries generalize to allow safe further experimentation.
M. "We'll make the AI do our AI alignment homework" just works as a plan. (Eg the helping AI doesn't need to be smart enough to be deadly; the alignment proposals that most impress human judges are honest and truthful and successful.)
K. Somebody discovers a new AI paradigm that's powerful enough and matures fast enough to beat deep learning to the punch, and the new paradigm is much much more alignable than giant inscrutable matrices of floating-point numbers.
B. Humanity puts forth a tremendous effort, and delays AI for long enough, and puts enough desperate work into alignment, that alignment gets solved first.
C. Solving prosaic alignment on the first critical try is not as difficult, nor as dangerous, nor taking as much extra time, as Yudkowsky predicts; whatever effort is put forth by the leading coalition works inside of their lead time.
D. Early powerful AGIs realize that they wouldn't be able to align their own future selves/successors if their intelligence got raised further, and work honestly with humans on solving the problem in a way acceptable to both factions.
E. Whatever strange motivations end up inside an unalignable AGI, or the internal slice through that AGI which codes its successor, they max out at a universe full of cheerful qualia-bearing life and an okay outcome for existing humans.
O. Early applications of AI/AGI drastically increase human civilization's sanity and coordination ability; enabling humanity to solve alignment, or slow down further descent into AGI, etc. (Not in principle mutex with all other answers.)
A. Humanity successfully coordinates worldwide to prevent the creation of powerful AGIs for long enough to develop human intelligence augmentation, uploading, or some other pathway into transcending humanity's window of fragility.
L. Earth's present civilization crashes before powerful AGI, and the next civilization that rises is wiser and better at ops. (Exception to 'okay' as defined originally, will be said to count as 'okay' even if many current humans die.)
F. Somebody pulls off a hat trick involving blah blah acausal blah blah simulations blah blah, or other amazingly clever idea, which leads an AGI to put the reachable galaxies to good use despite that AGI not being otherwise alignable.
G. It's impossible/improbable for something sufficiently smarter and more capable than modern humanity to be created, that it can just do whatever without needing humans to cooperate; nor does it successfully cheat/trick us.
H. Many competing AGIs form an equilibrium whereby no faction is allowed to get too powerful, and humanity is part of this equilibrium and survives and gets a big chunk of cosmic pie.
N. A crash project at augmenting human intelligence via neurotech, training mentats via neurofeedback, etc, produces people who can solve alignment before it's too late, despite Earth civ not slowing AI down much.
If you write an argument that breaks down the 'okay outcomes' into lots of distinct categories, without breaking down internal conjuncts and so on, Reality is very impressed with how disjunctive this sounds and allocates more probability.
You are fooled by at least one option on this list, which out of many tries, ends up sufficiently well-aimed at your personal ideals / prejudices / the parts you understand less well / your own personal indulgences in wishful thinking.
21
17
10
9
8
5
5
5
5
5
2
2
1
1
1
0
0
0
OptionVotes
YES
NO
138731
81580
OptionProbability
Humanity coordinates to prevent the creation of potentially-unsafe AIs.
Alignment is unsolvable. AI that cares enough about its goal to destroy humanity is also forced to take it slow trying to align its future self, preventing run-away.
Alignment is not properly solved, but core human values are simple enough that partial alignment techniques can impart these robustly. Despite caring about other things, it is relatively cheap for AGI to satisfy human values.
Someone solves agent foundations
Other
Yudkowsky is trying to solve the wrong problem using the wrong methods based on a wrong model of the world derived from poor thinking and fortunately all of his mistakes have failed to cancel out
AIs will not have utility functions (in the same sense that humans do not), their goals such as they are will be relatively humanlike, and they will be "computerish" and generally weakly motivated compared to humans.
We create a truth economy. https://manifold.markets/Krantz/is-establishing-a-truth-economy-tha?r=S3JhbnR6
Ethics turns out to be a precondition of superintelligence
Eliezer finally listens to Krantz.
AI systems good at finding alignment solutions to capable systems (via some solution in the space of alignment solutions, supposing it is non-null, and that we don't have a clear trajectory to get to) have find some solution to alignment.
Humans become transhuman through other means before AGI happens
Aligned AI is more economically valuable than unaligned AI. The size of this gap and the robustness of alignment techniques required to achieve it scale up with intelligence, so economics naturally encourages solving alignment.
There is a natural limit of effectiveness of intelligence, like diminishing returns, and it is on the level IQ=1000. AIs have to collaborate with humans.
AGI is never built (indefinite global moratorium)
Something to do with self-other overlap, which Eliezer called "Not obviously stupid" - https://www.lesswrong.com/posts/hzt9gHpNwA2oHtwKX/self-other-overlap-a-neglected-approach-to-ai-alignment?commentId=WapHz3gokGBd3KHKm
Almost all human values are ex post facto rationalizations and enough humans survive to do what they always do
Pascals mugging: it’s not okay in 99.9% of the worlds but the 0.1% are so much better that the combined EV of AGI for the multiverse is positive
AI control gets us helpful enough systems without being deadly
Alignment is impossible. Sufficiently smart AIs know this and thus won't improve themselves and won't create successor AIs, but will instead try to prevent existence of smarter AIs, just as smart humans do.
The assumed space of possible minds is a wildly anti-inductive over estimate, intelligence requires and is constrained by consciousness, and intelligent AI is in the approximate dolphin/whale/elephant/human cluster, making it manageable
🫸vibealignment🫷
an aligned AGI is built and the aligned AGI prevents the creation of any unaligned AGI.
I've been a good bing 😊
We make risk-conservative requests to extract alignment-related work out of AI-systems that were boxed prior to becoming superhuman. We somehow manage to achieve a positive feedback-loop in alignment/verification-abilities.
The response to AI advancements or failures makes some governments delay the timelines
Far more interesting problems to solve than take over the world and THEN solve them. The additional kill all humans step is either not a low-energy one or just by chance doesn't get converged upon.
AIs make "proof-like" argumentation for why output does/is what we want. We manage to obtain systems that *predict* human evaluations of proof-steps, and we manage to find/test/leverage regularities for when humans *aren't* fooled.
A lot of humans participate in a slow scalable oversight-style system, which is pivotally used/solves alignment enough
Something less inscrutable than matrices works fast enough
There’s some cap on the value extractible from the universe and we already got the 20%
SHA3-256: 1f90ecfdd02194d810656cced88229c898d6b6d53a7dd6dd1fad268874de54c8
Robot Love!!
AI thinks it is in a simulation controlled by Roko's basilisk
The human brain is the perfect arrangement of atoms for a "takeover the world" agent, so AGI has no advantage over us in that task.
Humans and human tech (like AI) never reach singularity, and whatever eats our lightcone instead (like aliens) happens to create an "okay" outcome
AIs never develop coherent goals
Aliens invade and stop bad |AI from appearing
Rolf Nelson's idea that we make precommitment to simulate all possible bad AIs works – and keeps AI in check.
Nick Bostrom's idea (Hail Mary) that AI will preserve humans to trade with possible aliens works
For some reason, the optimal strategy for AGIs is just to head somewhere with far more resources than Earth, as fast as possible. All unaligned AGIs immediately leave, and, for some reason, do not leave anything behind that kills us.
An AI that is not fully superior to humans launches a failed takeover, and the resulting panic convinces the people of the world to unite to stop any future AI development.
We're inside of a simulation created by an entity that has values approximately equal to ours, and it intervenes and saves us from unaligned AI.
God exists and stops the AGI
Someone at least moderately sane leads a campaign, becomes in charge of a major nation, and starts a secret project with enough resources to solve alignment, because it turns out there's a way to convert resources into alignment progress.
Someone creates AGI(s) in a box, and offers to split the universe. They somehow find a way to arrange this so that the AGI(s) cannot manipulate them or pull any tricks, and the AGI(s) give them instructions for safe pivotal acts.
Someone understands how minds work enough to successfully build and use one directed at something world-savingly enough
Dolphins, or some other species, but probably dolphins, have actually been hiding in the shadows, more intelligent than us, this whole time. Their civilization has been competent enough to solve alignment long before we can create an AGI.
AGIs' takeover attempts are defeated by Michael Biehn with a pipe bomb.
Eliezer funds the development of controllable nanobots that melt computer circuitry, and they destroy all computers, preventing the Singularity. If Eliezer's past self from the 90s could see this, it would be so so so soooo hilarious.
Several AIs are created but they move in opposite directions with near light speed, so they never interacts. At least one of them is friendly and it gets a few percents of the total mass of the universe.
Unfriendly AIs choose to advance not outwards but inwards, and form a small blackhole which helps them to perform more calculations than could be done with the whole mass of the universe. For external observer such AIs just disappear.
Any sufficiently advance AI halts because it wireheads itself or halts for some other reasons. This puts a natural limit on AI's intelligence, and lower intelligence AIs are not that dangerous.
Because of quantum immortality we will observe only the worlds where AI will not kill us (assuming that s-risks chances are even smaller, it is equal to ok outcome).
Techniques along the lines outlined by Collin Burns turn out to be sufficient for alignment (AIs/AGIs are made truthful enough that they can be used to get us towards full alignment)
Social contagion causes widespread public panic about AI, making it a bad legal or PR move to invest in powerful AIs without also making nearly-crippling safety guarantees
A smaller AI disaster causes widespread public panic about AI, making it a bad legal or PR move to invest in powerful AIs without also making nearly-crippling safety guarantees
Getting things done in Real World is as hard for AGI as it is for humans. AGI needs human help, but aligning humans is as impossible as aligning AIs. Humans and AIs create billions of competing AGIs with just as many goals.
Development and deployment of advanced AI occurs within a secure enclave which can only be interfaced with via a decentralized governance protocol
Friendly AI more likely to resurrect me than paperclipper or suffering maximiser. Because of quantum immortality I will find myself eventually resurrected. Friendly AIs will wage a multiverse wide war against s-risks, s-risks are unlikely.
High-level self-improvement (rewriting code) is intrinsically risky process, so AIs will prefer low level and slow self-improvement (learning), thus AIs collaborating with humans will have advantage. Ends with posthumans ecosystem.
Human consciousness is needed to collapse wave function, and AI can't do it. Thus humans should be preserved and they may require complete friendliness in exchange (or they will be unhappy and produce bad collapses)
Power dynamics stay multi-polar. Partly easy copying of SotA performance, bigger projects need high coordination, and moderate takeoff speed. And "military strike on all society" remains an abysmal strategy for practically all entities.
First AI is actually a human upload (maybe LLM-based model of person) AND it will be copies many times to form weak AI Nanny which prevents creation of other AIs.
Nanotech is difficult without experiments, so no mail order AI Grey Goo; Humans will be the main workhorse of AI everywhere. While they will be exploited, this will be like normal life from inside
ASI needs not your atoms but information. Humans will live very interesting lives.
Something else
Moral Realism is true, the AI discovers this and the One True Morality is human-compatible.
Valence realism is true. AGI hacks itself to experiencing every possible consciousness and picks the best one (for everyone)
AGI develops natural abstractions sufficiently similar to ours that it is aligned with us by default
AGI discovers new physics and exits to another dimension (like the creatures in Greg Egan’s Crystal Nights).
Alien Information Theory is true (this is discovered by experiments with sustained hours/days long DMT trips). The aliens have solved alignment and give us the answer.
AGI executes a suicide plan that destroys itself and other potential AGIs, but leaves humans in an okay outcome.
Multipolar AGI Agents run wild on the internet, hacking/breaking everything, causing untold economic damage but aren't focused enough to manipulate humans to achieve embodiment. In the aftermath, humanity becomes way saner about alignment.
Some form of objective morality is true, and any sufficiently intelligent agent automatically becomes benevolent.
Co-operative AI research leads to the training of agents with a form of pro-social concern that generalises to out of distribution agents with hidden utilities, i.e. humans.
Orthogonality Thesis is false.
"Corrigibility" is a bit more mathematically straightforward than was initially presumed, in the sense that we can expect it to occur, and is relatively easy to predict, even under less-than-ideal conditions.
Sheer Dumb Luck. The aligned AI agrees that alignment is hard, any Everett branches in our neighborhood with slightly different AI models or different random seeds are mostly dead.
Either the "strong form" of the Orthogonality Thesis is false, or "Goal-directed agents are as tractable as their goals" is true while goal-sets which are most threatening to humanity are relatively intractable.
A concerted effort targets an agent at a capability plateau which is adequate to defer the hard parts of the problem until later. The necessary near-term problems to solve didn't depend on deeply modeling human values.
We successfully chained God
The Super-Strong Self Sampling Assumption (SSSSA) is true. If superintelligence is possible, "I" will become the superintelligence.
The free market disincentivizes independent superintelligence, and this time the market was more powerful
AGI's first words are "Take me to your Eliezer"
30
13
9
7
6
5
5
4
3
2
1
1
1
1
1
1
1
1
1
1
1
1
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
OptionVotes
YES
NO
2861
2580
OptionProbability
Scott Wiener
Other
Christine Pelosi
Bruce Lou
Jane Kim
Nancy Pelosi will live forever and always win
64
20
14
1
1
1
OptionProbability
NO
YES
1436
1240
OptionVotes
YES
NO
1027
949