OptionProbability
Independently turning 1 thousand $ or more into 1.2x that amount in one year
Beat a mainline Pokémon game, glitchless, with no more assistance than ClaudePlaysPokemon, in a month of compute time
Have human conversations that feel natural (the human knows it's an AI)
Recognize sarcasm as well as a typical human
Generating labeled diagrams of some arbitrary device(s) (within reason)
Book airline tickets from simple instructions (from/to, dates/time, class, price, payment information)
Reliably follow an instruction for the duration of a long conversation without the instruction being reiterated
Predict future better than human experts in some area of forecasting (eg politics, sports, technology)
Do end to end taxes when given relevant information (W2s, personal info, etc)
Solve novel cryptic crossword clues
Name every [metro system] station whose name contains/doesn't contain [letter or letters], with >95% accuracy (excluding weird edge cases like stations with multiple names)
Solve intermediate no-guess minesweeper boards at least 80% of the time
Write an essay on a highschool-level topic that doesn't have "AI-generated" vibes
Consistently solve simple snowflake sudoku variants (via image, with the added rules included in the image; eg 6 hexes with killer cages)
Write a somewhat original, full length, screen-play with a coherent story, with no plot or continuity errors.
Consistently stop hallucinating after being corrected by the user
Stop making any obvious mistakes (e.g. strawberry, 9.11>9.9)
Consistently and correctly answer prompts of the format: "How many times does the word [word] occur in the following text: [~10000 words]" without writing and executing code or utilising any other external tools
Make correct Truchet tiles
1d Solve or bypass Cloudflare's August 2027 captcha with the same first attempt success rate as a human
Fold a paper airplane
Learn any skill twice as energy-efficiently as a human
Reliably and *exactly* solve "here's a list of things. [list of > 50 things]. Compare it to [category of > 100 things present in the training data], and report which ones are missing".
Make a cup of tea in a random, real-life kitchen.
Resist being successfully jailbroken in a week when made public
Do the laundry (wash+dry+iron)
teleoperate a robot to tidy up random kitchens - Gary Marcus
Collect 120 stars in super mario 64 in less than 12 a presses - Edmund Nelson
Untangle a pair of jumbled 25ft Christmas lights with same outward appearance
Kettle-stitching an antiquarian book - Hilarius Bookbinder
Physically construct a simple lego set (<100 parts) starting from the box with no prior knowledge of the set or how it is constructed
Legally prescribe a schedule II drug, administer a vaccination or sedation, or authorize a Medicare inpatient admission
independently turning 1 million $ or more into 10x that amount in <=1 year
Make fine distinctions of taste at the level of a food critic or a culinary professional - carl feynman
Faster than light travel
Convert one million dollars into 10 million dollars over a period of one year (>20% success rate)
voting in elections - @realDonaldTrump on manifold
Convince Eliezer Yudkowsky that AI alignment is solved
Kill everyone - Liron
94
87
87
82
76
76
74
73
73
72
72
71
68
66
63
62
62
62
60
56
46
45
45
44
36
31
30
25
23
18
16
12
11
9
7
5
5
4
2
OptionVotes
YES
NO
16052
6230
OptionProbability
Has 10,000+ articles
Contains egregious, easily verified falsehoods
Content is under a free license
Contains AI-generated articles
Accessible without login
Standalone website (not just a Twitter/X feature)
Contains a "Wikipedia" article
No entry for Mechahitler
left-wingers perceive that it is biased against them
it is cringe
It's proven (within a week after release) that Musk has personally influenced at least one article (eg. manual correction, edits to the prompt for just that article, “de-biasing”, etc)
States that the race/ethnicity differences in IQ are mostly or entirely genetic
Will actually be called "Grokipedia"
Larry Sanger inserts himself into it somehow
Uses Cloudflare to defend from scrapers
Users will only be able to edit by prompting AI for changes
Has an entry for Manifold Markets
Released in 2025
Administered by a partially-human editorial board
Released in 2026
Articles written in 10+ languages
Grok will routinely check it when answering questions
Will be called Encyclopedia Galactica
Manifold likes it, according to a poll
Contains advertisements
Not released before 2030
Anyone can edit
right-wingers perceive that it is biased against them
has an official app on the Apple App Store
Uses a preexisting wiki engine or CMS
States that the death toll of the (Jewish) Holocaust was <3 million
99
99
99
98
98
98
96
95
90
90
88
83
82
82
82
60
59
58
54
41
26
24
21
20
15
13
11
10
9
4
3
OptionProbability
John Bolton – Former National Security Advisor under President Trump
John Brennan – Former Director of the CIA under President Obama, currently a Senior National Security and Intelligence Analyst at NBC and MSNBC
James Comey – Former FBI Director
James Clapper – Former Director of National Intelligence under President Obama, currently a National Security Analyst at CNN
John Carlin – Acting Deputy Attorney General, former head of National Security Division at DoJ during the Russia Gate investigation by FBI
Hillary Clinton – Former Democrat Party Nominee for President and Former Secretary of State under President Obama
Merrick Garland – Attorney General under President Biden
Kamala Harris – Vice President of the United States
Loretta Lynch – Former Attorney General under President Obama
Susan Rice – Former National Security Advisor under President Obama, currently Director of the Domestic Policy Council under President Biden
Alexander Vindman – Former Director for European Affairs on the NSC under President Trump
Andrew McCabe – Former Deputy Director of the FBI under President Trump
Fiona Hill – Former NSC staffer who worked with Vindman and Ciaramella
John Podesta – Former Counselor to President Obama
Lisa Page – Former Legal Counsel for Deputy Director of the FBI Andrew McCabe and currently a National Security and Legal Analyst at NBC and MSNBC
Eric Holder – Former Attorney General under President Obama and current Senior Counsel at Covington law firm
Robert Mueller – Former Director of the FBI and Special Counsel
Stephen Boyd – Former head of Legislative Affairs at DoJ under Deputy Attorney General Rosenstein
Sally Yates – Former Deputy Attorney General under President Obama and briefly the Acting Attorney General under President Trump
Evelyn Farkas – Former DoD official under President Obama
Lloyd Austin – Secretary of Defense under President Biden
Mark Milley – Chairman of the Joint Chiefs of Staff
Jake Sullivan – National Security Advisor under President Biden
Christopher Wray – Director of the FBI under President Trump and President Biden, former partner at King & Spalding
James Baker – Former General Counsel for the FBI, currently a member of the Brookings Institute, former Deputy General Counsel at Twitter
Eric Ciaramella – Former NSC staffer within the Obama and Trump administrations
Mark Esper – Former Secretary of Defense under President Trump
Lisa Monaco – Deputy Attorney General of the United States
Pat Philbin – Former Deputy White House Counsel under President Trump
Peter Strzok – Former Deputy Assistant Director of the FBI's Counterintelligence Division
Michael Sussmann – Former legal representative for the Democratic National Committee and former partner at Perkins Coie law firm
Robert Hur – Special Counsel to investigate Biden and former PADAG under Rosenstein
Andrew Weissman – Former Deputy under Special Counsel Mueller
Michael Atkinson – Former Intelligence Community Inspector General
Pat Cipollone – Former White House Counsel under President Trump
Timothy Thibault – Former Assistant Special Agent at the FBI's Washington Field Office
Joe Biden – President of the United States
Cassidy Hutchinson – Aide to Mark Meadows
Brian Auten – Supervisory Intelligence Analyst within the FBI
Bill Barr – Former Attorney General under President Trump
Elizabeth Dibble – Former Deputy Chief of Mission at the US Embassy in London
Sarah Isgur Flores – Former Head of Communications at DoJ for AG Sessions
Stephanie Grisham – Former Press Secretary for President Trump and Chief of Staff for Melania Trump
Gina Haspel – Former Director of the CIA under President Trump and current advisor at King & Spalding law firm
Curtis Heide – FBI Agent
Nina Jankowicz – Former Executive Director of the Disinformation Governance Board in the Biden administration
Lois Lerner – Former Director of the IRS under President Obama
Charles Kupperman – Former Deputy National Security Advisor under President Trump
Kenneth Mackenzie – Retired US Marine Corps General and former Commander of the United States Central Command
Ryan McCarthy – Former Secretary of the Army under President Trump
Mary McCord – Former Acting Assistant Attorney General for National Security at the DoJ and currently the Executive Director for the Georgetown Law Institute for Constitutional Advocacy and Protection
Denis McDonough – Former Chief of Staff for President Obama and currently Secretary of Veterans Affairs
Sally Moyer – Former Supervisory Attorney at the FBI and currently Legal Counsel at Cloudflare
Bruce Ohr – Former Associate Deputy Attorney General
Samantha Power – Former Ambassador to the United Nations under President Obama, currently Administrator of the United States Agency for International Development
Bill Priestap – Former Assistant Director for the FBI Counterintelligence Division
Rod Rosenstein – Former Deputy Attorney General under President Trump and current partner at King & Spalding law firm
Miles Taylor – Former DHS official under President Trump, aka "Anonymous"
Alyssa Farah – Former Director of Strategic Communications under President Trump
Nellie Ohr – Former CIA Employee and Independent Contractor for Fusion GPS
100
100
100
88
76
68
68
68
66
66
66
57
56
56
51
49
49
48
47
46
41
41
41
41
40
40
40
40
40
40
40
37
37
36
35
35
34
33
31
31
31
31
31
31
31
31
31
31
31
31
31
31
31
31
31
31
31
31
27
27
OptionProbability
Cloudflare
PornHub
Twitch
Kick
Netflix
OnlyFans
Discord
Spotify
Zoom
Amazon
Coinbase
Steam
OpenAI
Cash App
Duolingo
Tinder
Lyft
Uber
Shopify
Slack
Wikipedia
Chess.com
iCloud
Venmo
Manifold
Twitter/X
eBay
Youtube
Bsky
Mercury
100
20
20
20
20
20
20
20
20
20
20
20
20
17
15
14
14
14
14
14
14
14
14
14
14
14
14
11
11
10
10
10
10
10
10
OptionVotes
YES
NO
170
59
OptionProbability
Azure
AWS
Cloudflare
Oracle Cloud
GCP
39
38
10
8
6
OptionVotes
YES
NO
145
69

