Read News

Generating labeled diagrams of some arbitrary device(s) (within reason)

Beat a mainline Pokémon game, glitchless, with no more assistance than ClaudePlaysPokemon, in a month of compute time

Do end to end taxes when given relevant information (W2s, personal info, etc)

Independently turning 1 thousand $ or more into 1.2x that amount in one year

Book airline tickets from simple instructions (from/to, dates/time, class, price, payment information)

Have human conversations that feel natural (the human knows it's an AI)

Solve novel cryptic crossword clues

Recognize sarcasm as well as a typical human

Write an essay on a highschool-level topic that doesn't have "AI-generated" vibes

Name every [metro system] station whose name contains/doesn't contain [letter or letters], with >95% accuracy (excluding weird edge cases like stations with multiple names)

Predict future better than human experts in some area of forecasting (eg politics, sports, technology)

Write a somewhat original, full length, screen-play with a coherent story, with no plot or continuity errors.

Solve intermediate no-guess minesweeper boards at least 80% of the time

Reliably follow an instruction for the duration of a long conversation without the instruction being reiterated

Consistently solve simple snowflake sudoku variants (via image, with the added rules included in the image; eg 6 hexes with killer cages)

Consistently stop hallucinating after being corrected by the user

Fold a paper airplane

Learn any skill twice as energy-efficiently as a human

Reliably and *exactly* solve "here's a list of things. [list of > 50 things]. Compare it to [category of > 100 things present in the training data], and report which ones are missing".

Make correct Truchet tiles

teleoperate a robot to tidy up random kitchens - Gary Marcus

1d Solve or bypass Cloudflare's August 2027 captcha with the same first attempt success rate as a human

Consistently and correctly answer prompts of the format: "How many times does the word [word] occur in the following text: [~10000 words]" without writing and executing code or utilising any other external tools

Resist being successfully jailbroken in a week when made public

Make a cup of tea in a random, real-life kitchen.

Do the laundry (wash+dry+iron)

Stop making any obvious mistakes (e.g. strawberry, 9.11>9.9)

Kettle-stitching an antiquarian book - Hilarius Bookbinder

Untangle a pair of jumbled 25ft Christmas lights with same outward appearance

Physically construct a simple lego set (<100 parts) starting from the box with no prior knowledge of the set or how it is constructed

Make fine distinctions of taste at the level of a food critic or a culinary professional - carl feynman

independently turning 1 million $ or more into 10x that amount in <=1 year

Legally prescribe a schedule II drug, administer a vaccination or sedation, or authorize a Medicare inpatient admission

Collect 120 stars in super mario 64 in less than 12 a presses - Edmund Nelson

Convince Eliezer Yudkowsky that AI alignment is solved

Convert one million dollars into 10 million dollars over a period of one year (>20% success rate)

Kill everyone - Liron

voting in elections - @realDonaldTrump on manifold

YES

YES

NO

YES

NO

NO

YES

YES

NO

YES

NO