Transformer architecture News

What will be true of the SOTA AI on the FrontierMath benchmark, before 2027?

Nov 11, 11:53 PMJan 1, 4:59 AM

233866

OptionProbability

Transformer-based architecture

Over 1T parameters

Developed by OpenAI

Part of the GPT-N family of models (GPT-5, GPT-6, and variations)

Developed by Google Deepmind

Energy-based Model (https://en.wikipedia.org/wiki/Energy-based_model)

Developed by a non-British and non-American company

Based on Symbolic AI (https://en.wikipedia.org/wiki/Symbolic_artificial_intelligence)

Part of the AlphaProof family of models (AlphaProof N and variations)

Part of the o1 family of models (o1, o2, etc. and variations)

Narrow domain of knowledge. ie Does not know random facts such as when Google was founded, or who won the 1960 presidential election.

2030 – 3. Over one hundred thousand humanoid robots will be deployed in the real world.

Mar 11, 12:08 AMDec 31, 10:59 PM

79.08%chance

382747

OptionVotes

YES

1720

680

What will be true of the SOTA AI on the FrontierMath benchmark, before 2028?

Nov 11, 11:53 PMJan 1, 4:59 AM

122492

OptionProbability

Over 1T parameters

Transformer-based architecture

Developed by OpenAI

Part of the GPT-N family of models (GPT-5, GPT-6, and variations)

Developed by Google Deepmind

Narrow domain of knowledge. ie Does not know random facts such as when Google was founded, or who won the 1960 presidential election.

Developed by Anthropic

Part of the AlphaProof family of models (AlphaProof N and variations)

Developed by a non-British and non-American company

Part of the o1 family of models (o1, o2, etc. and variations)

Energy-based Model (https://en.wikipedia.org/wiki/Energy-based_model)

Based on Symbolic AI (https://en.wikipedia.org/wiki/Symbolic_artificial_intelligence)

What will be true about the first AGI that becomes accessible to everyone? [ADD MORE]

Apr 24, 12:58 PMMar 22, 10:59 PM

372059

OptionProbability

Runs entirely on silicon-based non-quantum machines

The existence of the AGI and the model name were leaked prior to release and official announcement

Developed by a US company

Trained with synthetic data and self-play

Doomsday clock moved at least one full minute closer to midnight due to this AI

Transformer based or mix of Transformer and other architectures

Has an internal World Model able to simulate basic physics without external tools

Not available in EU countries initially for the first 4 months after public release

Based on/inspired by algorithms from the human brain (beyond neural networks).

Public announcement was made after 1 year or more of finishing training

Not a static model; weights change during inference

Used by a Figure humanoid robot

Infinite context window

Solves at least one of the seven Millennium Problems

This market will resolve N/A

Based on/inspired by OpenAI's Sora (resolves YES if explicitly stated by developers in announcement or paper)

Is OpenAI's GPT-6, whatever name or architecture it has

No consensus that it's AGI until over a month after being announced and interacting with people outside the lab.

Developed by a Chinese company

Open sourced

Developed by the open-source community instead of a company

Developed by an EU company

Is OpenAI's GPT-5, whatever name or architecture it has

Will the first AGI be a transformer model?

Jan 1, 4:54 PMDec 31, 6:59 PM

71.43%chance

161309

OptionVotes

YES

1007

205

Will the transformer architecture be replaced in SOTA LLMs by 2028?

Dec 26, 8:37 PMJan 1, 10:59 PM

54.33%chance

21752

OptionVotes

YES

1155

804

What Will Be the Next Big Tech Industry Hype Cycle Thing After GPT-Enabled LLM's?

Mar 12, 6:40 PMDec 1, 5:59 AM

19463

OptionProbability

Robots

Some As of Early 2024 Not Even Published Yet Architecture as Revolutionary as Transformers was in 2017

Synthetic Biology / Genetic Engineering: For example, developing new vaccines, engineering proteins for sustainable fabric production, developing cell-cultured meats, plant-based meat alternatives, and engineering human immune cells.

Quantum Computing

Will the most capable, public multimodal model at the end of 2027 in my judgement use a transformer-like architecture?

Nov 17, 9:50 AMJan 1, 10:59 PM

63.05%chance

10372

OptionVotes

YES

232

Will early transformative AIs primarily use text?

Oct 2, 2:57 PMOct 10, 6:59 AM

54%chance

12264

OptionVotes

YES

156

141

Will transformer architectures lose their dominant position in deep learning before 2028?

Jan 20, 9:04 PMDec 31, 11:59 PM

14.84%chance

6155

OptionVotes

YES

240

Will the first robotic AGI be developed using a transformer-like architecture?

Mar 19, 8:15 AMJan 2, 7:59 AM

30.58%chance

8140

OptionVotes

YES

231

163

Will the next neural network architectural discovery explicitly incorporate some kind of self-reflection?

Apr 18, 9:56 PMJan 2, 4:59 AM

44.35%chance

438

OptionVotes

YES

156

126

Transformer architecture News

Prediction markets for Transformer architecture

Prediction markets for Transformer architecture

Prediction markets for Transformer architecture

What will be true of the SOTA AI on the FrontierMath benchmark, before 2027?

2030 – 3. Over one hundred thousand humanoid robots will be deployed in the real world.

What will be true of the SOTA AI on the FrontierMath benchmark, before 2028?

What will be true about the first AGI that becomes accessible to everyone? [ADD MORE]

Will the first AGI be a transformer model?

Will the transformer architecture be replaced in SOTA LLMs by 2028?

What Will Be the Next Big Tech Industry Hype Cycle Thing After GPT-Enabled LLM's?

Will the most capable, public multimodal model at the end of 2027 in my judgement use a transformer-like architecture?

Will early transformative AIs primarily use text?

Will transformer architectures lose their dominant position in deep learning before 2028?

Will the first robotic AGI be developed using a transformer-like architecture?

Will the next neural network architectural discovery explicitly incorporate some kind of self-reflection?

Latest stories