OptionVotes
NO
YES
1862
538
2380
283
OptionProbability
Intermediate scenario
No such statement before 2030
Optimistic scenario
Pessimistic scenario
56
29
11
4
No, but transformers are still key (the breakthoughs augment upon transformers)
No, a paradigm shift is needed (e.g. JEPA, etc.
Yes: transformers scale the best
No, but the new technology is still a “large foundation model” (non-transformer e.g. Mamba, Diffusion)
46
35
7
