OptionVotes
YES
NO
7748
3856
1075
815
279
241
OptionProbability
Yes
No
Other
54
23
41
No, but transformers are still key (the breakthoughs augment upon transformers)
No, a paradigm shift is needed (e.g. JEPA, etc.
Yes: transformers scale the best
No, but the new technology is still a “large foundation model” (non-transformer e.g. Mamba, Diffusion)
51
37
7
5
100
Below 0.6
0.06 - 0.07
0.07 - 0.08
0.08 - 0.09
0.09 - 0.10
Above 0.10
17