OptionVotes
NO
YES
1941
31
1646
86
1928
630
OptionProbability
Before 2050
Before 2040
Before 2030
57
39
30
805
315
409
180
No, but transformers are still key (the breakthoughs augment upon transformers)
No, a paradigm shift is needed (e.g. JEPA, etc.
Yes: transformers scale the best
No, but the new technology is still a “large foundation model” (non-transformer e.g. Mamba, Diffusion)
51
37
7
5
215
47
100