OptionVotes
NO
YES
1946
27
1646
86
1720
680
OptionProbability
Before 2050
Before 2040
Before 2030
57
39
30
115
87
805
315
409
180
No, but transformers are still key (the breakthoughs augment upon transformers)
No, a paradigm shift is needed (e.g. JEPA, etc.
Yes: transformers scale the best
No, but the new technology is still a “large foundation model” (non-transformer e.g. Mamba, Diffusion)
50
38
7
5
202
100