OptionVotes
NO
YES
2436
734
1450
153
1595
627
1803
555
1123
890
291
34
OptionProbability
No, a paradigm shift is needed (e.g. JEPA, etc.
No, but transformers are still key (the breakthoughs augment upon transformers)
Yes: transformers scale the best
No, but the new technology is still a “large foundation model” (non-transformer e.g. Mamba, Diffusion)
48
41
6
4
205
49
160
63
149
73
1035
976
120
83