OptionVotes
NO
YES
1921
51
1646
86
1928
630
805
315
409
180
215
47
OptionProbability
No, but transformers are still key (the breakthoughs augment upon transformers)
No, a paradigm shift is needed (e.g. JEPA, etc.
Yes: transformers scale the best
No, but the new technology is still a “large foundation model” (non-transformer e.g. Mamba, Diffusion)
46
35
11
7