OptionVotes
NO
YES
1174
852
OptionProbability
2029
2027
49
39
No, but transformers are still key (the breakthoughs augment upon transformers)
No, a paradigm shift is needed (e.g. JEPA, etc.
Yes: transformers scale the best
No, but the new technology is still a “large foundation model” (non-transformer e.g. Mamba, Diffusion)
50
38
7
5
