Nat Friedman@natfriedman

2 years ago

ARC has been one of the most durable benchmarks; I'm curious to see how much progress this contest generates, and how closely it tracks improvement in general intelligence. https://t.co/i1nOkAZA7F

Guillermo Rauch@rauchg

2 years ago

The recent podcast with @fchollet makes an excellent case for “current-gen LLM architectures don’t lead to AGI”. An LLM is the perfection of @nntaleb’s “intellectual-yet-idiot”. They’ve gotten the most prestigious, most expensive “Ivy League” education on the planet. And… https://t.co/mavrbZQKyB

ARC is cool, and I look forward to the results, but I expect near-term solutions will be: 1) within the span of existing techniques and/or 2) clearly overfit to ARC, thus showing this to be yet another benchmark that seems more general before it's solved than after https://t.co/0MNWqeaSuB