Gary Marcus, a prominent figure in the AI community, has reiterated his stance that deep learning is encountering significant limitations. In 2022, Marcus stated that deep learning was hitting a wall, and he maintains this view in 2024, emphasizing that it has not yet achieved artificial general intelligence (AGI). The discussion around AGI suggests that while AI can perform superhuman tasks in narrow domains, a universal AGI remains elusive. The future of AI appears to be a 'jagged' landscape with advancements in specific areas but notable gaps in others. Marcus also acknowledges the role of neurosymbolic approaches in AI development.
It is becoming clear that AGI is going to be as jagged as everything else about AI. We will see superhuman ability at narrow tasks happen one by one, with obvious gaps or lags in many others. When a “universal AGI” will happen is unclear, but a Jagged AGI-ish world seems likely.
Is deep learning hitting a wall? :) https://t.co/W9HlFbTT48
Gary Marcus' view: https://t.co/mRrv80SpKK