
The ARC-AGI challenge, a benchmark for evaluating artificial general intelligence (AGI) proposed by François Chollet, has seen significant progress. Jack Cole's team recently achieved a new high score of 38% on the private Kaggle leaderboard, surpassing the previous record of 34%. The challenge, which includes a $1 million prize pool, aims to reach 85% accuracy to be considered solved. Notable contributions include a 50% score on the public test set by Redwood Research using GPT-4o and a 60% score on the public test set by a heterogenous ensemble. Ryan and his coworker achieved state-of-the-art (SOTA) performance on the train set. The ARC-AGI benchmark remains a critical measure of human-like general fluid intelligence, with ongoing efforts to improve performance through innovative methods and computational techniques.
In just one week, the 2023 ARC Prize high score has officially been broken on the private Kaggle leaderboard. Now at 38%. Congrats @Jcole75Cole and team! (And we are working with @RyanPGreenblatt to validate his high score for the separate public leaderboard) https://t.co/bZSHi1BIHB
New ARC-AGI SOTA solution - 38% @Jcole75Cole and team absolutely crushing it I *believe* this is using active inference (test time fine-tuning) Reminder that prizes require that solutions be open sourced by the end of the competition https://t.co/DXSvoDuTW1 https://t.co/nGZkrdP9Ud
New ARC-AGI high score! 38% (Prize goal: 85%) Congratulations, MindsAI! https://t.co/iFTeEVaGci


