Sources
Matthew BarnettWhile I appreciate this study, I'm also a bit worried its headline result is misleading—it only measures performance on a narrow set of software tasks. As of March 2025, AIs still can't handle 15-minute robotics or computer-use tasks, despite what the headline plot might suggest. https://t.co/idkZNJpL21
Rohan PaulBRILLIANT Paper. 💡 Practical Meaning If this pace holds, AI might soon handle larger coding or research tasks without constant oversight. 📈 Observed Trend Researchers compare model success rates on tasks against the hours expert humans need. The longest tasks current models https://t.co/U8mKNRyv6W
Ray WangMeasuring AI Ability to Complete Long Tasks https://t.co/jqwleTZpvN https://t.co/OadL5Stxvt
Additional media








