W&B Weave@weave_wb

2 years ago

We’re excited to see HAL released! 🎉 With W&B Weave powering logging and cost tracking, you can easily understand the performance and cost trade-offs when running agent evaluations. 🚀 https://t.co/tDrRH9vKBd

Arvind Narayanan@random_walker

2 years ago

Really proud of the work by @benediktstroebl @sayashk and many others that went into this. We think HAL could bring a lot of efficiency and clarity to the confusing mess that is AI agent evaluation. Check it out ➤ https://t.co/CmElEQ0QJm https://t.co/HAG1mYhR49 https://t.co/XgchjJDHOl

How expensive are the best SWE-Bench agents? Do reasoning models outperform language models? Can we trust agent evaluations? 📢 Announcing HAL, a Holistic Agent Leaderboard for evaluating AI agents, with 11 benchmarks, 90+ agents, and many more to come. https://t.co/394naRGfGD