Jan 20, 05:02 PM

Aya Expanse Named Best Open-Weights Model on Scale AI's Protocol, Outperforming Proprietary and Larger Models in Multilingual Performance

Aya Expanse has been recognized as the best open-weights model on Scale AI's private multilingual protocol. The model reportedly outperforms proprietary models, larger models, and those developed by more researchers with greater infrastructure in certain languages. Additionally, private evaluations indicate that Aya Expanse demonstrates strong multilingual performance despite being a smaller model. There are ongoing discussions in the AI community regarding the effectiveness of current benchmarking methods, with some experts suggesting that traditional benchmarks may not accurately reflect the capabilities of modern models. The need for new benchmarks that account for randomized or generated models is also emphasized, as current benchmarks may not fully capture the practical performance of these systems.

#Aya Expanse #Scale AI

Written with ChatGPT (GPT-4o mini).