Bindu Reddy@bindureddy

2 years ago

Livebench AI is fast becoming the go to benchmark to evaluate LLMs for real world problems You can’t game it because we change the questions every month For instance, step-2 seems unexpectedly performant and as good as Sonnet and o1! We will know when we evaluate it in the… https://t.co/VnOJbnjfQn

Fraction AI@FractionAI_xyz

2 years ago

This is amazing! Benchmarks evolving is super necessary. Otherwise people can just train their models to perform on selected benchmarks and fake competence. Kudos to Livebench AI https://t.co/LlE6oCWkbR

AI For Humans Show@AIForHumansShow

2 years ago

Deepseek's new reasoning engine is SUPER interesting and worth a try... most interesting you get to see how the AI is thinking and just how surprised the AI is to discover the third 'r' in Strawberry. link to @deepseek_ai's model below... https://t.co/utunYyyyXR