Google's updated Gemini 1.5 Pro and Flash models have achieved significant rankings in the AI leaderboard. The Gemini 1.5 Pro model now ranks second overall, closing in on GPT-4, and tops the Chinese and French leaderboards. The Gemini 1.5 Flash model ranks ninth, outperforming notable models such as Llama-3-70B. These models offer lower cost and latency, making them advantageous for developers. The Flash model ties with Opus in coding, longer query, and Chinese categories. The Pro model has shown significant improvement since its April version, while the Flash model is noted for its speed and capability.
The performance of Gemini 1.5 Flash is the real takeaway. It's priced roughly similar to Claude Haiku, but in this leaderboard it's performing better than Claude Sonnet. https://t.co/zNiXe4O69d
We released an updated Gemini 1.5 Pro at IO, and a super fast yet capable Flash model. They're both very strong models, on LMSys the 1.5 Pro model ranks overall in 2nd place and it tops the Chinese and French leaderboard. On a personal note, the 1.5 series are the first LLMs… https://t.co/wnuTJ1yFz3
Gemini 1.5 Flash is so strong. https://t.co/B0A2Er6sEZ