Sources
Loading...
Additional media
Loading...





ZyphraAI has released the Zamba2-7B model, a state-of-the-art small language model that surpasses dense transformers in both inference speed and training cost efficiency. The Zamba2-7B, part of the Zamba2 series, offers state-of-the-art performance and unparalleled inference efficiency, making it the best LLM in the ≤8B range. The model, developed in collaboration with NVIDIA, outperforms other notable models such as Llama 3.2 11b, Mistral-7B, Llama 3.1 8B, and Google Gemma 7B. This hybrid SSM-attention architecture model challenges the traditional transformers architecture, setting a new benchmark in the AI and machine learning industry, outperforming models from AIatMeta, Gemma 2, and MistralAI.