May 14, 01:06 AM

ByteDance Unveils Seed1.5-VL With 532M Vision Encoder; Qwen3 Scores 62 AI Index; DeepSeek Advances AI Hardware Efficiency

ByteDance has introduced Seed1.5-VL, a vision-language model featuring a 532 million parameter vision encoder paired with a 20 billion active parameter Mixture-of-Experts (MoE) large language model. Seed1.5-VL achieves state-of-the-art results on 38 out of 60 public vision-language model benchmarks, outperforming OpenAI's CUA and Anthropic's Claude 3.7 in tasks such as GUI control and gameplay. The model is designed to be efficient enough to run on laptops, exemplifying advances in compact yet powerful AI architectures. Concurrently, the Qwen3 model family has been released, with the largest Qwen3 235B-A22B model scoring 62 on the Artificial Analysis Intelligence Index, marking it as the most intelligent open-weight model to date. The Qwen3 series excels in reasoning, coding, and multilingual tasks, with an efficient MoE design but currently lacks vision support. Additionally, the startup DeepSeek, led by founder Liang Wenfeng, has gained attention for its innovative approach to AI development despite U.S. restrictions on Chinese AI technology. DeepSeek's recent paper on scaling challenges and hardware architecture reveals the use of 2048 H800 GPUs for training, employing FP8 precision with less than 0.25% accuracy loss and achieving a training cost per token of 250 GFLOPS, significantly lower than the 2.45 TFLOPS required for a dense 405 billion parameter model. The company also introduced Multi-head Latent Attention, which reduces the key-value cache size to 70 KB per token, compared to LLaMA-3.1's cache, which is seven times larger. These developments highlight ongoing advancements in AI model efficiency and hardware optimization in both Chinese and global AI research communities.

#ByteDance #OpenAI #CUA #Anthropic #Claude #Qwen3 #Artificial Analysis Intelligence Index #MoE #DeepSeek #Liang Wenfeng #Chinese #LLaMA

Written with ChatGPT (GPT-4).

Sources

Additional media

Image #1 for story bytedance-unveils-seed1-5-vl-532m-vision-encoder-qwen3-scores-62-ai-index-ai-25c280fb

Image #2 for story bytedance-unveils-seed1-5-vl-532m-vision-encoder-qwen3-scores-62-ai-index-ai-25c280fb

Image #3 for story bytedance-unveils-seed1-5-vl-532m-vision-encoder-qwen3-scores-62-ai-index-ai-25c280fb

Image #4 for story bytedance-unveils-seed1-5-vl-532m-vision-encoder-qwen3-scores-62-ai-index-ai-25c280fb

Image #5 for story bytedance-unveils-seed1-5-vl-532m-vision-encoder-qwen3-scores-62-ai-index-ai-25c280fb

Image #6 for story bytedance-unveils-seed1-5-vl-532m-vision-encoder-qwen3-scores-62-ai-index-ai-25c280fb

Image #7 for story bytedance-unveils-seed1-5-vl-532m-vision-encoder-qwen3-scores-62-ai-index-ai-25c280fb

Image #8 for story bytedance-unveils-seed1-5-vl-532m-vision-encoder-qwen3-scores-62-ai-index-ai-25c280fb

Image #9 for story bytedance-unveils-seed1-5-vl-532m-vision-encoder-qwen3-scores-62-ai-index-ai-25c280fb

Image #10 for story bytedance-unveils-seed1-5-vl-532m-vision-encoder-qwen3-scores-62-ai-index-ai-25c280fb

Image #11 for story bytedance-unveils-seed1-5-vl-532m-vision-encoder-qwen3-scores-62-ai-index-ai-25c280fb

Image #12 for story bytedance-unveils-seed1-5-vl-532m-vision-encoder-qwen3-scores-62-ai-index-ai-25c280fb

Image #13 for story bytedance-unveils-seed1-5-vl-532m-vision-encoder-qwen3-scores-62-ai-index-ai-25c280fb

Image #14 for story bytedance-unveils-seed1-5-vl-532m-vision-encoder-qwen3-scores-62-ai-index-ai-25c280fb