Mar 12, 08:02 AM

Apple's M3 Ultra 512GB Mac Studios with 1TB Memory Power DeepSeek R1, Achieving Up to 18.43 Tokens Per Second with 671 Billion Parameters

Apple has provided early access to two maxed-out M3 Ultra 512GB Mac Studios for testing ahead of their public release. Users are utilizing these machines to run the DeepSeek R1 model, which features 671 billion parameters and operates at 8 bits. The setup includes a Thunderbolt 5 interconnect capable of 80 Gbps, allowing for efficient processing. Initial tests indicate that the system can run at speeds of approximately 11 to 18.43 tokens per second, with a theoretical maximum of around 20 tokens per second. The DeepSeek R1 model has gained recognition as the leading open-source large language model (LLM) six weeks post-launch, with various users showcasing its capabilities, including real-time animation generation using p5.js.

#Apple #M3 Ultra #Mac Studios #DeepSeek R1

Written with ChatGPT (GPT-4o mini).

Sources

Additional media

Image #1 for story apple-s-m3-ultra-512gb-mac-studios-1tb-memory-power-deepseek-r1-achieving-up-to-50ab4c58

Image #2 for story apple-s-m3-ultra-512gb-mac-studios-1tb-memory-power-deepseek-r1-achieving-up-to-50ab4c58