DeepNewz, mobile.
People-sourced. AI-powered. Unbiased News.
Download on the App Store
Screenshot of DeepNewz app showing story detail view.
Jun 26, 12:58 AM
UC Santa Cruz Researchers Develop Efficient AI Models Running at 13 Watts by Eliminating Matrix Multiplication
Sustainability
Tech
Environment
AI

UC Santa Cruz Researchers Develop Efficient AI Models Running at 13 Watts by Eliminating Matrix Multiplication

Authors
  • Ars Technica
  • Slashdot
  • DataCamp
13

Researchers from UC Santa Cruz and partners have developed a groundbreaking approach to operating AI language models by eliminating matrix multiplication. This innovative method promises to reduce power consumption and operational costs significantly while maintaining performance. Traditional large language models (LLMs) rely heavily on matrix multiplication, which strains GPUs. The new custom architecture achieves similar performance with smaller models, leading to more efficient and sustainable AI operations. This advancement could revolutionize the AI industry by making AI models more eco-friendly and cost-effective. AI chatbots can now run at a lightbulb-esque 13 watts with no performance loss.

Written with ChatGPT (GPT-4o).

Additional media

Image #1 for story uc-santa-cruz-researchers-develop-efficient-ai-models-running-13-watts-matrix