Rohan Paul@rohanpaul_ai

2 years ago

Wild Paper from @GoogleDeepMind, @Intel and @GeorgiaTech Multiplication-Less LLM training - Reduces memory usage by over 80% for OPT-66B and LLaMA-2-70B models. The Problem 🔍: Existing LLM efficiency methods still rely on costly multiplications, and reparameterization… https://t.co/SaBsr6dplp

Sentients@Sentientslive

2 years ago

This development not only pushes the boundaries of what's possible with model compression but also opens up new avenues for deploying high-performance AI models in resource-constrained environments. #Sentients #AI #LLAMA #optimization #LLMs #MachineLearning @nvidia @NVIDIAAIDev https://t.co/v0h0k7C0S9

Sumanth@Sumanth_077

2 years ago

A few years ago, running large models like Llama3 70B on an RTX 3090 was just a dream. Today, it's a reality! Introducing AQLM + PV-Tuning: the best algorithm for 2-bit quantization yet in terms of quality It compresses the Llama 13B model down to an effective size of 6.9B https://t.co/bNmxWOFVlq