Good Fire AI Open-Sources Sparse Autoencoders (SAEs) for Llama 3.1 8B and Llama 3.3 70B https://t.co/mkhCgaA5Dq #AIAdvancements #SparseAutoencoders #LLaMA #MachineLearning #GoodFireAI #ai #news #llm #ml #research #ainews #innovation #artificialintelligence #machinelearning #t… https://t.co/gnB6fCzXlr

Marktechpost AI Research News ⚡@Marktechpost

2 years ago

Good Fire AI Open-Sources Sparse Autoencoders (SAEs) for Llama 3.1 8B and Llama 3.3 70B Good Fire AI’s SAEs are designed to enhance the efficiency of Meta’s LLaMA models, focusing on two configurations: LLaMA 3.3 70B and LLaMA 3.1 8B. Sparse Autoencoders leverage sparsity…

Rohan Paul@rohanpaul_ai

2 years ago

New open source SAE (Sparse Autoencoder) for model steering, including the first ever SAE for Llama 3.3 70b Aimed at decoding the internal representations of Llama models. With a focus on layer 50 of Llama 3.3-70B, it identifies 121 sparse activations (L0 count), breaking down… https://t.co/9sTTMSOe8D