Aug 12, 01:41 AM

Google Launches Gemma Scope on Gemma 2 with 7B, 9B, 27B Sparse Autoencoders

Google has introduced Gemma Scope, a new suite of Open Sparse Autoencoders Everywhere All At Once on the Gemma 2 platform. This development focuses on sparse autoencoders, an unsupervised method for learning a sparse decomposition of a neural network's latent representations into interpretable features. The suite includes models such as Gemma 2 7B, 9B, and 27B, which have been trained and evaluated for their performance. The initiative aims to provide a more open and accessible framework for developing and understanding neural network models.

#Google #Gemma Scope #Gemma

Written with ChatGPT (GPT-4o).