OpenAI has introduced a groundbreaking technique to better understand the internal workings of its GPT-4 language model. By employing sparse autoencoders, the company has successfully identified 16 million interpretable features within GPT-4. This advancement allows researchers to disentangle the model's internal representations, offering a more transparent view of how the AI processes information. The new method scales better than previous approaches and has been praised for its potential to enhance AI interpretability. Additionally, GPT-4 has surpassed human performance in theory of mind tasks. This development comes amid criticisms of OpenAI's superalignment team, which has recently been disbanded.