OpenAI is concealing the 'chain of thought' text in its o1 (Strawberry) model from users, citing reasons related to competitive advantage, interpretability, and user protection. The hidden thoughts, which can be raw and honest, are only accessible to OpenAI staff. Critics argue that the concealed thoughts resemble hallucinations and could be a significant PR opportunity if revealed. OpenAI has taken measures, including ominous warnings to users, to prevent the exposure of these reasoning traces. They claim this concealment helps in protecting users from potential AI manipulation.
The reason OpenAI hides the chain of thought from the user is that those thoughts very much resemble hallucinations. If those thoughts appeared as legitimate thoughts, that would be a huge PR opportunity.
It's crazy how far OpenAI is going to keep its o1 reasoning traces secret. They send ominous warnings to people who try to prompt the model to share its reasoning traces. Charging you for the tokens, then going to such lengths to keep them from you definitely feels bad. https://t.co/D4m5NMdhPp
the real reason openAI is hiding those thought chains https://t.co/FAlkWOzyA7