Sources
Additional media
Loading...

VITA Group has released a new report titled 'On The Planning Abilities of OpenAI's o1 Models.' The study by Wang et al. evaluates the feasibility, optimality, and generalizability of OpenAI's o1 models across complex planning and reasoning tasks such as Barman and Floortile. The report highlights the strengths of these models in self-evaluation and constraint-following. However, it also notes that the o1-preview model faces similar qualitative trends as previous large language models (LLMs), particularly in its sensitivity to the probability of certain outcomes.

