Sources
Chelsea Sierra Voss
don’t miss this part of today’s 12th Day of OpenAI: “Deliberative Alignment,” exciting work by the illustrious @MelodyGuan et al! the technique achieves a Pareto improvement over previous approaches such as RLHF, and reduces overrefusals! https://t.co/la6zthJaQP
Lisan al Gaib Along with the o3 announcement OpenAI also dropped a cute little paper: "Deliberative Alignment: Reasoning Enables Safer Language Models" The paper introduces a new training approach for LLMs called "Deliberative Alignment." This method teaches the model safety specifications… https://t.co/iN1lukfbJq https://t.co/B9DPd0DbsE
Eric Wallace Chain-of-thought reasoning provides a natural avenue for improving model safety. Today we are publishing a paper on how we train the "o" series of models to think carefully through unsafe prompts: https://t.co/nnll4K6usQ…
Additional media
