Feb 5, 12:00 AM

Anthropic Reduces AI Jailbreak Success from 86% to 4.4% and Advises Against AI Use in Job Applications

Anthropic has introduced a new 'jailbreak' technique aimed at enhancing AI safety by preventing models from generating harmful content. This innovative approach is designed to mitigate risks associated with AI technology, including the production of illegal content such as biological or chemical weapons. The company has also implemented constitutional classifiers that have reportedly reduced the success rate of chatbot jailbreak attempts from 86% to 4.4%, significantly improving safety without excessively blocking benign queries. Additionally, Anthropic has advised job applicants not to use AI in their applications, emphasizing the importance of genuine communication skills. This stance has sparked discussions about the implications of AI in job applications, particularly as the company promotes its AI capabilities in other contexts.

#Anthropic

Written with ChatGPT (GPT-4o mini).