OpenAI researchers show small doses of “beneficial trait” training make AI models broadly safer and harder to manipulate
OpenAI researchers show that reinforcement learning on desired behavioral traits like truthfulness and corrigibility works across domains. Training on health data also improved deception detection, and the model scored better on 44 out of 53 benchmarks.
The approach differs from Anthropic’s constitution-based method.
