AI models’ written reasoning steps correspond to distinct internal patterns, a new study finds
Can the distinct reasoning steps a language model shows in its text output also be found in its internal states? A new study put it to the test.
When a reasoning model solves a task step by step, it does different things along the way: reading data, breaking down the problem, retrieving a formula, running a calculation. Researchers at South Korea’s KAIST and Naver AI Lab wanted to know whether those reasoning steps can also be separated from one another inside the model’s numerical representations. They can, and the signal is strongest in the middle layers. The team defined eight recurring reasoning operations, including extraction, decomposition, formula recall, deduction, and computation. They had three models (Qwen2.5-7B, Qwen3-8B, and Gemma4-31B) solve math problems, split the solution paths into segments, and then used GPT-5 to label each segment with one of those operations. Reasoning steps are clearly separable inside the model The different reasoning operations can be reliably told apart in the models’ internal representations, and this holds across all three models tested. The separation peaks in the middle layers. The researchers checked whether simple word choice could account for the effect. A classifier that only looked at the tokens used performed worse than one analyzing internal representations. Position within the solution path didn’t explain it either. That means the internal states carry information about the type of reasoning step that goes beyond surface-level wording. Same words, different representations depending on the reasoning step Common function words like “a,” “is,” or “the” show up across very different reasoning steps. In the early layers, their representations are still jumbled together, but by the middle and later layers they separate according to the surrounding operation. The same word gets a different internal representation depending on which reasoning step it belongs to. The researchers also tested whether a reasoning step forms in isolation.
