Large language models (LLMs) show a classic Stroop-like conflict effect, pitting automatic habits against rule-based control.
The research
Led by Chandra Sripada at the University of Michigan, researchers tested seven LLMs on a novel verbal conflict task. The prompt asked for a word opposite to a color name, but the model had a strong default to say the same color. In congruent trials, the rule matched the default (e.g., say "red" when the word is "red"); in incongruent trials, they conflicted (e.g., say "blue" when the word is "red"). Results showed six of seven models had strong congruency effects—slower or less accurate responses when rule and habit disagreed—mirroring human performance on the Stroop task. The team used causal attribution, attention analysis, and ablation to identify two pathways: a short-range attention to the color word (favoring congruent trials) and a long-range attention to the rule prefix (favoring incongruent trials). Fine-tuning to strengthen the default habit reduced incongruent performance but boosted congruent performance, while increasing rule set size selectively hurt incongruent trials.
Why it matters
This research bridges cognitive psychology and artificial intelligence, showing LLMs can serve as model systems for studying how the brain resolves conflict between automatic and controlled responses. The findings suggest that congruency effects—long studied in humans—may arise from competition between two learned mappings: one in-weight (default) and one in-context (rule-based). For your own cognition, this highlights that habits and rules often compete, and strengthening one can weaken the other. Understanding this balance can help you design better strategies for learning new skills or breaking old ones.
What you can do
- Practice tasks that require overriding automatic responses, like saying the color of ink rather than reading the word.
- When learning a new rule, be aware that your default habits may interfere; extra practice can help the new rule compete.
- Use brain training games that challenge inhibition and cognitive flexibility to strengthen your mental control.
Source: arXiv q-bio.NC
Curious about your own brain? Take our free adaptive IQ test or try 306 brain training levels.