Artificial intelligence may learn language better when it forgets — just like humans. A new proof-of-principle study shows that giving a neural network a human-like memory limitation actually boosts its ability to learn grammar from limited data.
The Research
Researchers Abishek Thamma (University of Amsterdam) and Micha Heilbron (Max Planck Institute for Psycholinguistics) designed “fleeting memory transformers” that integrate memory decay and a short-term echoic buffer of only 3 to 7 words. They trained these models on the BabyLM benchmark, a dataset scaled to match the amount of language a human child hears during development. Compared to standard Transformers, the fleeting memory models achieved better language modeling performance and stronger results on tests of syntactic knowledge — even though they had less access to past text. The key mechanism: by forgetting exact word forms, the AI was forced to compress information and focus on recurring grammatical patterns.
Why It Matters
For anyone curious about their own learning, this study highlights a paradox: forgetting isn’t always a bug; it can be a feature. Human memory limits — like our short-term echoic buffer — may actually help us extract abstract rules from language. The same principle could apply to how we learn new skills or facts: instead of trying to remember every detail, allowing some information to fade might help the brain build stronger, more generalizable knowledge. This research also shows how insights from human cognition can inspire better AI designs, making machines more efficient learners.
What You Can Do
To leverage your brain’s natural memory constraints, try “spaced repetition” when studying: review material at increasing intervals, letting some details fade between sessions. Focus on understanding underlying rules rather than memorizing specifics. And when learning a language, practice in short bursts — your echoic memory works best with just a few words at a time.
Source: Neuroscience News
Curious about your own brain? Take our free adaptive IQ test or try 306 brain training levels.
