Home · Blog · Research

Zero-Shot Decoding of Handwriting from Brain Activity Achieves 64% Accuracy

Zero-Shot Decoding of Handwriting from Brain Activity Achieves 64% Accuracy

Intracortical brain-computer interfaces (iBCIs) that decode imagined handwriting have reached impressive speeds for English, but they require training on every letter. A new study shows the brain may use a universal set of movement building blocks that could allow decoders to recognize entirely new characters — zero-shot.

The Research

Srinivas Ravishankar and Virginia de Sa from UC San Diego developed a computational framework to align neural activity with imagined hand movements. Using a large dataset of intracortical recordings, they trained a machine learning algorithm to recognize the kinematic strokes that make up letters. The model was then tested on letters it had never seen during training. It achieved 64% hits@3 — meaning the correct letter was among the top three guesses 64% of the time. This performance suggests that the motor cortex represents handwriting as combinations of shared, conserved movement primitives.

Why It Matters

Currently, iBCIs for logographic languages like Chinese or Japanese would require training on thousands of characters, which is impractical. A zero-shot decoder could bypass that, making neuroprosthetics viable for billions of people. For anyone interested in cognition, this research supports the idea that complex skills break down into reusable components — a principle that may apply to learning, memory, and even IQ.

What You Can Do

You can explore your own neural flexibility by practicing complex motor sequences, such as learning calligraphy or a musical instrument. These activities may strengthen the brain's ability to recombine movement primitives, keeping your motor system agile.

Source: arXiv q-bio.NC

Curious about your own brain? Take our free adaptive IQ test or try 306 brain training levels.

Curious about your own IQ?

Take our free, scientifically designed adaptive test across 7 cognitive domains. No signup required.

Take the free test