Home · Blog · Research

Diffusion Models and Brain Circuits: A New Window into How We See

Diffusion Models and Brain Circuits: A New Window into How We See

New research from Zeyu Yun, Alexander Belsten, and colleagues at UC Berkeley bridges artificial intelligence and neuroscience by showing that a simple diffusion model of the primary visual cortex (V1) behaves strikingly like the brain during perception. The model, described in a preprint on arXiv (July 2026), reproduces the structure of horizontal connections in superficial V1 layers—links that connect neurons tuned to similar orientations—and achieves near state-of-the-art denoising performance.

The Research

The team built a recurrent neural network based on sparse coding with a non-factorial prior over latent variables, trained it on natural images using denoising score-matching and implicit differentiation. After training, the learned interaction matrix among latent variables mirrored the pattern of horizontal connections in superficial V1 layers. The model restored extended contours even under extreme visual ambiguity, nearly matching standard black-box diffusion models in generalization. Crucially, the model's simplicity allowed the researchers to decompose its Jacobian in terms of the interaction matrix, revealing how recurrent dynamics assign high probability to natural structural deformations. Moreover, a large fraction of latent variables disconnected from visual input entirely, forming a hierarchical representation that enforces global consistency among image features.

Why It Matters

This work offers a mechanistic understanding of how the brain might perform perceptual inference—filling in missing information from ambiguous input—using recurrent circuits. For machine learning, it demystifies the internal workings of diffusion models, showing how they learn to generate infinitely many novel images from finite data. For you, it suggests that the brain's ability to see coherent objects in noisy environments relies on learned prior expectations wired into neural circuits. This insight underscores the importance of training your visual system through varied experiences to sharpen perception.

What You Can Do

To keep your visual inference sharp, expose yourself to ambiguous stimuli like optical illusions or low-contrast images—your brain will strengthen its internal models. Also, practice drawing or photography to actively engage your visual system in constructing coherent scenes.

Source: arXiv q-bio.NC

Curious about your own brain? Take our free adaptive IQ test or try 306 brain training levels.

Curious about your own IQ?

Take our free, scientifically designed adaptive test across 7 cognitive domains. No signup required.

Take the free test