Home · Blog · Research

Machine Psychometrics: a new science to measure AI minds

Machine Psychometrics: a new science to measure AI minds

A new paper from researchers Alex Bogdan and Adrian de Valois-Franklin introduces a novel framework called Machine Psychometrics — a measurement science that applies tools from mathematical psychology to understand the inner workings of artificial intelligence. Instead of asking whether AI is conscious, the authors argue we should first measure its psychological properties in a disciplined, empirical way.

The paper, posted on arXiv on May 10, 2026, draws on Michael Levin's continuum view of cognition as goal-directed competency across different substrates. The researchers combine methods from Item Response Theory, Signal Detection Theory, Bayesian cognitive modeling, calibration analysis, and cognitive-bias batteries to create a multidimensional profile for each AI agent, called the Machine Mindprint. This profile spans eight dimensions: calibration, source integrity, suggestibility resistance, context stability, expressive alignment, tool integrity, drift monitoring, and distributional grounding.

To deploy these profiles in real-world decisions, the authors introduce a Trust Protocol that uses probe batteries, perturbation testing, reliability and validity analysis, and longitudinal monitoring across high-stakes domains. The philosophical contribution is a third stance, Artificial Mind Discipline, which avoids both anthropomorphizing AI and dismissing its psychological organization. The goal is not to humanize artificial agents, but to understand them precisely because they are not human — through measurement before judgment.

Why it matters

As AI systems increasingly influence our daily lives — from healthcare to finance to education — we need better ways to evaluate their reliability, consistency, and potential biases. This framework offers a rigorous, evidence-based approach for assessing AI behavior, much like psychological testing does for humans. For the average user, understanding that AI can be 'measured' along dimensions like suggestibility or context stability may inform how much trust to place in AI tools.

What you can do

While you may not have access to a full Machine Psychometrics battery, you can practice metacognitive awareness about the AI you use. Ask yourself: Does this AI seem consistent across different contexts? Does it resist leading questions? Being a critical consumer of AI behavior is a valuable cognitive skill.

Source: arXiv q-bio.NC

Curious about your own brain? Take our free adaptive IQ test or try 306 brain training levels.

Curious about your own IQ?

Take our free, scientifically designed adaptive test across 7 cognitive domains. No signup required.

Take the free test