A landmark study provides the first empirical evidence that an AI system can pass the Turing test—the classic benchmark of machine intelligence proposed by Alan Turing in 1950. Researchers from UC San Diego found that GPT-4.5, when given a specific persona prompt, was judged to be human 73% of the time, outperforming actual human participants.
The Research
Published in the Proceedings of the National Academy of Sciences, the study by Cameron Jones and colleagues tested four AI systems: GPT-4.5, LLaMa-3.1-405B, GPT-4o, and the 1960s chatbot ELIZA. Human interrogators held text conversations with two entities—one human, one AI—and tried to identify the human. With a persona prompt that encouraged natural fallibility, GPT-4.5 achieved a 73% deception rate, while LLaMa-3.1-405B reached 56%. Without prompting, GPT-4.5’s success dropped to 36%. Older models like GPT-4o and ELIZA were judged human only 21% and 23% of the time, respectively. The study included two independent participant groups: UC San Diego undergraduates and online volunteers, with conversations lasting 5 or 15 minutes.
Why It Matters
These findings challenge our understanding of human uniqueness. The AI succeeded not by displaying superior intelligence, but by mimicking human imperfections—making mistakes, using casual tone, and showing humor. As coauthor Ben Bergen noted, the models “won by exhibiting natural human fallibilities.” This raises practical concerns about online deception and social engineering. For cognitive science, it reveals that personality traits we consider uniquely human, like fallibility, can be algorithmically reproduced. Understanding this helps us appreciate the subtle cues that define genuine human interaction.
What You Can Do
To sharpen your ability to detect AI vs. human, practice paying attention to conversational depth and emotional consistency. Engage in critical discussions about AI’s role in society. And remember: your own cognitive strengths—like empathy and context awareness—remain hard to fake.
Source: Neuroscience News
Curious about your own brain? Take our free adaptive IQ test or try 306 brain training levels.
