Have you ever noticed that when you make a decision, your confidence seems to hinge on the reasons that support it, while ignoring contradictory evidence? This common experience has been dubbed “detection-like” confidence. A new paper by Wiktoria Kozyra, Kevin O’Neill, and Stephen M. Fleming, published on arXiv, reveals that this pattern isn't a cognitive bias — it's a rational consequence of operating in high-dimensional spaces, where many possible alternatives exist.
The Research
Researchers at University College London used signal detection theory, a framework for how we make decisions under uncertainty, to model confidence. They showed that when a decision involves many possible alternatives (high-dimensional space), Bayesian confidence estimates naturally become more sensitive to evidence that supports the chosen option. This effect arises from a nonlinearity: confidence is normalized by the number of unchosen alternatives. In their analysis, they found that this detection-like confidence is rational when the decision-maker considers more hypotheses than the experimenter assumes.
They extended their findings to artificial systems. Convolutional neural networks (CNNs) also exhibit stronger positive evidence biases when operating in higher-dimensional spaces, linking the signal detection theory to confidence behavior in AI. This suggests a universal principle: as complexity grows, confidence becomes more one-sided.
Why It Matters
Understanding this mechanism helps us interpret our own confidence. When we feel sure about a choice, it’s not necessarily because we’re ignoring counterarguments — it’s a natural consequence of considering many possibilities. This insight can improve how we evaluate our own judgment. Instead of second-guessing our confidence as biased, we can recognize it as a rational adaptation to complexity. It also highlights the importance of considering multiple hypotheses deliberately, as that can modulate our confidence.
What You Can Do
When making a significant decision, try to explicitly list alternatives and evidence both for and against each. This practice can help you calibrate your confidence and make more informed choices. Remember, your gut feeling is a rational response to a complex world — just ensure you’ve considered enough options.
Source: arXiv q-bio.NC
Curious about your own brain? Take our free adaptive IQ test or try 306 brain training levels.