Two people are asked the same difficult question. The first looks down for a moment. “I think the answer is B,” she says. “Maybe sixty percent.” The second answers before the question has fully left the room.
“It is B.”
No hesitation. No visible doubt. No careful boundary around what he knows and what he does not.
You have never met either person. You do not know their training. You do not know their record. You do not know whether the first person has spent ten years studying the subject and the second has spent thirty seconds thinking about it.
Still, the second answer often feels stronger. It lands cleanly. The first answer carries uncertainty in public. The second hides it. Now imagine that B is wrong.
The interesting problem is not merely that a confident person can make a mistake. Everyone can make a mistake.
The stranger question is why confidence can make the mistake persuasive before the evidence catches up.
Why does certainty feel like evidence when certainty and accuracy are not the same thing?
Follow the Question: Psychology
Confidence is a judgment about a judgment
When you answer a question, you do not only produce an answer. You also have some feeling about the answer. You remember a name and think, yes, that is definitely it.
You remember another name and think, I am not sure. It might be wrong.
Psychologists often study this as metacognition: the mind making a judgment about the quality of one of its own judgments.
That extra layer is useful.
Your brain has access to clues that do not appear in the final answer. A memory may arrive quickly or only after effort. Two possible answers may feel almost equal. One explanation may fit several pieces of evidence at once while another requires exceptions.
Confidence can summarize some of those signals. But confidence is not a meter connected directly to truth. It is an interpretation of internal evidence.
And internal evidence can be misleading.
The research literature also uses the word overconfidence for more than one failure. Don Moore and Paul Healy distinguish overestimating your actual performance, believing you rank higher than others, and being too precise about what you know. Those are different mistakes.
For this question, the third is especially important.
A person can be modest about their abilities and still draw the range of possibilities too narrowly.
That is overprecision. So the danger is not simply that confident people think they are better than everyone else.
It is that uncertainty can disappear from the mental picture before the evidence justifies its disappearance.
Familiarity can feel like knowledge. Fluency can feel like understanding. Repetition can make a sentence easier to process without making it more accurate.
A neat explanation can feel more convincing than a messy one even when the messy explanation is closer to reality.
This matters because reality often has bad presentation skills.
A careful expert may say:
“There are three plausible explanations. I lean toward the second, but the data are weak in this population.”
A less careful speaker may say:
“This is what happened.” The second sentence is easier to carry. It asks less of the listener. It also creates less visible uncertainty. In many social settings, that is rewarded.
Leaders are expected to know what to do. Salespeople are rewarded for conviction. Commentators are expected to react before all the evidence exists. In meetings, “I do not know yet” can sound weaker than a fast answer, even when waiting would be rational.
So confidence can become partly a performance. Not because every confident person is pretending. Because the social environment sometimes rewards certainty before it rewards calibration.
And that gives us a more useful word: calibration. Consider two forecasters.
The first repeatedly says, “I am ninety percent sure.” But over time, only about sixty percent of those predictions are correct.
The second repeatedly says, “I am sixty percent sure.” And over time, about sixty percent of those predictions are correct.
The first sounds stronger. The second understands their uncertainty better.
That does not automatically make the second person more knowledgeable. Someone can be perfectly calibrated and still know very little.
But calibration tells us something raw confidence cannot. It tells us whether certainty has learned from reality.
Moore, D. A., & Healy, P. J. (2008). The trouble with overconfidence.
Follow the Question: Credibility
We do not only judge answers. We judge answerers.
Suppose you have worked with the same engineer for ten years. When she says, “I am almost certain,” you have noticed that she usually is.
When she says, “Something is wrong, but I do not know what yet,” you have learned to take the uncertainty seriously too.
Her confidence has acquired meaning because it has a history. Now replace her with a stranger. A person in a meeting. A viral account. A television guest.
A salesperson. An anonymous post. An AI response. The confidence arrives before the history. That is the dangerous order.
Research on credibility suggests that people can use more than confidence alone. In a 2011 study by Elizabeth Tenney and colleagues, both five- and six-year-old children and adults used information about confidence and accuracy when judging informants. But only the adults used information about calibration — how well an informant's confidence tracked the likelihood of being correct.
That difference is useful for our question. Humans can care about calibration, not just swagger, but calibration is a more demanding judgment than merely noticing who sounds certain.
That should make the problem less cynical, not less serious. We are not helpless before confidence. But we often lack the information required to interpret it.
If you have no track record, style becomes more important than it should be. Fast speech can resemble fluency of thought. Technical vocabulary can resemble expertise.
A long explanation can resemble a deep explanation. A complete absence of hesitation can resemble strong evidence. Sometimes those cues are genuine.
Sometimes they are costume. The problem is that costume is easier to see.
Follow the Question: Statistics
Confidence needs a denominator
Statistics gives us a cleaner version of the problem. Suppose a weather forecaster says there is a seventy percent chance of rain tomorrow.
If tomorrow is dry, was the forecast wrong?
Not necessarily.
A seventy percent forecast is not a promise that rain must occur on one particular day. It is a claim about how similar forecasts should behave across many days.
If the forecaster says “seventy percent” one hundred times, we can eventually ask whether rain occurred on something like seventy of those occasions.
The number becomes meaningful because it has a denominator. Human confidence usually does not. “I am certain” sounds absolute.
But the hidden question is statistical:
How often are you certain? And how often are you right when you are?
Without that history, certainty is difficult to interpret. Organizations make this problem worse because success and failure are rarely clean.
A manager makes ten bold decisions. Three work spectacularly, four work modestly, and three fail quietly. Which ones become stories?
An investor succeeds for several years during a favorable market. Was the confidence skill, luck, or both?
A doctor may be extremely well calibrated in common cases and poorly calibrated in rare ones.
A founder can become more certain after success even if part of the success depended on timing that will not repeat.
We are selective historians of our own judgment. So confidence can grow faster than calibration.
A useful distinction appears:
That does not make confidence useless. It makes confidence incomplete.
Raw confidence is a signal. Calibrated confidence is a measured signal.
Follow the Question: Law
Eyewitness confidence is not a simple cautionary tale
Few examples show the problem better than eyewitness identification. The popular lesson is familiar: eyewitnesses can be confident and wrong. That is true.
Memory can be influenced. Feedback, suggestion, repeated questioning, time, and exposure to new information can alter what a person remembers and how certain they feel about it.
But the scientific story is more specific than the slogan.
A major 2017 synthesis by John Wixted and Gary Wells argued that under carefully controlled, uncontaminated conditions, an eyewitness's initial confidence can carry meaningful information about identification accuracy. Those conditions include things such as a fair lineup, no influence from the lineup administrator, an initial memory test, and a confidence statement recorded immediately rather than reconstructed later.
That sounds almost like the opposite of the standard warning. It is not. The two claims can coexist. Confidence can be informative when the process that produced it is clean.
Confidence can become less informative when the process contaminates memory or confidence after the fact.
A courtroom statement months later is not automatically equivalent to an immediate confidence statement gathered under controlled conditions.
Other researchers have warned against treating confidence as a universal shortcut precisely because real cases may not satisfy ideal conditions.
The deeper lesson is not:
Eyewitness confidence is reliable.
Nor is it:
Eyewitness confidence is worthless.
It is this:
That is a more demanding principle.
It means we cannot evaluate the sentence without evaluating the process that made the sentence possible.
The conditions under which confidence is produced help determine how much information the confidence carries.
Follow the Question: Communication
Why certainty travels well
Uncertainty takes space.
“This is probably true because of A and B, but C could change my estimate, and the evidence is weaker in this population” is a useful sentence.
It is also a terrible slogan. “This is true” is much easier. Compact certainty travels well. It fits inside a headline. It survives retelling. It is easy to remember.
It gives a meeting direction. It gives an argument a clean edge. Nuance behaves differently.
Every qualification is another piece that can be lost as the claim moves from paper to article to post to conversation.
This creates an asymmetry.
The careful speaker must carry conditions, uncertainty, exceptions, missing data, and alternative explanations.
The overconfident speaker can compress all of that into one sentence. That rhetorical advantage exists even when nobody is deliberately manipulating anyone.
Sometimes decisive language is justified. A structural engineer may know that a load exceeds a known limit. A laboratory result may be unambiguous. A calculation may have a definite answer.
The difficulty is that justified decisiveness and stylistic decisiveness can sound identical to a listener who cannot inspect the evidence.
The sentence does not reveal which one produced it.
Follow the Question: Artificial Intelligence
Synthetic confidence has no emotional cost
A human being can feel doubt and hide it. A language model does not need to hide anything in that sense. It can simply generate a sentence that has the form of certainty.
That makes AI a strange laboratory for the problem. A model can give a polished explanation when the answer is correct. It can also give a polished explanation when the answer is wrong.
The grammar remains composed. The paragraphs remain balanced. The conclusion does not blush.
A 2025 Nature Machine Intelligence study by Mark Steyvers and colleagues examined the gap between what large language models know and what people think the models know. Participants tended to overestimate the accuracy of LLM answers when default explanations were shown. Longer explanations could increase user confidence even when the additional length did not improve accuracy.
That finding matters because it separates two things people often merge:
explanatory form and epistemic strength. A longer explanation can contain more evidence. It can also contain more language. Those are not the same achievement.
The study also points toward a more constructive idea: explanations can be designed so that expressed uncertainty better reflects the model's actual confidence. When that happens, the gap between user confidence and model performance can narrow.
The lesson is not that AI should always sound unsure. The lesson is that uncertainty should be meaningful.
A system that sounds equally certain when it knows and when it guesses has hidden one of the most important facts the user needs.
Humans do this too. AI simply does it at scale.
Steyvers, M., et al. (2025). What large language models know and what people think they know.
Where the Fields Collide
Psychology tells us that confidence is a real mental signal, but an imperfect one.
Credibility research tells us that people can learn who is well calibrated, but only when a track record is visible.
Statistics tells us that confidence becomes more meaningful when it can be compared with repeated outcomes.
Eyewitness research shows that the procedure surrounding a confidence statement can change what the statement is worth.
Communication rewards compact certainty.
Artificial intelligence can generate the language of certainty without the social and emotional costs humans usually associate with it.
The fields meet at one uncomfortable point:
Competence may require years of training, access to data, replication, delayed outcomes, or technical knowledge.
Confidence arrives in the first sentence. So we use it as a shortcut. Sometimes the shortcut works. Sometimes it rewards the person — or the system — least willing to expose uncertainty.
Confidence is easier to observe than competence.
What We Know — and What We Don't
We know confidence can correlate with accuracy under some conditions.
We know people can learn whether a speaker's confidence is calibrated when they have enough information about past performance.
We know eyewitness confidence is sensitive to how and when it is measured.
We know AI explanations can increase user confidence even when explanatory length adds no corresponding accuracy.
We do not have a universal conversion from confidence to truth. And the answer is not to distrust confident people by default.
A surgeon who says, “I am highly confident this is appendicitis” may be communicating genuinely useful information.
A scientist who says, “The evidence is mixed” may be demonstrating expertise rather than weakness.
The goal is not to punish certainty. It is to ask what certainty is connected to.
Evidence?
Experience?
Past accuracy?
A clean procedure?
Or simply a style of speaking?
Back to the Two Speakers
Return to the room. One person says sixty percent. The other says definitely B. At first, the second answer may still feel stronger. But now there is another question in the room.
What happens when this person is wrong?
Do they update quickly?
Do they remember the miss?
Does their confidence shrink in areas where their performance is poor?
Does certainty change with evidence?
Or is certainty simply how they sound?
The better question may not be:
How confident are you?
It may be:
What happens to your confidence when you are wrong?
The Next Question
If confidence can mislead us about an answer, what happens when a system claims something far more consequential than “B is correct”?
What happens when it claims to know what someone will do next?
If we could predict a crime before it happens, should we act on the prediction?
Sources & Further Reading
- Moore, D. A., & Healy, P. J. (2008). The trouble with overconfidence.
- Tenney, E. R., Small, J. E., Kondrad, R. L., Jaswal, V. K., & Spellman, B. A. (2011). Accuracy, confidence, and calibration: how young children and adults assess credibility.
- Wixted, J. T., & Wells, G. L. (2017). The Relationship Between Eyewitness Confidence and Identification Accuracy: A New Synthesis.
- Palmer et al. (2021). Convicting with confidence? Why we should not over-rely on eyewitness confidence.
- Steyvers, M., et al. (2025). What large language models know and what people think they know.
Beyond the Question is an interdisciplinary series by Arin Vale.
Read the editorial approachTHE NEXT QUESTION