Why do we rely on AI too much?
People can trust a system that sounds sure of itself too much, or only check the result they expect.
What is it?
People trust systems that sound reliable too much, and often check only what they expect to see. This is called automation bias. Human oversight helps only if the person has the knowledge, time and authority to change the decision.
An everyday example
A driver follows the satnav onto a closed road because “the phone said so”, even though a road sign warns otherwise.
Why does it matter?
In health care, justice or hiring, blind trust in AI can cause serious mistakes for which nobody takes responsibility.
A common misconception
That a “human in the loop” automatically ensures safety. If the person only rubber-stamps suggestions, the oversight is a formality.
In more detail
What is automation bias?
The tendency to accept a system’s suggestion without checking it enough.
Why is it dangerous?
Because the mistake gets a human signature, even though nobody really reviewed it.
What does human oversight mean?
Not just clicking “approve”, but being able to understand, reject and correct the result.
How can review be improved?
Set out clearly which claims are checked, who is responsible and when the system must not be used.
Remember: A human “in the loop” only helps if they have the knowledge, the time and the authority.
Reliable sources
Last reviewed 1 November 2026. An explainer, not professional, legal or medical advice. For rules and figures that change, check the official version.