Watch for
Deferring to automated recommendations without critical evaluation.
Decision & ChoiceBias #97
Automation Bias
We trust automated systems over human judgment.
The tendency to favour automated decision-making systems or algorithmic suggestions over non-automated human judgment even when the automation is imperfect.
Why it matters: Explains accidents in aviation medicine and self-driving cars where humans over-relied on automation.
Try this
Treat automation as one input not an authority and test its outputs regularly.
Real-world example
A pilot follows an autopilot recommendation that contradicts their own assessment because the system must be correct.
Key researchers
Raja Parasuraman
First described in 2000
Psychological mechanism
Trust transfer and effort reduction. Automated systems are perceived as objective and error-free reducing the cognitive effort of evaluation. Humans also treat machines as authority figures.
Seminal research
Raja Parasuraman and Victor Riley (1997), "Humans and automation: Use misuse disuse abuse."
Related Biases
Below is a realistic scenario. Read it, then choose what you would do. The feedback will show whether a cognitive bias influenced your choice — not to judge, but to reveal the pattern in action.
Thought Experiment
This experiment places you in a realistic decision. Your instinctive choice will reveal whether bias is at work.
STEP 1 → ReadSTEP 2 → ChooseSTEP 3 → Reveal
Debrief
Automation bias causes us to trust algorithms uncritically because they feel objective and precise. But automated systems have blind spots and errors. The best approach is to treat automation as a helpful but fallible assistant not an infallible authority.
Sources
Original ResearchParasuraman and Riley (1997) — Automation bias
EducationalAPA Dictionary entry