ψpsychologyof.ai
Research/Human-AI Teams/Paper
2023·CHI Conference on Human Factors in Computing Systems

Knowing About Knowing: An Illusion of Human Competence Can Hinder Appropriate Reliance on AI Systems

Gaube, S., Suresh, H., Raber, M., Merz, E. M., Ghassemi, M., & Gurkan, H.

🧩 Human-AI Teams

Abstract

Reveals that domain experts may be worse at collaborating with AI than novices, because their confidence in their own knowledge leads them to dismiss correct AI recommendations. The "illusion of competence" paradoxically makes experts less effective in human-AI teams.

Key Findings

  • Domain experts override correct AI recommendations more often than novices
  • Confidence in human expertise can reduce human-AI team performance
  • Calibrated self-assessment is key to effective human-AI collaboration

Source

DOI: 10.1145/3544548.3581025 →

Related Papers

2021·CHI Conference on Human Factors in Computing Systems

Does the Whole Exceed its Parts? The Effect of AI Explanations on Complementary Team Performance

Bansal, G., Wu, T., Zhou, J., Fok, R., Nushi, B., Kamar, E., Ribeiro, M. T., & Weld, D.

collaboration→
2019·FAccT Conference on Fairness, Accountability, and Transparency

On Human Predictions with Explanations and Predictions of Machine Learning Models

Lai, V., & Tan, C.

collaboration→