Human Responsibility for Autonomous Agents

  • Authors:
  • Ben Shneiderman

  • Affiliations:
  • University of Maryland, College Park

  • Venue:
  • IEEE Intelligent Systems
  • Year:
  • 2007

Quantified Score

Hi-index 0.00

Visualization

Abstract

Automated or autonomous systems can sometimes fail harmlessly, but they can also destroy data, compromise privacy, and consumeresources, such as bandwidth or server capacity. What's more troubling is that automated systems embedded in vital systems can causefinancial losses, destruction of property, and loss of life. Controlling these dangers will increase trust while enabling broader use ofthese systems with higher degrees of safety. Obvious threats stem from design errors and software bugs, but we can't overlook mistakenassumptions by designers, unanticipated actions by humans, and interference from other computerized systems. This article is part of aspecial issue on Interacting with Autonomy.