“I want that”: Human-in-the-loop control of a wheelchair-mounted robotic arm

  • Authors:
  • Katherine M. Tsui;Dae-Jin Kim;Aman Behal;David Kontak;Holly A. Yanco

  • Affiliations:
  • University of Massachusetts Lowell, Lowell, MA, USA;Universal Robotics, Inc., Noshville, TN, USA and University of Central Florida, Orlando, FL, USA;University of Central Florida, Orlando, FL, USA;Crotched Mountain Rehabilitation Center, Greenfield, NH, USA;University of Massachusetts Lowell, Lowell, MA, USA

  • Venue:
  • Applied Bionics and Biomechanics - Assistive and Rehabilitation Robotics
  • Year:
  • 2011

Quantified Score

Hi-index 0.00

Visualization

Abstract

Wheelchair-mounted robotic arms have been commercially available for a decade. In order to operate these robotic arms, a user must have a high level of cognitive function. Our research focuses on replacing a manufacturer-provided, menu-based interface with a vision-based system while adding autonomy to reduce the cognitive load. Instead of manual task decomposition and execution, the user explicitly designates the end goal, and the system autonomously retrieves the object. In this paper, we present the complete system which can autonomously retrieve a desired object from a shelf. We also present the results of a 15-week study in which 12 participants from our target population used our system, totaling 198 trials.