Human Detection and Identification by Robots Using Thermal and Visual Information in Domestic Environments

  • Authors:

  • Mauricio Correa;Gabriel Hermosilla;Rodrigo Verschae;Javier Ruiz-Del-Solar

  • Affiliations:

  • Department of Electrical Engineering, Universidad de Chile, Santiago, Chile and Advanced Mining Technology Center, Universidad de Chile, Santiago, Chile;Department of Electrical Engineering, Universidad de Chile, Santiago, Chile and Advanced Mining Technology Center, Universidad de Chile, Santiago, Chile;Department of Electrical Engineering, Universidad de Chile, Santiago, Chile and Advanced Mining Technology Center, Universidad de Chile, Santiago, Chile;Department of Electrical Engineering, Universidad de Chile, Santiago, Chile and Advanced Mining Technology Center, Universidad de Chile, Santiago, Chile

  • Venue:
  • Journal of Intelligent and Robotic Systems
  • Year:
  • 2012

Quantified Score

Hi-index 0.00

Visualization

Abstract

In this paper a robust system for enabling robots to detect and identify humans in domestic environments is proposed. Robust human detection is achieved through the use of thermal and visual information sources that are integrated to detect human-candidate objects, which are further processed in order to verify the presence of humans and their identity using face information in the thermal and visual spectrums. Face detection is used to verify the presence of humans, and face recognition to identify them. Active vision mechanisms are employed in order to improve the relative pose of a candidate object/person in case direct identification is not possible. The response of the different modules is characterized, and the proposed system is validated using image databases of real domestic environments, and human detection and identification benchmarks of the RoboCup@Home research community.