Interactive Object Recognition System for a Helper Robot Using Photometric Invariance

  • Authors:

  • Md. Altab Hossain;Rahmadi Kurnia;Akio Nakamura;Yoshinori Kuno

  • Affiliations:

  • The authors are with the Department of Information and Computer Sciences, Saitama University, Saitama-shi, 338--8570 Japan. E-mail: hossain@cv.ics.saitama-u.ac.jp,;The authors are with the Department of Information and Computer Sciences, Saitama University, Saitama-shi, 338--8570 Japan. E-mail: hossain@cv.ics.saitama-u.ac.jp,;The author is with the Department of Machinery System Engineering, Tokyo Denki University, Tokyo, 101-8457 Japan.;The authors are with the Department of Information and Computer Sciences, Saitama University, Saitama-shi, 338--8570 Japan. E-mail: hossain@cv.ics.saitama-u.ac.jp,

  • Venue:
  • IEICE - Transactions on Information and Systems
  • Year:
  • 2005

Quantified Score

Hi-index 0.00

Visualization

Abstract

We are developing a helper robot that carries out tasks ordered by the user through speech. The robot needs a vision system to recognize the objects appearing in the orders. It is, however, difficult to realize vision systems that can work in various conditions. Thus, we have proposed to use the human user's assistance through speech. When the vision system cannot achieve a task, the robot makes a speech to the user so that the natural response by the user can give helpful information for its vision system. Our previous system assumes that it can segment images without failure. However, if there are occluded objects and/or objects composed of multicolor parts, segmentation failures cannot be avoided. This paper presents an extended system that tries to recover from segmentation failures using photometric invariance. If the system is not sure about segmentation results, the system asks the user by appropriate expressions depending on the invariant values. Experimental results show the usefulness of the system.