Reflectance based object recognition
International Journal of Computer Vision
Understanding Natural Language
Understanding Natural Language
Object Reference in Task-Oriented Keyboard Dialogues
Multimodal Human-Computer Communication, Systems, Techniques, and Experiments
Learning Audio-Visual Associations Using Mutual Information
SPELMG '99 Proceedings of the Integration of Speech and Image Understanding
Hi-index | 0.00 |
An effective human-robot interaction is essential for wide penetration of service robots into the market. Such robots need vision systems to recognize objects. It is, however, difficult to realize vision systems that can work in various conditions. More robust techniques of object recognition and image segmentation are essential. Thus, we have proposed to use the human user’s assistance for objects recognition through speech. Our previous system assumes that it can segment images without failure. However, if there are occluded objects and/or objects composed of multicolor parts, segmentation failures cannot be avoided. This paper presents an extended system that can recognize objects in occlusion and/or multicolor cases using geometric and photometric analysis of images. If the robot is not sure about the segmentation results, it asks questions of the user by appropriate expressions depending on the certainty to remove the ambiguity.