Robust human-computer interaction system guiding a user by providing feedback

Authors:
M. S. Ryoo;J. K. Aggarwal
Affiliations:
Computer and Vision Research Center, Department of Electrical and Computer Engineering, The University of Texas at Austin, Austin, TX;Computer and Vision Research Center, Department of Electrical and Computer Engineering, The University of Texas at Austin, Austin, TX
Venue:
IJCAI'07 Proceedings of the 20th international joint conference on Artifical intelligence
Year:
2007

Citing 6
Cited 3

Design principles for intelligent environments

AAAI '98/IAAI '98 Proceedings of the fifteenth national/tenth conference on Artificial intelligence/Innovative applications of artificial intelligence
Perceptual user interfaces: the KidsRoom

Communications of the ACM
Maintaining knowledge about temporal intervals

Communications of the ACM
Simultaneous tracking of multiple body parts of interacting persons

Computer Vision and Image Understanding
Recognition of Composite Human Activities through Context-Free Grammar Based Representation

CVPR '06 Proceedings of the 2006 IEEE Computer Society Conference on Computer Vision and Pattern Recognition - Volume 2
Grounding the lexical semantics of verbs in visual perception using force dynamics and event logic

Journal of Artificial Intelligence Research

Semantic Representation and Recognition of Continued and Recursive Human Activities

International Journal of Computer Vision
A task-driven intelligent workspace system to provide guidance feedback

Computer Vision and Image Understanding
A syntactic approach to robot imitation learning using probabilistic activity grammars

Robotics and Autonomous Systems

Quantified Score

Hi-index	0.01

Visualization

Abstract

We introduce a human-computer interaction system which collaborates with a user by providing feed-back during user activities. The goal of the system is to help a user complete a high-level activity that has been represented hierarchically. While a user is performing the high-level activity, our system analyzes what sub-events a user has already completed and what sub-events are needed next in order for the user to finish the activity. The representations of human activities are constructed using a previously developed context-free grammar based representation scheme. We focus on a game named 'pentagram game' to illustrate our system. In the experiments, our system showsthe ability to guide the user to complete the 'pentagram game' by providing explicit feedback. The feedback not only contains atomic level instructions but also describes higher-level long-term goals of the composite activities.