Design principles for intelligent environments
AAAI '98/IAAI '98 Proceedings of the fifteenth national/tenth conference on Artificial intelligence/Innovative applications of artificial intelligence
The Aware Home: A Living Laboratory for Ubiquitous Computing Research
CoBuild '99 Proceedings of the Second International Workshop on Cooperative Buildings, Integrating Information, Organization, and Architecture
Proactive Instructions for Furniture Assembly
UbiComp '02 Proceedings of the 4th international conference on Ubiquitous Computing
Recognizing multitasked activities from video using stochastic context-free grammar
Eighteenth national conference on Artificial intelligence
Representation and Recognition of Events in Surveillance Video Using Petri Nets
CVPRW '04 Proceedings of the 2004 Conference on Computer Vision and Pattern Recognition Workshop (CVPRW'04) Volume 7 - Volume 07
Recognition of Composite Human Activities through Context-Free Grammar Based Representation
CVPR '06 Proceedings of the 2006 IEEE Computer Society Conference on Computer Vision and Pattern Recognition - Volume 2
Activity Recognition of Assembly Tasks Using Body-Worn Microphones and Accelerometers
IEEE Transactions on Pattern Analysis and Machine Intelligence
Action Recognition in aWearable Assistance System
ICPR '06 Proceedings of the 18th International Conference on Pattern Recognition - Volume 02
The KidsRoom: A Perceptually-Based Interactive and Immersive Story Environment
Presence: Teleoperators and Virtual Environments
Learning temporal structure for task based control
Image and Vision Computing
Conceptual representations between video signals and natural language descriptions
Image and Vision Computing
Semantic Representation and Recognition of Continued and Recursive Human Activities
International Journal of Computer Vision
Grounding the lexical semantics of verbs in visual perception using force dynamics and event logic
Journal of Artificial Intelligence Research
IJCAI'83 Proceedings of the Eighth international joint conference on Artificial intelligence - Volume 2
Robust human-computer interaction system guiding a user by providing feedback
IJCAI'07 Proceedings of the 20th international joint conference on Artifical intelligence
Automatic video interpretation: a novel algorithm for temporal scenario recognition
IJCAI'03 Proceedings of the 18th international joint conference on Artificial intelligence
| Hi-index | 0.00 |
We introduce a vision-based human-computer interaction system which collaborates with a user by providing feedback during user activities. We design an intelligent workspace system that analyzes the context of a user's tasks and generates appropriate feedback guiding the user to complete the tasks correctly. While a user is performing the high-level activity, our system analyzes what sub-events the user has already completed and what sub-events are needed next in order for the user to finish the activity. Based on this analysis, the system generates hierarchical feedback messages to assist the user. We test our system on three different types of tasks: tightening nuts on a wheel of a car, assembling a toy spaceship with LEGO blocks, and assembling a laptop computer with its parts. Experimental results demonstrate the accuracy of the vision-based activity analysis, and a comparative user study shows that our system's feedback enables users to complete assembly tasks with significantly improved efficiency.