Shape Matching and Object Recognition Using Shape Contexts
IEEE Transactions on Pattern Analysis and Machine Intelligence
Learning a Similarity Metric Discriminatively, with Application to Face Verification
CVPR '05 Proceedings of the 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05) - Volume 1 - Volume 01
Cover trees for nearest neighbor
ICML '06 Proceedings of the 23rd international conference on Machine learning
Motion templates for automatic classification and retrieval of motion capture data
Proceedings of the 2006 ACM SIGGRAPH/Eurographics symposium on Computer animation
Two gesture recognition systems for immersive math education of the deaf
Proceedings of the First International Conference on Immersive Telecommunications
Distance Metric Learning for Large Margin Nearest Neighbor Classification
The Journal of Machine Learning Research
Can virtual humans be more engaging than real ones?
HCI'07 Proceedings of the 12th international conference on Human-computer interaction: intelligent multimodal interaction environments
Ada and grace: toward realistic and engaging virtual museum guides
IVA'10 Proceedings of the 10th international conference on Intelligent virtual agents
Developing speech input for virtual reality applications: A reality based interaction approach
International Journal of Human-Computer Studies
Real-time human pose recognition in parts from single depth images
CVPR '11 Proceedings of the 2011 IEEE Conference on Computer Vision and Pattern Recognition
Nearest neighbor pattern classification
IEEE Transactions on Information Theory
Mining actionlet ensemble for action recognition with depth cameras
CVPR '12 Proceedings of the 2012 IEEE Conference on Computer Vision and Pattern Recognition (CVPR)
AMDO'12 Proceedings of the 7th international conference on Articulated Motion and Deformable Objects
Full-body gesture interaction with improvisational narrative agents
IVA'12 Proceedings of the 12th international conference on Intelligent Virtual Agents
Multi-party interaction with a virtual character and a human-like robot
Proceedings of the 19th ACM Symposium on Virtual Reality Software and Technology
| Hi-index | 0.00 |
In this paper, a novel human-virtual human interaction system is proposed. This system supports a real human to communicate with a virtual human using natural body language. Meanwhile, the virtual human is capable of understanding the meaning of human upper body gestures and reacting with its own personality by the means of body action, facial expression and verbal language simultaneously. In total, 11 human upper body gestures with and without human-object interaction are currently involved in the system. They can be characterized by human head, hand and arm posture. In our system implementation, the wearable Immersion CyberGlove II is used to capture the hand posture and the vision-based Microsoft Kinect takes charge of capturing the head and arm posture. This is a new sensor solution for human-gesture capture, and can be regarded as the most important contribution of this paper. Based on the posture data from the CyberGlove II and the Kinect, an effective and real-time human gesture recognition algorithm is also proposed. To verify the effectiveness of the gesture recognition method, we build a human gesture sample dataset. Additionally, the experiments demonstrate that our algorithm can recognize human gestures with high accuracy in real time.