The Visual Hull Concept for Silhouette-Based Image Understanding
IEEE Transactions on Pattern Analysis and Machine Intelligence
Polyhedral Visual Hulls for Real-Time Rendering
Proceedings of the 12th Eurographics Workshop on Rendering Techniques
3D Model Based Gesture Acquisition Using a Single Camera
WACV '02 Proceedings of the Sixth IEEE Workshop on Applications of Computer Vision
3-D Articulated Pose Tracking for Untethered Diectic Reference
ICMI '02 Proceedings of the 4th IEEE International Conference on Multimodal Interfaces
Simultaneous Pose Estimation and Camera Calibration from Multiple Views
CVPRW '04 Proceedings of the 2004 Conference on Computer Vision and Pattern Recognition Workshop (CVPRW'04) Volume 1 - Volume 01
Dynamic Human Pose Estimation using Markov Chain Monte Carlo Approach
WACV-MOTION '05 Proceedings of the IEEE Workshop on Motion and Video Computing (WACV/MOTION'05) - Volume 2 - Volume 02
Full Body Tracking from Multiple Views Using Stochastic Sampling
CVPR '05 Proceedings of the 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05) - Volume 2 - Volume 02
Kernel Particle Filter for Real-Time 3D Body Tracking in Monocular Color Images
FGR '06 Proceedings of the 7th International Conference on Automatic Face and Gesture Recognition
View independent human body pose estimation from a single perspective image
CVPR'04 Proceedings of the 2004 IEEE computer society conference on Computer vision and pattern recognition
A tutorial on particle filters for online nonlinear/non-GaussianBayesian tracking
IEEE Transactions on Signal Processing
Real-Time 3D Body Pose Tracking from Multiple 2D Images
AMDO '08 Proceedings of the 5th international conference on Articulated Motion and Deformable Objects
Human-computer intelligent interaction: a survey
HCI'07 Proceedings of the 2007 IEEE international conference on Human-computer interaction
| Hi-index | 0.00 |
We describe a visual communication application for a dark, theaterlike interactive virtual simulation training environment. Our system visually estimates and tracks the body position, orientation and the arm-pointing direction of the trainee. This system uses a near-IR camera array to capture images of the trainee from different angles in the dim-lighted theater. Image features like silhouettes and intermediate silhouette body axis points are then segmented and extracted from image backgrounds. 3D body shape information such as 3D body skeleton points and visual hulls can be reconstructed from these 2D features in multiple calibrated images. We proposed a particle-filtering based method that fits an articulated body model to the observed image features. Currently we focus on the arm-pointing gesture of either limb. From the fitted articulated model we can derive the position on the screen the user is pointing to. We use current graphic hardware to accelerate the processing speed so the system is able to work in real-time. The system serves as part of multi-modal user-input device in the interactive simulation.