Surround-screen projection-based virtual reality: the design and implementation of the CAVE
SIGGRAPH '93 Proceedings of the 20th annual conference on Computer graphics and interactive techniques
Multi-projector displays using camera-based registration
VIS '99 Proceedings of the conference on Visualization '99: celebrating ten years
Scalable alignment of large-format multi-projector displays using camera homography trees
Proceedings of the conference on Visualization '02
Multiple View Geometry in Computer Vision
Multiple View Geometry in Computer Vision
Mixed Reality in Education, Entertainment, and Training
IEEE Computer Graphics and Applications
SMALLab: a mediated platform for education
ACM SIGGRAPH 2006 Educators program
Social immersive media: pursuing best practices for multi-user interactive camera/projector exhibits
Proceedings of the SIGCHI Conference on Human Factors in Computing Systems
Virtual reality and mixed reality for virtual learning environments
Computers and Graphics
Supporting children's learning with body-based metaphors in a mixed reality environment
Proceedings of the 10th International Conference on Interaction Design and Children
Virtual Reality - Special Issue on Augmented Reality
Autocalibration of Multiprojector CAVE-Like Immersive Environments
IEEE Transactions on Visualization and Computer Graphics
Games for learning in embodied mixed-reality environments: principles and results
GLS'11 Proceedings of the 7th international conference on Games + Learning + Society Conference
| Hi-index | 0.00 |
This paper describes the development of an MR environment that can be used in teaching STEM (Science, Technology, Engineering, and Mathematics) topics. Specifically we seek to create a space for facilitating whole-body metaphors where learners use the physical movement and positioning of their entire bodies to enact their understanding of complex concepts. A rigorous technical approach comprised of virtual elements, real users, spatial audio, and an integrated sensor network is presented that fulfills the requirements of an embodied learning environment. An algorithm that uses homography-based multi-projector blending is used to create a large, seamless projection on the floor that affords a human-scale interaction environment. To further improve the immersive quality, projectors are strategically overlapped to minimize user shadows on the projected surface. A hybrid sensor solution using a Kinect and a laser scanner is developed that tracks users' physical movements and extracts relevant game parameters such as position and velocity. Requiring no pre-training or props, this tracking setup is adaptable and shows high performance over a wide range of users, from children to adults. An exhibit employing this MR system was field-tested at the Museum of Science and Industry in Tampa, FL.