A Method for Registration of 3-D Shapes
IEEE Transactions on Pattern Analysis and Machine Intelligence - Special issue on interpretation of 3-D scenes—part II
Tangible interaction + graphical interpretation: a new approach to 3D modeling
Proceedings of the 27th annual conference on Computer graphics and interactive techniques
Comparative effectiveness of augmented reality in object assembly
Proceedings of the SIGCHI Conference on Human Factors in Computing Systems
Origami Desk: integrating technological innovation and human-centric design
DIS '02 Proceedings of the 4th conference on Designing interactive systems: processes, practices, methods, and techniques
Virtual Reality and Augmented Reality as a Training Tool for Assembly Tasks
IV '99 Proceedings of the 1999 International Conference on Information Visualisation
Designing effective step-by-step assembly instructions
ACM SIGGRAPH 2003 Papers
A Metric for Distributions with Applications to Image Databases
ICCV '98 Proceedings of the Sixth International Conference on Computer Vision
Proceedings of the working conference on Advanced visual interfaces
Computer vision and augmented reality for guiding assembly
Computer vision and augmented reality for guiding assembly
Automated generation of interactive 3D exploded view diagrams
ACM SIGGRAPH 2008 papers
Visual information as a conversational resource in collaborative physical tasks
Human-Computer Interaction
Illustrating how mechanical assemblies work
ACM SIGGRAPH 2010 papers
Design principles for visual communication
Communications of the ACM
Constructing virtual 3D models with physical building blocks
CHI '11 Extended Abstracts on Human Factors in Computing Systems
Pause-and-play: automatically linking screencast video tutorials with applications
Proceedings of the 24th annual ACM symposium on User interface software and technology
KinectFusion: real-time 3D reconstruction and interaction using a moving depth camera
Proceedings of the 24th annual ACM symposium on User interface software and technology
Augmented reality in the psychomotor phase of a procedural task
ISMAR '11 Proceedings of the 2011 10th IEEE International Symposium on Mixed and Augmented Reality
Interactive 3D Model Acquisition and Tracking of Building Block Structures
IEEE Transactions on Visualization and Computer Graphics
Closing the loop between intentions and actions
Adjunct proceedings of the 25th annual ACM symposium on User interface software and technology
Touch & activate: adding interactivity to existing objects using active acoustic sensing
Proceedings of the 26th annual ACM symposium on User interface software and technology
DemoCut: generating concise instructional videos for physical demonstrations
Proceedings of the 26th annual ACM symposium on User interface software and technology
| Hi-index | 0.00 |
We demonstrate a realtime system which infers and tracks the assembly process of a snap-together block model using a Kinect® sensor. The inference enables us to build a virtual replica of the model at every step. Tracking enables us to provide context specific visual feedback on a screen by augmenting the rendered virtual model aligned with the physical model. The system allows users to author a new model and uses the inferred assembly process to guide its recreation by others. We propose a novel way of assembly guidance where the next block to be added is rendered in blinking mode with the tracked virtual model on screen. The system is also able to detect any mistakes made and helps correct them by providing appropriate feedback. We focus on assemblies of Duplo® blocks. We discuss the shortcomings of existing methods of guidance - static figures or recorded videos - and demonstrate how our method avoids those shortcomings. We also report on a user study to compare our system with standard figure-based guidance methods found in user manuals. The results of the user study suggest that our method is able to aid users' structural perception of the model better, leads to fewer assembly errors, and reduces model construction time.