CHI '92 Proceedings of the SIGCHI Conference on Human Factors in Computing Systems
Coordination of communication: effects of shared visual context on collaborative work
CSCW '00 Proceedings of the 2000 ACM conference on Computer supported cooperative work
Co-presence and co-working in distributed collaborative virtual environments
AFRIGRAPH '01 Proceedings of the 1st international conference on Computer graphics, virtual reality and visualisation
CSCW '02 Proceedings of the 2002 ACM conference on Computer supported cooperative work
A study of gestures in a video-mediated collaborative assembly task
Advances in Human-Computer Interaction
Using sticky light technology for projected guidance
Proceedings of the 23rd Australian Computer-Human Interaction Conference
ISMAR '11 Proceedings of the 2011 10th IEEE International Symposium on Mixed and Augmented Reality
Reducing interference between multiple structured light depth sensors using motion
VR '12 Proceedings of the 2012 IEEE Virtual Reality
Supporting hand gestures in mobile remote collaboration: a usability evaluation
BCS-HCI '11 Proceedings of the 25th BCS Conference on Human-Computer Interaction
HandsinAir: a wearable system for remote collaboration on physical tasks
Proceedings of the 2013 conference on Computer supported cooperative work companion
A scenario- and observation-based requirement analysis for delivery of remote mining services
Proceedings of the 24th Australian Computer-Human Interaction Conference
Visualization of off-surface 3D viewpoint locations in spatial augmented reality
Proceedings of the 1st symposium on Spatial user interaction
RemoteFusion: real time depth camera fusion for remote collaboration on physical tasks
Proceedings of the 12th ACM SIGGRAPH International Conference on Virtual-Reality Continuum and Its Applications in Industry
HandsIn3D: augmenting the shared 3D visual space with unmediated hand gestures
SIGGRAPH Asia 2013 Emerging Technologies
MobileHelper: remote guiding using smart mobile devices, hand gestures and augmented reality
SIGGRAPH Asia 2013 Symposium on Mobile Graphics and Interactive Applications
| Hi-index | 0.00 |
There is currently a strong need for collaborative systems with which two or more participants interact over a distance on a task involving tangible artifacts (e.g., a machine, a patient, a tool). The present paper focuses on the specific category of remote-collaboration systems where hand gestures are used by a remote helper to assist a physically distant worker to perform manual tasks. Existing systems use a combination of video capturing, 2D monitors or 2D projectors, however displaying a video of the remote workspace and allowing helpers to gesture over the video does not provide helpers with sufficient understanding of the spatial relationships between remote objects and between their hands and the remote objects. In this paper we introduce our tele-presence Mixed Reality system for remote collaboration on physical tasks based on real-time capture and rendering of the remote workspace and of the helper's hands. We improve on previous 2D systems introducing 3D capturing and rendering, and exploiting the possibility offered by the use of real 3D data to increase the feeling of immersion offered by the system using head tracking, stereoscopic rendering, inter-occlusion handling and virtual shadowing. We performed initial usability test of our system to verify if users are satisfied with the spatial awareness the system provides.