Kinected conference: augmenting video imaging with calibrated depth and audio

Authors:
Anthony DeVincenzi;Lining Yao;Hiroshi Ishii;Ramesh Raskar
Affiliations:
MIT Media Lab, Cambridge, MA, USA;MIT Media Lab, Cambridge, MA, USA;MIT Media Lab, Cambridge, MA, USA;MIT Media Lab, Cambridge, MA, USA
Venue:
Proceedings of the ACM 2011 conference on Computer supported cooperative work
Year:
2011

Citing 6
Cited 6

Toward an open shared workspace: computer and video fusion approach of TeamWorkStation

Communications of the ACM
The office of the future: a unified approach to image-based modeling and spatially immersive displays

Proceedings of the 25th annual conference on Computer graphics and interactive techniques
Virtual Space Teleconferencing Using a Sea of Cameras

Virtual Space Teleconferencing Using a Sea of Cameras
Remote collaboration using Augmented Reality Videoconferencing

GI '04 Proceedings of the 2004 Graphics Interface Conference
Pseudo-3D Video Conferencing with a Generic Webcam

ISM '08 Proceedings of the 2008 Tenth IEEE International Symposium on Multimedia
Collaboard: a remote collaboration groupware device featuring an embodiment-enriched shared workspace

Proceedings of the 16th ACM international conference on Supporting group work

People in books: using a FlashCam to become part of an interactive book for connected reading

Proceedings of the ACM 2012 conference on Computer Supported Cooperative Work
The fascinate production scripting engine

MMM'12 Proceedings of the 18th international conference on Advances in Multimedia Modeling
Workspace configurations: setting the stage for remote collaboration on physical tasks

Proceedings of the 7th Nordic Conference on Human-Computer Interaction: Making Sense Through Design
Scaled reality: interfaces for augmenting information on small-scale tangible objects

CHI '13 Extended Abstracts on Human Factors in Computing Systems
FocalSpace: multimodal activity tracking, synthetic blur and adaptive presentation for video conferencing

Proceedings of the 1st symposium on Spatial user interaction
3DTI amphitheater: a manageable 3DTI environment with hierarchical stream prioritization

Proceedings of the 5th ACM Multimedia Systems Conference

Quantified Score

Hi-index	0.00

Visualization

Abstract

The proliferation of broadband and high-speed Internet access has, in general, democratized the ability to commonly engage in videoconference. However, current video systems do not meet their full potential, as they are restricted to a simple display of unintelligent 2D pixels. In this paper we present a system for enhancing distance-based communication by augmenting the traditional video conferencing system with additional attributes beyond two-dimensional video. We explore how expanding a system's understanding of spatially calibrated depth and audio alongside a live video stream can generate semantically rich three-dimensional pixels containing information regarding their material properties and location. We discuss specific scenarios that explore features such as synthetic refocusing, gesture activated privacy, and spatiotemporal graphic augmentation.