An immersive system for browsing and visualizing surveillance video

Authors:
Philip DeCamp;George Shaw;Rony Kubat;Deb Roy
Affiliations:
MIT Media Lab, Cambridge, MA, USA;MIT Media Lab, Cambridge, MA, USA;MIT Media Lab, Cambridge, MA, USA;MIT Media Lab, Cambridge, MA, USA
Venue:
Proceedings of the international conference on Multimedia
Year:
2010

Citing 14
Cited 4

OpenGL Programming Guide: The Official Guide to Learning OpenGL, Version 1.2

OpenGL Programming Guide: The Official Guide to Learning OpenGL, Version 1.2
Video flashlights: real time rendering of multiple videos for immersive model visualization

EGRW '02 Proceedings of the 13th Eurographics workshop on Rendering
Reality Modeling and Visualization from Multiple Video Sequences

IEEE Computer Graphics and Applications
Towards video-based immersive environments

Multimedia Systems - Special issue on multimedia and multisensory virtual worlds
3D video surveillance with Augmented Virtual Environments

IWVS '03 First ACM SIGMM international workshop on Video surveillance
Forensic video reconstruction

Proceedings of the ACM 2nd international workshop on Video surveillance & sensor networks
GeoTime Information Visualization

INFOVIS '04 Proceedings of the IEEE Symposium on Information Visualization
DOTS: support for effective video surveillance

Proceedings of the 15th international conference on Multimedia
Visualizing the History of Living Spaces

IEEE Transactions on Visualization and Computer Graphics
Totalrecall: visualization and semi-automatic annotation of very large audio-visual corpora

Proceedings of the 9th international conference on Multimodal interfaces
Optimizing content-preserving projections for wide-angle images
Towards a Subject-Centered Analysis for Automated Video Surveillance

ICIAP '09 Proceedings of the 15th International Conference on Image Analysis and Processing
A human-machine collaborative approach to tracking human movement in multi-camera video

Proceedings of the ACM International Conference on Image and Video Retrieval
The human speechome project

EELC'06 Proceedings of the Third international conference on Emergence and Evolution of Linguistic Communication: symbol Grounding and Beyond

VizKid: a behavior capture and visualization system of adult-child interaction

HCII'11 Proceedings of the 1st international conference on Human interface and the management of information: interacting with information - Volume Part II
Video collections in panoramic contexts

Proceedings of the 26th annual ACM symposium on User interface software and technology
Everything is alive: towards the future wisdom Web of things

World Wide Web
Surveillance video synopsis in the compressed domain for fast video browsing

Journal of Visual Communication and Image Representation

Quantified Score

Hi-index	0.00

Visualization

Abstract

HouseFly is an interactive data browsing and visualization system that synthesizes audio-visual recordings from multiple sensors, as well as the meta-data derived from those recordings, into a unified viewing experience. The system is being applied to study human behavior in both domestic and retail situations grounded in longitudinal video recordings. HouseFly uses an immersive video technique to display multiple streams of high resolution video using a realtime warping procedure that projects the video onto a 3D model of the recorded space. The system interface provides the user with simultaneous control over both playback rate and vantage point, enabling the user to navigate the data spatially and temporally. Beyond applications in video browsing, this system serves as an intuitive platform for visualizing patterns over time in a variety of multi-modal data, including person tracks and speech transcripts.