SCAAT: incremental tracking with incomplete information
Proceedings of the 24th annual conference on Computer graphics and interactive techniques
Motion Tracking: No Silver Bullet, but a Respectable Arsenal
IEEE Computer Graphics and Applications
The FindIT Flashlight: Responsive Tagging Based on Optically Triggered Microprocessor Wakeup
UbiComp '02 Proceedings of the 4th international conference on Ubiquitous Computing
Estimating cloth simulation parameters from video
Proceedings of the 2003 ACM SIGGRAPH/Eurographics symposium on Computer animation
ID CAM: A Smart Camera for Scene Capturing and ID Recognition
ISMAR '03 Proceedings of the 2nd IEEE/ACM International Symposium on Mixed and Augmented Reality
RFIG lamps: interacting with a self-describing world via photosensing wireless tags and projectors
ACM SIGGRAPH 2004 Papers
Embedding Imperceptible Patterns into Projected Images for Simultaneous Acquisition and Display
ISMAR '04 Proceedings of the 3rd IEEE/ACM International Symposium on Mixed and Augmented Reality
Moveable interactive projected displays using projector based tracking
Proceedings of the 18th annual ACM symposium on User interface software and technology
Smart Light-Ultra High Speed Projector for Spatial Multiplexing Optical Transmission
CVPR '05 Proceedings of the 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05) - Workshops - Volume 03
Instant replay using high speed motion capture and projected overlay
ACM SIGGRAPH 2006 Sketches
Shadowtrack: A Novel Tracking System Based on Spreadspectrum Spatio-Temporal Illumination
Presence: Teleoperators and Virtual Environments
A wirelessly-powered platform for sensing and computation
UbiComp'06 Proceedings of the 8th international conference on Ubiquitous Computing
Illumination sensitive dynamic virtual sets
ACM SIGGRAPH 2007 emerging technologies
The visual computing of projector-camera systems
ACM SIGGRAPH 2008 classes
Motion capture system using single-track gray code
ACE '08 Proceedings of the 2008 International Conference on Advances in Computer Entertainment Technology
Second skin: motion capture with actuated feedback for motor learning
CHI '09 Extended Abstracts on Human Factors in Computing Systems
Haptic ring: touching virtual creatures in mixed reality environments
SIGGRAPH '09: Posters
Point and Control: The Intuitive Method to Control Multi-device with Single Remote Control
Proceedings of the 13th International Conference on Human-Computer Interaction. Part III: Ubiquitous and Intelligent Interaction
Action capture with accelerometers
Proceedings of the 2008 ACM SIGGRAPH/Eurographics Symposium on Computer Animation
ACM SIGGRAPH ASIA 2009 Sketches
Marker-based human motion capture in multiview sequences
EURASIP Journal on Advances in Signal Processing
Motion capture from body-mounted cameras
ACM SIGGRAPH 2011 papers
Proceedings of the 13th international conference on Ubiquitous computing
Second skin: motion capture with actuated feedback for motor learning
ACM SIGGRAPH 2011 Posters
SpeckleSense: fast, precise, low-cost and compact motion sensing using laser speckle
Proceedings of the 24th annual ACM symposium on User interface software and technology
IrCube tracker: an optical 6-DOF tracker based on LED directivity
Proceedings of the 24th annual ACM symposium on User interface software and technology
The role of physical controllers in motion video gaming
Proceedings of the Designing Interactive Systems Conference
Full body performance capture under uncontrolled and varying illumination: a shading-based approach
ECCV'12 Proceedings of the 12th European conference on Computer Vision - Volume Part IV
Lumitrack: low cost, high precision, high speed tracking with projected m-sequences
Proceedings of the 26th annual ACM symposium on User interface software and technology
Scalable optical tracking for navigating large virtual environments using spatially encoded markers
Proceedings of the 19th ACM Symposium on Virtual Reality Software and Technology
The matching of infrared markers for tracking objects using stereo pairs
Pattern Recognition and Image Analysis
Hi-index | 0.00 |
In this paper, we present a high speed optical motion capture method that can measure three dimensional motion, orientation, and incident illumination at tagged points in a scene. We use tracking tags that work in natural lighting conditions and can be imperceptibly embedded in attire or other objects. Our system supports an unlimited number of tags in a scene, with each tag uniquely identified to eliminate marker reacquisition issues. Our tags also provide incident illumination data which can be used to match scene lighting when inserting synthetic elements. The technique is therefore ideal for on-set motion capture or real-time broadcasting of virtual sets. Unlike previous methods that employ high speed cameras or scanning lasers, we capture the scene appearance using the simplest possible optical devices - a light-emitting diode (LED) with a passive binary mask used as the transmitter and a photosensor used as the receiver. We strategically place a set of optical transmitters to spatio-temporally encode the volume of interest. Photosensors attached to scene points demultiplex the coded optical signals from multiple transmitters, allowing us to compute not only receiver location and orientation but also their incident illumination and the reflectance of the surfaces to which the photosensors are attached. We use our untethered tag system, called Prakash, to demonstrate methods of adding special effects to captured videos that cannot be accomplished using pure vision techniques that rely on camera images.