RFIG lamps: interacting with a self-describing world via photosensing wireless tags and projectors

Authors:
Ramesh Raskar;Paul Beardsley;Jeroen van Baar;Yao Wang;Paul Dietz;Johnny Lee;Darren Leigh;Thomas Willwacher
Affiliations:
Mitsubishi Electric Research Labs, Cambridge MA;Mitsubishi Electric Research Labs, Cambridge MA;Mitsubishi Electric Research Labs, Cambridge MA;Mitsubishi Electric Research Labs, Cambridge MA;Mitsubishi Electric Research Labs, Cambridge MA;Mitsubishi Electric Research Labs, Cambridge MA;Mitsubishi Electric Research Labs, Cambridge MA;Mitsubishi Electric Research Labs, Cambridge MA
Venue:
ACM SIGGRAPH 2004 Papers
Year:
2004

Citing 20
Cited 52

The active badge location system

ACM Transactions on Information Systems (TOIS)
Bridging physical and virtual worlds with electronic tags

Proceedings of the SIGCHI conference on Human Factors in Computing Systems
Emancipated pixels: real-world graphics in the luminous room

Proceedings of the 26th annual conference on Computer graphics and interactive techniques
Implementing phicons: combining computer vision with infrared technology for interactive physical icons

Proceedings of the 12th annual ACM symposium on User interface software and technology
Amorphous computing

Communications of the ACM
Sensing techniques for mobile interaction

UIST '00 Proceedings of the 13th annual ACM symposium on User interface software and technology
A Flexible New Technique for Camera Calibration

IEEE Transactions on Pattern Analysis and Machine Intelligence
Random sample consensus: a paradigm for model fitting with applications to image analysis and automated cartography

Communications of the ACM
Sensetable: a wireless object tracking platform for tangible user interfaces

Proceedings of the SIGCHI Conference on Human Factors in Computing Systems
DataTiles: a modular platform for mixed physical and graphical interactions

Proceedings of the SIGCHI Conference on Human Factors in Computing Systems
Multiple view geometry in computer visiond

Multiple view geometry in computer visiond
Recent Advances in Augmented Reality

IEEE Computer Graphics and Applications
The Virtual Showcase

IEEE Computer Graphics and Applications
Shader Lamps: Animating Real Objects With Image-Based Illumination

Proceedings of the 12th Eurographics Workshop on Rendering Techniques
The Everywhere Displays Projector: A Device to Create Ubiquitous Graphical Interfaces

UbiComp '01 Proceedings of the 3rd international conference on Ubiquitous Computing
Smart-Its Friends: A Technique for Users to Easily Establish Connections between Smart Artefacts

UbiComp '01 Proceedings of the 3rd international conference on Ubiquitous Computing
The FindIT Flashlight: Responsive Tagging Based on Optically Triggered Microprocessor Wakeup

UbiComp '02 Proceedings of the 4th international conference on Ubiquitous Computing
Pervasive Pose-Aware Applications and Infrastructure

IEEE Computer Graphics and Applications
iLamps: geometrically aware and self-configuring projectors

ACM SIGGRAPH 2003 Papers
An installation of interactive furniture

IBM Systems Journal

Photosensing wireless tags for geometric procedures

Communications of the ACM - Special issue: RFID
Moveable interactive projected displays using projector based tracking

Proceedings of the 18th annual ACM symposium on User interface software and technology
Zoom-and-pick: facilitating visual zooming and precision pointing with interactive handheld projectors

Proceedings of the 18th annual ACM symposium on User interface software and technology
Product Associated Displays in a Shopping Scenario

ISMAR '05 Proceedings of the 4th IEEE/ACM International Symposium on Mixed and Augmented Reality
The Smart Phone: A Ubiquitous Input Device

IEEE Pervasive Computing
Interacting with dynamically defined information spaces using a handheld projector and a pen

UIST '06 Proceedings of the 19th annual ACM symposium on User interface software and technology
Instant replay using high speed motion capture and projected overlay

ACM SIGGRAPH 2006 Sketches
Modern approaches to augmented reality

SIGGRAPH '05 ACM SIGGRAPH 2005 Courses
iProCam: a lens-sharing projector-camera system for augmented reality applications

CHI '07 Extended Abstracts on Human Factors in Computing Systems
VisiCon: a robot control interface for visualizing manipulation using a handheld projector

Proceedings of the international conference on Advances in computer entertainment technology
Sharing visual information in virtual environments using projective texture mapping

Proceedings of the international conference on Advances in computer entertainment technology
Prakash: lighting aware motion capture using photosensing markers and multiplexed illuminators

ACM SIGGRAPH 2007 papers
Illumination sensitive dynamic virtual sets

ACM SIGGRAPH 2007 emerging technologies
Multi-user interaction using handheld projectors

Proceedings of the 20th annual ACM symposium on User interface software and technology
RFID-based networks: exploiting diversity and redundancy

ACM SIGMOBILE Mobile Computing and Communications Review
The visual computing of projector-camera systems

ACM SIGGRAPH 2008 classes
The universal media book: tracking and augmenting moving surfaces with projected information

ISMAR '06 Proceedings of the 5th IEEE and ACM International Symposium on Mixed and Augmented Reality
Projected interfaces: enabling serendipitous interaction with smart tangible objects

Proceedings of the 3rd International Conference on Tangible and Embedded Interaction
Bokode: imperceptible visual tags for camera based interaction from a distance

ACM SIGGRAPH 2009 papers
Motion Capture System Using an Optical Resolver

Proceedings of the 13th International Conference on Human-Computer Interaction. Part III: Ubiquitous and Intelligent Interaction
Bonfire: a nomadic system for hybrid laptop-tabletop interaction

Proceedings of the 22nd annual ACM symposium on User interface software and technology
Marauders light: replacing the wand with a mobile camera projector unit

Proceedings of the 8th International Conference on Mobile and Ubiquitous Multimedia
MotionBeam: designing for movement with handheld projectors

CHI '10 Extended Abstracts on Human Factors in Computing Systems
iLight: information flashlight on objects using handheld projector

CHI '10 Extended Abstracts on Human Factors in Computing Systems
uPackage: a package to enable do-it-yourself style ubiquitous services with daily objects

UCS'07 Proceedings of the 4th international conference on Ubiquitous computing systems
An explorative comparison of magic lens and personal projection for interacting with smart objects

Proceedings of the 12th international conference on Human computer interaction with mobile devices and services
Sensing through structure: designing soft silicone sensors

Proceedings of the fifth international conference on Tangible, embedded, and embodied interaction
Transferring information from mobile devices to personal computers by using vibration and accelerometer

Proceedings of the 13th international conference on Ubiquitous computing
Ubiquitous augmented reality: expanding augmented reality environment with wireless tags and visible light communication projector

Proceedings of the 13th international conference on Ubiquitous computing
OmniTouch: wearable multitouch interaction everywhere

Proceedings of the 24th annual ACM symposium on User interface software and technology
Projector phone use: practices and social implications

Personal and Ubiquitous Computing
Pico-ing into the future of mobile projection and contexts

Personal and Ubiquitous Computing
The projector as instrument

Personal and Ubiquitous Computing
Mobile information presentation schemes for supra-adaptive logistics applications

ICAT'06 Proceedings of the 16th international conference on Advances in Artificial Reality and Tele-Existence
On-body interaction: armed and dangerous

Proceedings of the Sixth International Conference on Tangible, Embedded and Embodied Interaction
Tracking locations of moving hand-held displays using projected light

PERVASIVE'05 Proceedings of the Third international conference on Pervasive Computing
To frame or not to frame: the role and design of frameless displays in ubiquitous applications

UbiComp'05 Proceedings of the 7th international conference on Ubiquitous Computing
LightGuide: projected visualizations for hand movement guidance

Proceedings of the SIGCHI Conference on Human Factors in Computing Systems
SpeckleEye: gestural interaction for embedded electronics in ubiquitous computing

CHI '12 Extended Abstracts on Human Factors in Computing Systems
LightBeam: nomadic pico projector interaction with real world objects

CHI '12 Extended Abstracts on Human Factors in Computing Systems
Interactive environment-aware handheld projectors for pervasive computing spaces

Pervasive'12 Proceedings of the 10th international conference on Pervasive Computing
Revisiting peephole pointing: a study of target acquisition with a handheld projector

MobileHCI '12 Proceedings of the 14th international conference on Human-computer interaction with mobile devices and services
PICOntrol: using a handheld projector for direct control of physical devices through visible light

Proceedings of the 25th annual ACM symposium on User interface software and technology
LightBeam: interacting with augmented real-world objects in pico projections

Proceedings of the 11th International Conference on Mobile and Ubiquitous Multimedia
HideOut: mobile projector interaction with tangible objects and surfaces

Proceedings of the 7th International Conference on Tangible, Embedded and Embodied Interaction
InfraStructs: fabricating information inside physical objects for imaging in the terahertz region

ACM Transactions on Graphics (TOG) - SIGGRAPH 2013 Conference Proceedings
Designing disambiguation techniques for pointing in the physical world

Proceedings of the 5th ACM SIGCHI symposium on Engineering interactive computing systems
Displaydrone: a flying robot based interactive display

Proceedings of the 2nd ACM International Symposium on Pervasive Displays
Mobile pointing task in the physical world: balancing focus and performance while disambiguating

Proceedings of the 15th international conference on Human-computer interaction with mobile devices and services
Cooperative augmentation of mobile smart objects with projected displays

ACM Transactions on Interactive Intelligent Systems (TiiS) - Special issue on interaction with smart objects, Special section on eye gaze and conversation
Lumitrack: low cost, high precision, high speed tracking with projected m-sequences

Proceedings of the 26th annual ACM symposium on User interface software and technology
HiFi: hide and find digital content associated with physical objects via coded light

Proceedings of the 15th Workshop on Mobile Computing Systems and Applications

Quantified Score

Hi-index	0.01

Visualization

Abstract

This paper describes how to instrument the physical world so that objects become self-describing, communicating their identity, geometry, and other information such as history or user annotation. The enabling technology is a wireless tag which acts as a radio frequency identity and geometry (RFIG) transponder. We show how addition of a photo-sensor to a wireless tag significantly extends its functionality to allow geometric operations - such as finding the 3D position of a tag, or detecting change in the shape of a tagged object. Tag data is presented to the user by direct projection using a handheld locale-aware mobile projector. We introduce a novel technique that we call interactive projection to allow a user to interact with projected information e.g. to navigate or update the projected information.The ideas are demonstrated using objects with active radio frequency (RF) tags. But the work was motivated by the advent of unpowered passive-RFID, a technology that promises to have significant impact in real-world applications. We discuss how our current prototypes could evolve to passive-RFID in the future.