Cooperative augmentation of smart objects with projector-camera systems

Authors:
David Molyneaux;Hans Gellersen;Gerd Kortuem;Bernt Schiele
Affiliations:
Computing Department, Lancaster University, England;Computing Department, Lancaster University, England;Computing Department, Lancaster University, England;Computer Science Department, Darmstadt University of Technology
Venue:
UbiComp '07 Proceedings of the 9th international conference on Ubiquitous computing
Year:
2007

Citing 21
Cited 11

Color indexing

International Journal of Computer Vision
CONDENSATION—Conditional Density Propagation forVisual Tracking

International Journal of Computer Vision
Recognition without Correspondence using MultidimensionalReceptive Field Histograms

International Journal of Computer Vision
Random sample consensus: a paradigm for model fitting with applications to image analysis and automated cartography

Communications of the ACM
What's Real About Virtual Reality?

IEEE Computer Graphics and Applications
The Everywhere Displays Projector: A Device to Create Ubiquitous Graphical Interfaces

UbiComp '01 Proceedings of the 3rd international conference on Ubiquitous Computing
Context Acquisition Based on Load Sensing

UbiComp '02 Proceedings of the 4th international conference on Ubiquitous Computing
Marker Tracking and HMD Calibration for a Video-Based Augmented Reality Conferencing System

IWAR '99 Proceedings of the 2nd IEEE and ACM International Workshop on Augmented Reality
Interacting with Steerable Projected Displays

FGR '02 Proceedings of the Fifth IEEE International Conference on Automatic Face and Gesture Recognition
Dynamic Shader Lamps: Painting on Movable Objects

ISAR '01 Proceedings of the IEEE and ACM International Symposium on Augmented Reality (ISAR'01)
A Wearable Mixed Reality with an On-Board Projector

ISMAR '03 Proceedings of the 2nd IEEE/ACM International Symposium on Mixed and Augmented Reality
Scale & Affine Invariant Interest Point Detectors

International Journal of Computer Vision
Distinctive Image Features from Scale-Invariant Keypoints

International Journal of Computer Vision
Projected Augmentation - Augmented Reality using Rotatable Video Projectors

ISMAR '04 Proceedings of the 3rd IEEE/ACM International Symposium on Mixed and Augmented Reality
A Projector-Camera System with Real-Time Photometric Adaptation for Dynamic Environments

CVPR '05 Proceedings of the 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05) - Volume 1 - Volume 01
Spatial Augmented Reality: Merging Real and Virtual Worlds

Spatial Augmented Reality: Merging Real and Virtual Worlds
Moveable interactive projected displays using projector based tracking

Proceedings of the 18th annual ACM symposium on User interface software and technology
The particle computer system

IPSN '05 Proceedings of the 4th international symposium on Information processing in sensor networks
RFIG lamps: interacting with a self-describing world via photosensing wireless tags and projectors

SIGGRAPH '05 ACM SIGGRAPH 2005 Courses
Ubiquitous interaction - using surfaces in everyday environments as pointing devices

ERCIM'02 Proceedings of the User interfaces for all 7th international conference on Universal access: theoretical perspectives, practice, and experience
Tracking locations of moving hand-held displays using projected light

PERVASIVE'05 Proceedings of the Third international conference on Pervasive Computing

Vision-Based Detection of Mobile Smart Objects

EuroSSC '08 Proceedings of the 3rd European Conference on Smart Sensing and Context
Projected interfaces: enabling serendipitous interaction with smart tangible objects

Proceedings of the 3rd International Conference on Tangible and Embedded Interaction
Visible imagination: projected play

Proceedings of the 23rd British HCI Group Annual Conference on People and Computers: Celebrating People and Technology
An explorative comparison of magic lens and personal projection for interacting with smart objects

Proceedings of the 12th international conference on Human computer interaction with mobile devices and services
Pico-ing into the future of mobile projection and contexts

Personal and Ubiquitous Computing
Nondirective information presentation for on-site safety training in chemistry experiments

Proceedings of the International Working Conference on Advanced Visual Interfaces
Interactive environment-aware handheld projectors for pervasive computing spaces

Pervasive'12 Proceedings of the 10th international conference on Pervasive Computing
Steerable augmented reality with the beamatron

Proceedings of the 25th annual ACM symposium on User interface software and technology
Configuring and controlling ubiquitous computing infrastructure with semantic connections: a tangible and an AR approach

Personal and Ubiquitous Computing
Cooperative augmentation of mobile smart objects with projected displays

ACM Transactions on Interactive Intelligent Systems (TiiS) - Special issue on interaction with smart objects, Special section on eye gaze and conversation
User experience and usage scenarios of audio-tactile interaction with virtual objects in a physical environment

Proceedings of the 6th International Conference on Designing Pleasurable Products and Interfaces

Quantified Score

Hi-index	0.00

Visualization

Abstract

In this paper we present a new approach for cooperation between mobile smart objects and projector-camera systems to enable augmentation of the surface of objects with interactive projected displays. We investigate how a smart object's capability for self description and sensing can be used in cooperation with the vision capability of projector-camera systems to help locate, track and display information onto object surfaces in an unconstrained environment. Finally, we develop a framework that can be applied to distributed projector-camera systems, cope with varying levels of description knowledge and different sensors embedded in an object.