Dynamic Shader Lamps: Painting on Movable Objects

• Venue: ISAR '01 Proceedings of the IEEE and ACM International Symposium on Augmented Reality (ISAR'01)
• Year: 2001

We present a Dynamic Spatially Augmented Reality systemfor augmenting movable 3D objects in an indoor environmentusing multiple projectors. We describe a real-timesystem for applying virtual paint and textures to real objectssimply by direct physical manipulation of the objectand a "paint brush" stylus. We track the objects and the"paintbrush", and illuminate the objects with images thatremain registered as they move, to create the illusion of materialproperties. The system is simple to use and we hope itmay herald new applications in diverse fields such as visualization,tele-immersion, art and architecture. The systemcurrently works with tracked objects whose geometry waspre-acquired and models created manually, but it is possibleto extend it, by adding cameras to the environment, toacquire object geometry automatically and use vision-basedtracking for the object and paintbrush.