Toolglass and magic lenses: the see-through interface
SIGGRAPH '93 Proceedings of the 20th annual conference on Computer graphics and interactive techniques
Speeded-Up Robust Features (SURF)
Computer Vision and Image Understanding
From the internet of computers to the internet of things
From active data management to event-based systems and more
Demo: uncovering device whispers in smart homes
Proceedings of the 11th International Conference on Mobile and Ubiquitous Multimedia
Smarter objects: using AR technology to program physical objects and their interactions
CHI '13 Extended Abstracts on Human Factors in Computing Systems
Hi-index | 0.00 |
Supporting human users when interacting with smart devices is important to drive the successful adoption of the Internet of Things in people's homes and at their workplaces. In this poster contribution, we present a system that helps users control Web-enabled smart things in their environment. Our approach involves a handheld interaction device that recognizes smart things in its view using state-of-the-art visual object recognition techniques. It then augments the camera feed with appropriate interaction primitives such as knobs or buttons for control, and can also display measured values, for instance, when recognizing a sensor. The interaction primitives are generated from user interface descriptions that are embedded in the Web representations of the smart things. Our prototype implementation achieves frame rates that allow for interactive use of the system by human users, and indeed proved to facilitate the interaction with smart things in a demonstration testbed in our research group.