Photo-Based User Interfaces: Picture It, Tag It, Use It

  • Authors:
  • Geert Vanderhulst;Kris Luyten;Karin Coninx

  • Affiliations:
  • Expertise Centre for Digital Media, Hasselt University - transnationale Universiteit Limburg - IBBT, Diepenbeek, Belgium 3590;Expertise Centre for Digital Media, Hasselt University - transnationale Universiteit Limburg - IBBT, Diepenbeek, Belgium 3590;Expertise Centre for Digital Media, Hasselt University - transnationale Universiteit Limburg - IBBT, Diepenbeek, Belgium 3590

  • Venue:
  • OTM '09 Proceedings of the Confederated International Workshops and Posters on On the Move to Meaningful Internet Systems: ADI, CAMS, EI2N, ISDE, IWSSA, MONET, OnToContent, ODIS, ORM, OTM Academy, SWWS, SEMELS, Beyond SAWSDL, and COMBEK 2009
  • Year:
  • 2009

Quantified Score

Hi-index 0.00

Visualization

Abstract

Pervasive environments can be hard to configure and interact with using handheld computing devices, due to the mismatch between physical and digital worlds. Usually, smart resources in the user's vicinity are discovered and presented in a menu on the user's device from where they can be accessed. However, in environments with many embedded resources it becomes hard to identify resources by means of a textual description and to get aware of the tasks they support. As an alternative to menu-driven interfaces, we demonstrate annotated photos as a means for controlling a pervasive environment. We present as part of our approach a tool that enables people to picture their own environment and use photos as building blocks to create an interactive digital view on their surroundings. To demonstrate and evaluate our approach, we engineered a pervasive prototype application that is operated through a photo-based user interface and assembled using ontologies.