Tangible interaction with real and virtual products: designing a shopping assistant for rural communities

Authors:
Michael Schmitz;Homeira Quraischy
Affiliations:
DFKI GmbH and Saarland University, Saarbrücken, Germany;Saarland University, Saarbrücken, Germany
Venue:
Proceedings of the 3rd International Conference on Tangible and Embedded Interaction
Year:
2009

Citing 4
Cited 1

Readings in intelligent user interfaces

Readings in intelligent user interfaces
Ten myths of multimodal interaction

Communications of the ACM
Multimodal interfaces

The human-computer interaction handbook
Integrating intra and extra gestures into a mobile and multimodal shopping assistant

PERVASIVE'05 Proceedings of the Third international conference on Pervasive Computing

Pushing personhood into place: Situating media in rural knowledge in Africa

International Journal of Human-Computer Studies

Quantified Score

Hi-index	0.00

Visualization

Abstract

This work describes the design and development process of an interactive ordering system for rural corner stores, extending the limited assortment of a small store with virtual items on touch-sensitive displays embedded into shelves. The interface blends tangible interaction of both real products in a shelf and virtual products iconically represented on nearby screens. The tangible interaction component is complemented by a natural language interface, supporting comparison and inspection of multiple products of the real and virtual world.