Interaction design and implementation for multimodal mobile semantic web interfaces

  • Authors:
  • Daniel Sonntag

  • Affiliations:
  • German Research Center for Artificial Intelligence, Saarbrücken, Germany

  • Venue:
  • Proceedings of the 2007 conference on Human interface: Part II
  • Year:
  • 2007

Quantified Score

Hi-index 0.00

Visualization

Abstract

Multimodal mobile interfaces to the Semantic Web offer access to complex knowledge and information structures. In SmartWeb we try to build multimodal interfaces to answer very specific closed and open domain questions by natural language dialogue and multimedia presentations. Advanced user interactions such as pointing gestures are also supported. We present the interaction design and its implementation for Semantic Web related knowledge structures, i.e., ontology instances and relations, and follow the principle of no presentation without representation for information content, its presentation, and interaction possibilities. In particular, we address the challenge to display interactive text and image results obtained from multiple homogeneous and heterogeneous information sources.