UI on the Fly: generating a multimodal user interface

  • Authors:
  • David Reitter;Erin Marie Panttaja;Fred Cummins

  • Affiliations:
  • Media Lab Europe, Dublin, Ireland;Media Lab Europe, Dublin, Ireland;University College Dublin, Dublin, Ireland

  • Venue:
  • HLT-NAACL-Short '04 Proceedings of HLT-NAACL 2004: Short Papers
  • Year:
  • 2004

Quantified Score

Hi-index 0.00

Visualization

Abstract

UI on the Fly is a system that dynamically presents coordinated multimodal content through natural language and a small-screen graphical user interface. It adapts to the user's preferences and situation. Multimodal Functional Unification Grammar (MUG) is a unification-based formalism that uses rules to generate content that is coordinated across several communication modes. Faithful variants are scored with a heuristic function.