The NESPOLE! Multimodal Interface for Cross-lingual Communication - Experience and Lessons Learned

Authors:
Erica Costantini
Affiliations:
-
Venue:
ICMI '02 Proceedings of the 4th IEEE International Conference on Multimodal Interfaces
Year:
2002

Citing 3
Cited 0

The Added Value of Multimodality in the NESPOLE! Speech-to-Speech Translation System: an Experimental Study

ICMI '02 Proceedings of the 4th IEEE International Conference on Multimodal Interfaces
Architecture and design considerations in NESPOLE!: a speech translation system for e-commerce applications

HLT '01 Proceedings of the first international conference on Human language technology research
The NESPOLE! speech-to-speech translation system

HLT '02 Proceedings of the second international conference on Human Language Technology Research

Quantified Score

Hi-index	0.01

Visualization

Abstract

In this paper we describe the design, evolution, and development of the user interface components of the NESPOLE! speech-to-speech translation system. The NESPOLE! system was designed for users with medium-to-low levels of computer literacy and web expertise. The user interface was designed to effectively combine web browsing, real-time sharing of graphical information and multi-modal annotations using a shared whiteboard, and real-time multilingual speech communication, all within an e-commerce scenario. Data collected in sessions with naïve users in several stages in the process of system development formed the basis for improving the effectiveness and usability of the system. We describe this development process, the resulting interface components and the lessons learned.