A voice and ink XML multimodal architecture for mobile e-commerce systems

Authors:
Zouheir Trabelsi;Sung-Hyuk Cha;Darshan Desai;Charles Tappert
Affiliations:
Pace University, Pleasantville NY;Pace University, Pleasantville NY;Pace University, Pleasantville NY;Pace University, Pleasantville NY
Venue:
WMC '02 Proceedings of the 2nd international workshop on Mobile commerce
Year:
2002

Citing 9
Cited 5

Integration and synchronization of input modes during multimodal human-computer interaction

Proceedings of the ACM SIGCHI Conference on Human factors in computing systems
MedSpeak: report creation with continuous speech recognition

Proceedings of the ACM SIGCHI Conference on Human factors in computing systems
QuickSet: multimodal interaction for distributed applications

MULTIMEDIA '97 Proceedings of the fifth ACM international conference on Multimedia
Computer-human interface solutions for emergency medical care

interactions
Designing the user interface for pen and speech multimedia applications

CHI '99 Extended Abstracts on Human Factors in Computing Systems
“Put-that-there”: Voice and gesture at the graphics interface

SIGGRAPH '80 Proceedings of the 7th annual conference on Computer graphics and interactive techniques
Confirmation in multimodal systems

COLING '98 Proceedings of the 17th international conference on Computational linguistics - Volume 2
Multimodal interactive maps: designing for human performance

Human-Computer Interaction
Designing the user interface for multimodal speech and pen-based gesture applications: state-of-the-art systems and future research directions

Human-Computer Interaction

Dialog generation for voice browsing

W4A '06 Proceedings of the 2006 international cross-disciplinary workshop on Web accessibility (W4A): Building the mobile web: rediscovering accessibility?
A Mobile Ticket System Based on Personal Trusted Device

Wireless Personal Communications: An International Journal
A server-aided signature scheme for mobile commerce

IWCMC '07 Proceedings of the 2007 international conference on Wireless communications and mobile computing
Voice enabling mobile financial services with multimodal transformation

International Journal of Mobile Communications
A unifying architecture for easy development, deployment and management of voice-driven mobile applications

Proceedings of the 7th International Conference on Network and Services Management

Quantified Score

Hi-index	0.00

Visualization

Abstract

This paper presents a multimodal interface architecture that combines standardized voice and ink formats to facilitate the creation of robust and efficient multimodal mobile e-Commerce systems, particularly for noisy mobile environments. The platform provides a Web interactive system for generic multimodal application development. By providing mutual disambiguation of input signals and superior error handling this architecture should broaden the spectrum of users to the general population, including permanently and temporarily disabled users. Integration of VoiceXML and InkXML provides a standard data format to facilitate Web based development and content delivery. We present a prototype platform and sample dialogues.