Development of a dual-modal information presentation of sequential relationship

Authors:
Shuang Xu;Xiaowen Fang;Susy Chan
Affiliations:
Human Factors Research & Design, Consumer Experience Design, Motorola Inc., 600 North US Highway 45, Libertyville, IL 60048, USA.;College of Computing and Digital Media, DePaul University, 243 S. Wabash Avenue, Chicago, IL 60614, USA.;College of Computing and Digital Media, DePaul University, 243 S. Wabash Avenue, Chicago, IL 60614, USA
Venue:
International Journal of Mobile Learning and Organisation
Year:
2009

Citing 17
Cited 0

Codes and modalities in multiple resources: a success and a qualification

Human Factors - Special Issue: Human information processing: theory and applications
Task-sharing within and between hemispheres: a multiple-resources approach

Human Factors - Special Issue: Human information processing: theory and applications
A visual representation for knowledge structures

HYPERTEXT '89 Proceedings of the second annual ACM conference on Hypertext
Mental models

Foundations of cognitive science
Expressive richness: a comparison of speech and text as media for revision

CHI '91 Proceedings of the SIGCHI Conference on Human Factors in Computing Systems
Merging expert systems with multimedia technology

ACM SIGMIS Database
The effects on decision task performance of computer synthetic voice output

International Journal of Man-Machine Studies
The role of natural language in a multimodal interface

UIST '92 Proceedings of the 5th annual ACM symposium on User interface software and technology
Turning away from talking heads: the use of video-as-data in neurosurgery

INTERCHI '93 Proceedings of the INTERCHI '93 conference on Human factors in computing systems
Applying the Technology Acceptance Model and Flow Theory to Online Consumer Behavior

Information Systems Research
Introduction to Human Factors Engineering (2nd Edition)

Introduction to Human Factors Engineering (2nd Edition)
Mobile learning challenges and potentials

International Journal of Mobile Learning and Organisation
Mobile technology in education: uses and benefits

International Journal of Mobile Learning and Organisation
Development of a mobile learning model with usability features for online education

International Journal of Mobile Learning and Organisation
Changes in teaching and learning through digital media for higher education institutions

International Journal of Mobile Learning and Organisation
Designing multimedia learning objects for PDAs

International Journal of Mobile Learning and Organisation
Investigation of voice and text output modes with abstraction in a computer interface

Interacting with Computers

Quantified Score

Hi-index	0.00

Visualization

Abstract

This study focuses on how to design a visual-auditory presentation to minimise the interference in information processing between modality channels; and to improve the effectiveness of mental integration of multimodal information. A method was proposed to convert textual information describing sequential relationships into a 'graphics + voice' presentation. It was hypothesised that this dual-modal presentation would result in superior comprehension performance and user satisfaction as compared with the pure textual display. Findings of our experiment fully supported the hypothesis and would benefit interface design of mobile applications by alleviating the overabundance of information output in the visual channel.