Agent-based architecture for implementing multimodal learning environments for visually impaired children

Authors:
Rami Saarinen;Janne Järvi;Roope Raisamo;Jouni Salo
Affiliations:
University of Tampere, Finland;University of Tampere, Finland;University of Tampere, Finland;University of Tampere, Finland
Venue:
ICMI '05 Proceedings of the 7th international conference on Multimodal interfaces
Year:
2005

Citing 5
Cited 6

A generic platform for addressing the multimodal challenge

CHI '95 Proceedings of the SIGCHI Conference on Human Factors in Computing Systems
Multimodal user interfaces in the Open Agent Architecture

Proceedings of the 2nd international conference on Intelligent user interfaces
Multimodal Maps: An Agent-Based Approach

Multimodal Human-Computer Communication, Systems, Techniques, and Experiments
CommandTalk: a spoken-language interface for battlefield simulations

ANLC '97 Proceedings of the fifth conference on Applied natural language processing
Experiences on haptic interfaces for visually impaired young children

Proceedings of the 6th international conference on Multimodal interfaces

Testing Usability of Multimodal Applications with Visually Impaired Children

IEEE MultiMedia
The micole architecture: multimodal support for inclusion of visually impaired children

Proceedings of the 9th international conference on Multimodal interfaces
Image and video processing for visually handicapped people

Journal on Image and Video Processing
Supporting Collaboration between Visually Impaired and Sighted Children in a Multimodal Learning Environment

HAID '08 Proceedings of the 3rd international workshop on Haptic and Audio Interaction Design
Proactive agents to assist multimodal explorative learning of astronomical phenomena

Advances in Human-Computer Interaction - Special issue on interactive play and learning for children
Audio makes a difference in haptic collaborative virtual environments

Interacting with Computers

Quantified Score

Hi-index	0.00

Visualization

Abstract

Visually impaired children have a great disadvantage in the modern society since their ability to use modern computer technology is limited due to inappropriate user interfaces. The aim of the work presented in this paper was to develop a multimodal software architecture and applications to support visually impaired children and to enable them to interact equally with sighted children in learning situations. The architecture is based on software agents, and has specific support for visual, auditory and haptic interaction. It has been used successfully with different groups of 7-8-year-old and 12-year-old visually impaired children. In this paper we focus on the enabling software technology and interaction techniques aimed to realize our goal.