The micole architecture: multimodal support for inclusion of visually impaired children

Authors:
Thomas Pietrzak;Benoît Martin;Isabelle Pecci;Rami Saarinen;Roope Raisamo;Janne Järvi
Affiliations:
Université de Metz, Metz, France;Université de Metz, Metz, France;Université de Metz, Metz, France;University of Tampere, Tampere, Finland;University of Tampere, Tampere, Finland;University of Tampere, Tampere, Finland
Venue:
Proceedings of the 9th international conference on Multimodal interfaces
Year:
2007

Citing 9
Cited 3

A generic platform for addressing the multimodal challenge

CHI '95 Proceedings of the SIGCHI Conference on Human Factors in Computing Systems
Multimodal user interfaces in the Open Agent Architecture

Proceedings of the 2nd international conference on Intelligent user interfaces
Pattern-oriented software architecture: a system of patterns

Pattern-oriented software architecture: a system of patterns
Agent-based architecture for implementing multimodal learning environments for visually impaired children

ICMI '05 Proceedings of the 7th international conference on Multimodal interfaces
Supporting visually impaired children with software agents in a multimodal learning environment

Virtual Reality
Two-handed navigation in a haptic virtual environment

CHI '06 Extended Abstracts on Human Factors in Computing Systems
Affichage d'informations par des impulsions haptiques

IHM 2005 Proceedings of the 17th international conference on Francophone sur l'Interaction Homme-Machine
ABLE: a toolkit for building multiagent autonomic systems

IBM Systems Journal
Non visual haptic audio tools for virtual environments

HAID'06 Proceedings of the First international conference on Haptic and Audio Interaction Design

Graphisme tactile appliqué aux illustrations de manuels scolaires à l'usage d'enfants ayant une déficience visuelle

Proceedings of the 20th International Conference of the Association Francophone d'Interaction Homme-Machine
Groupware Accessibility for Persons with Disabilities

UAHCI '09 Proceedings of the 5th International Conference on Universal Access in Human-Computer Interaction. Part III: Applications and Services
Audio makes a difference in haptic collaborative virtual environments

Interacting with Computers

Quantified Score

Hi-index	0.00

Visualization

Abstract

Modern information technology allows us to seek out new ways to support the computer use and communication of disabled people. With the aid of new interaction technologies and techniques visually impaired and sighted users can collaborate, for example, in the classroom situations. The main goal of the MICOLE project was to create a software architecture that makes it easier for the developers to create multimodal multi-user applications. The framework is based on interconnected software agents. The hardware used in this study includes VTPlayer Mouse which has two built-in Braille displays, and several haptic devices such as PHANToM Omni, PHANToM Desktop and PHANToM Premium. We also used the SpaceMouse and various audio setups in the applications. In this paper we present a software architecture, a set of software agents, and an example of using the architecture. The example application shown is an electric circuit application that follows the single-user with many devices scenario. The application uses a PHANToM and a VTPlayer Mouse together with visual and audio feedback to make the electric circuits understandable through touch.