MICOO (multimodal interactive cubes for object orientation): a tangible user interface for the blind and visually impaired

Authors:
Muhanad S. Manshad;Enrico Pontelli;Shakir J. Manshad
Affiliations:
New Mexico State University, Las Cruces, NM, USA;New Mexico State University, Las Cruces, NM, USA;New Mexico State University, Las Cruces, NM, USA
Venue:
The proceedings of the 13th international ACM SIGACCESS conference on Computers and accessibility
Year:
2011

Citing 6
Cited 1

Tangible bits: towards seamless interfaces between people, bits and atoms

Proceedings of the ACM SIGCHI Conference on Human factors in computing systems
Digital manipulatives: new toys to think with

Proceedings of the SIGCHI Conference on Human Factors in Computing Systems
Multimodal vision glove for touchscreens

Proceedings of the 10th international ACM SIGACCESS conference on Computers and accessibility
reacTIVision and TUIO: a tangible tabletop toolkit

Proceedings of the ACM International Conference on Interactive Tabletops and Surfaces
Clutching at straws: using tangible interaction to provide non-visual access to graphs

Proceedings of the SIGCHI Conference on Human Factors in Computing Systems
Tangible User Interfaces: Past, Present, and Future Directions

Foundations and Trends in Human-Computer Interaction

Trackable interactive multimodal manipulatives: towards a tangible user environment for the blind

ICCHP'12 Proceedings of the 13th international conference on Computers Helping People with Special Needs - Volume Part II

Quantified Score

Hi-index	0.00

Visualization

Abstract

This paper presents the development of Multimodal Interactive Cubes for Object Orientation (MICOO) manipulatives. This system provides a multimodal tangible user interface (TUI), enabling people with visual impairments to create, modify and naturally interact with diagrams and graphs on a multitouch surface. The system supports a novel notion of active orientation and proximity tracking of manipulatives against diagram and graph components. If the orientation of a MICOO matches a component, then a user is allowed to modify that component by moving the MICOO. Conversely, if a MICOO does not match orientation or is far from a component, audio feedback is activated to help the user reach that component. This will lessen the need for manual intervention, enable independent discovery on the part of the user, and offers dynamic behavior, whereas the representation interacts and provides feedback to the user. The platform has been developed and it is undergoing formal evaluation (e.g., browse, modify and construct graphs on a Cartesian plot and diagrams).