Where the action is: the foundations of embodied interaction
Where the action is: the foundations of embodied interaction
Multimodal human discourse: gesture and speech
ACM Transactions on Computer-Human Interaction (TOCHI)
CSCW '02 Proceedings of the 2002 ACM conference on Computer supported cooperative work
Auditory browser for blind and visually impaired users
CHI '99 Extended Abstracts on Human Factors in Computing Systems
Using haptics in computer interfaces for blind people
CHI '01 Extended Abstracts on Human Factors in Computing Systems
HOMERE: a Multimodal System for Visually Impaired People to Explore Virtual Environments
VR '03 Proceedings of the IEEE Virtual Reality 2003
Collision warning design to mitigate driver distraction
Proceedings of the SIGCHI Conference on Human Factors in Computing Systems
MacVisSTA: a system for multimodal analysis
Proceedings of the 6th international conference on Multimodal interfaces
Assembling the senses: towards the design of cooperative interfaces for visually impaired users
CSCW '04 Proceedings of the 2004 ACM conference on Computer supported cooperative work
GameFlow: a model for evaluating player enjoyment in games
Computers in Entertainment (CIE) - Theoretical and Practical Computer Applications in Entertainment
HAPTICS '06 Proceedings of the Symposium on Haptic Interfaces for Virtual Environment and Teleoperator Systems
Design and evaluation of a tactile memory game for visually impaired children
Interacting with Computers
Sensory substitution using tactile pin arrays: human factors, technology and applications
Signal Processing - Special section: Multimodal human-computer interfaces
Flow in games (and everything else)
Communications of the ACM
An initial investigation into non-visual computer supported collaboration
CHI '07 Extended Abstracts on Human Factors in Computing Systems
The catchment feature model: a device for multimodal fusion and a bridge between signal and sense
EURASIP Journal on Applied Signal Processing
The body surface as a communication system: The state of the art after 50 years
Presence: Teleoperators and Virtual Environments
Proceedings of the 1st international conference on PErvasive Technologies Related to Assistive Environments
Multimodal vision glove for touchscreens
Proceedings of the 10th international ACM SIGACCESS conference on Computers and accessibility
Fun to develop embodied skill: how games help the blind to understand pointing
Proceedings of the 3rd International Conference on PErvasive Technologies Related to Assistive Environments
MLMI'05 Proceedings of the Second international conference on Machine Learning for Multimodal Interaction
Semi automatic generator of tactile video games for visually impaired children
ICCHP'06 Proceedings of the 10th international conference on Computers Helping People with Special Needs
Navigation and control in haptic applications shared by blind and sighted users
HAID'06 Proceedings of the First international conference on Haptic and Audio Interaction Design
The Haptic Deictic System—HDS: Bringing Blind Students to Mainstream Classrooms
IEEE Transactions on Haptics
Audible rendering of text documents controlled by multi-touch interaction
Proceedings of the 14th ACM international conference on Multimodal interaction
| Hi-index | 0.00 |
Human discourse is an embodied activity emerging from the embodied imagery and construction of our talk. Gesture and speech are coexpressive, conveying this imagery and meaning simultaneously. Mathematics instruction and discourse typically involve two modes of communication: speech and graphical presentation. Our goal is to assist Individuals who are Blind or Severely Visually Impaired (IBSVI) to access such instruction/communication. We employ a haptic glove interface to furnish the IBSVI with awareness of the deictic gestures performed by the instructor over the graphic in conjunction with speech. We present a series of studies spanning two years where we show how our Haptic Deictic System (HDS) can support learning in inclusive classrooms where IBSVI receive instruction alongside sighted students. We discuss how the introduction of the HDS was advantageous to all parties: IBSVI, instructor, and sighted students. The HDS created more learning opportunities, increasing mutual understanding and promoting greater engagement.