Shake2Talk: multimodal messaging for interpersonal communication

Authors:
Lorna M. Brown;John Williamson
Affiliations:
Microsoft Research, Cambridge;Department of Computing Science, University of Glasgow
Venue:
HAID'07 Proceedings of the 2nd international conference on Haptic and audio interaction design
Year:
2007

Citing 12
Cited 13

Hubbub: a sound-enhanced mobile instant messenger that supports awareness and opportunistic interactions

Proceedings of the SIGCHI Conference on Human Factors in Computing Systems
Age-old practices in the 'new world': a study of gift-giving between teenage mobile phone users

Proceedings of the SIGCHI Conference on Human Factors in Computing Systems
Mobile culture of children and teenagers in Finland

Perpetual contact
ComTouch: design of a vibrotactile communication device

DIS '02 Proceedings of the 4th conference on Designing interactive systems: processes, practices, methods, and techniques
HIM: a framework for haptic instant messaging

CHI '04 Extended Abstracts on Human Factors in Computing Systems
A First Investigation into the Effectiveness of Tactons

WHC '05 Proceedings of the First Joint Eurohaptics Conference and Symposium on Haptic Interfaces for Virtual Environment and Teleoperator Systems
Learning and Identifying Haptic Icons under Workload

WHC '05 Proceedings of the First Joint Eurohaptics Conference and Symposium on Haptic Interfaces for Virtual Environment and Teleoperator Systems
I saw this and thought of you: some social uses of camera phones

CHI '05 Extended Abstracts on Human Factors in Computing Systems
Mediated social touch: a review of current research and future directions

Virtual Reality
Communicating emotion through a haptic link: Design space and methodology

International Journal of Human-Computer Studies
Sound support for collaboration

ECSCW'91 Proceedings of the second conference on European Conference on Computer-Supported Cooperative Work
The SonicFinder: an interface that uses auditory icons

Human-Computer Interaction

Vibrotactile feedback as an orientation aid for blind users of mobile guides

Proceedings of the 10th international conference on Human computer interaction with mobile devices and services
Exploring the potential of audio-tactile messaging for remote interpersonal communication

Proceedings of the SIGCHI Conference on Human Factors in Computing Systems
Enhancing personal communication with spatial haptics: Two scenario-based experiments on gestural interaction

Journal of Visual Languages and Computing
Expectations for user experience in haptic communication with mobile devices

Proceedings of the 11th International Conference on Human-Computer Interaction with Mobile Devices and Services
Gestures all around us: user differences in social acceptability perceptions of gesture based interfaces

Proceedings of the 11th International Conference on Human-Computer Interaction with Mobile Devices and Services
Usable gestures for mobile interfaces: evaluating social acceptability

Proceedings of the SIGCHI Conference on Human Factors in Computing Systems
Roly-poly: a haptic interface with a self-righting feature

EuroHaptics'10 Proceedings of the 2010 international conference on Haptics: generating and perceiving tangible sensations, Part I
Design and evaluation of a wearable remote social touch device

International Conference on Multimodal Interfaces and the Workshop on Machine Learning for Multimodal Interaction
Psychophysical model for vibrotactile rendering in mobile devices

Presence: Teleoperators and Virtual Environments
A haptic wristwatch for eyes-free interactions

Proceedings of the SIGCHI Conference on Human Factors in Computing Systems
Exploring the effects of cumulative contextual cues on interpreting vibrotactile messages

Proceedings of the 13th International Conference on Human Computer Interaction with Mobile Devices and Services
iFeeling: vibrotactile rendering of human emotions on mobile phones

Mobile Multimedia Processing
Haptically augmented remote speech communication: a study of user practices and experiences

Proceedings of the 7th Nordic Conference on Human-Computer Interaction: Making Sense Through Design

Quantified Score

Hi-index	0.00

Visualization

Abstract

This paper explores the possibilities of using audio and haptics for interpersonal communication via mobile devices. Drawing on the literature on current messaging practises, a new concept for multimodal messaging has been designed and developed. The Shake2Talk system allows users to construct audio-tactile messages through simple gesture interactions, and send these messages to other people. Such messages could be used to communicate a range of meanings, from the practical (e.g. "home safely", represented by the sound and sensation of a key turning in a lock) to the emotional (e.g. "thinking of you" represented by a heartbeat). This paper presents the background to this work, the system design and implementation and a plan for evaluation.