NOOBIE: the animal design playstation
ACM SIGCHI Bulletin
When the interface is a talking dinosaur: learning across media with ActiMates Barney
Proceedings of the SIGCHI Conference on Human Factors in Computing Systems
The media equation: how people treat computers, television, and new media like real people and places
Sympathetic interfaces: using a plush toy to direct synthetic characters
Proceedings of the SIGCHI conference on Human Factors in Computing Systems
Shared reality: physical collaboration with a virtual peer
CHI '00 Extended Abstracts on Human Factors in Computing Systems
The familiar: a living diary and companion
CHI '01 Extended Abstracts on Human Factors in Computing Systems
RobotPHONE: RUI for interpersonal communication
CHI '01 Extended Abstracts on Human Factors in Computing Systems
Context-aware sensor-doll as a music expression device
CHI '01 Extended Abstracts on Human Factors in Computing Systems
Cross-modal coordination of expressive strength between voice and gesture for personified media
Proceedings of the 8th international conference on Multimodal interfaces
| Hi-index | 0.00 |
We propose an application that uses music as a multimodal expression to activate and support communication that runs parallel with traditional conversation. In this paper, we examine a personified doll-shaped interface designed for musical expression. To direct such gestures toward communication, we have adopted an augmented stuffed toy with tactile interaction as a musically expressive device. We constructed the doll with various sensors for user context recognition. This configuration enables translation of the interaction into melodic statements. We demonstrate the effect of the doll on face-to-face conversation by comparing the experimental results of different input interfaces and output sounds. Consequently, we have found that conversation with the doll was positively affected by the musical output, the doll interface, and their combination.