Jabberstamp: embedding sound and voice in traditional drawings

  • Authors:

  • Hayes Raffle;Cati Vaucelle;Ruibing Wang;Hiroshi Ishii

  • Affiliations:

  • MIT Media Lab, Cambridge, MA;MIT Media Lab, Cambridge, MA;Cornell University, Framingham, MA;MIT Media Lab, Cambridge, MA

  • Venue:
  • Proceedings of the 6th international conference on Interaction design and children
  • Year:
  • 2007

Quantified Score

Hi-index 0.00

Visualization

Abstract

We introduce Jabberstamp, the first tool that allows children to synthesize their drawings and voices. To use Jabberstamp, children create drawings, collages or paintings on normal paper. They press a special rubber stamp onto the page to record sounds into their drawings. When children touch the marks of the stamp with a small trumpet, they can hear the sounds playback, retelling the stories they created. We describe our design process and analyze the mechanism between the act of drawing and the one of telling, defining interdependencies between the two activities. In a series of studies, children ages 4--8 use Jabberstamp to convey meaning in their drawings. The system allows collaboration among peers at different developmental levels. Jabberstamp compositions reveal children's narrative styles and their planning strategies. In guided activities, children develop stories by situating sound recording in their drawing, which suggests future opportunities for hybrid voice-visual tools to support children's emergent literacy.