Experience sharing by retrieving captured conversations using non-verbal features

Authors:
Christof E. Müller;Yasuyuki Sumi;Kenji Mase;Megumu Tsuchikawa
Affiliations:
ATR Media Information Science Laboratories, Kyoto, Japan;Kyoto University, Kyoto, Japan;Nagoya University, Nagoya City, Japan;ATR Media Information Science Laboratories, Kyoto, Japan
Venue:
Proceedings of the the 1st ACM workshop on Continuous archival and retrieval of personal experiences
Year:
2004

Citing 6
Cited 1

Designing audio aura

Proceedings of the SIGCHI Conference on Human Factors in Computing Systems
HIPS: Hyper-Interaction within Physical Space

ICMCS '99 Proceedings of the IEEE International Conference on Multimedia Computing and Systems - Volume 2
The Locust Swarm: An Environmentally-Powered, Networkless Location and Messaging System

ISWC '97 Proceedings of the 1st IEEE International Symposium on Wearable Computers
The wearable remembrance agent: a system for augmented memory

ISWC '97 Proceedings of the 1st IEEE International Symposium on Wearable Computers
Augment-able Reality: Situated Communication through Physical and Digital Spaces

ISWC '98 Proceedings of the 2nd IEEE International Symposium on Wearable Computers
Collage of video and sound for raising the awareness of situated conversations

IMTCI'04 Proceedings of the Second international conference on Intelligent Media Technology for Communicative Intelligence

Collage of video and sound for raising the awareness of situated conversations

IMTCI'04 Proceedings of the Second international conference on Intelligent Media Technology for Communicative Intelligence

Quantified Score

Hi-index	0.00

Visualization

Abstract

We present a system that retrieves the voice part of human communications captured by our collaborative experience capturing system. For segmenting, interpreting, and retrieving past conversation scenes from a huge amount of captured data the system focusses on the non-verbal aspects, i.e. the contextual information captured by ubiquitous sensors, rather than the verbal (semantic) aspects of the data. The retrieved communications are presented to other persons being in similar situations as the communicators. This experience sharing enables people to gain more information about their situation or surroundings. The system's current domain is a poster exhibition at an academic conference where the system provides a visitor with additional information about the exhibited posters or can be used to re-experience the event after the exhibition is finished.