The visual analysis of human movement: a survey
Computer Vision and Image Understanding
IEEE Concurrency
Sensing and Modeling Human Networks using the Sociometer
ISWC '03 Proceedings of the 7th IEEE International Symposium on Wearable Computers
Real-time Localization in Outdoor Environments using Stereo Vision and Inexpensive GPS
ICPR '06 Proceedings of the 18th International Conference on Pattern Recognition - Volume 03
Multi-source localization in reverberant environments by ROOT-MUSIC and clustering
ICASSP '00 Proceedings of the Acoustics, Speech, and Signal Processing, 2000. on IEEE International Conference - Volume 02
Social Mirrors as Social Signals: Transforming Audio into Graphics
IEEE Computer Graphics and Applications
Discovering semantically meaningful places from pervasive RF-beacons
Proceedings of the 11th international conference on Ubiquitous computing
Autonomous construction of a WiFi access point map using multidimensional scaling
Pervasive'11 Proceedings of the 9th international conference on Pervasive computing
Audio location: accurate low-cost location sensing
PERVASIVE'05 Proceedings of the Third international conference on Pervasive Computing
Using sound source localization in a home environment
PERVASIVE'05 Proceedings of the Third international conference on Pervasive Computing
EELC'06 Proceedings of the Third international conference on Emergence and Evolution of Linguistic Communication: symbol Grounding and Beyond
| Hi-index | 0.00 |
Understanding and facilitating real-life social interaction is a high-impact goal for Ubicomp research. Microphone arrays offer the unique capability to provide continuous, calm capture of verbal interaction in large physical spaces, such as homes and (especially open-plan) offices. Most microphone array work has focused on arrays of custom sensors in small spaces, and a few recent works have tested small arrays of commodity sensors in single rooms. This paper describes the first working scalable and cost-effective array that offers high-precision localization of conversational speech, and hence enables ongoing studies of verbal interactions in large semi-structured spaces. This work represents significant improvements over prior work in three dimensions -- cost, scale and accuracy. It also achieves high throughput for real-time updates of tens of active sources using off-the-shelf components. We describe the system design, key localization algorithms, and a systematic performance evaluation. We then show how source location data can be usefully aggregated to reveal interesting patterns in group conversations, such as dominance and engagement.