Sensing and Modeling Human Networks using the Sociometer
ISWC '03 Proceedings of the 7th IEEE International Symposium on Wearable Computers
Introduction to Machine Learning (Adaptive Computation and Machine Learning)
Introduction to Machine Learning (Adaptive Computation and Machine Learning)
Automatic detection of interaction groups
ICMI '05 Proceedings of the 7th international conference on Multimodal interfaces
Persistent personal names for globally connected mobile devices
OSDI '06 Proceedings of the 7th USENIX Symposium on Operating Systems Design and Implementation - Volume 7
Meeting mediator: enhancing group collaborationusing sociometric feedback
Proceedings of the 2008 ACM conference on Computer supported cooperative work
SoundSense: scalable sound sensing for people-centric applications on mobile phones
Proceedings of the 7th international conference on Mobile systems, applications, and services
Exploring Privacy Concerns about Personal Sensing
Pervasive '09 Proceedings of the 7th International Conference on Pervasive Computing
IEEE Transactions on Systems, Man, and Cybernetics, Part B: Cybernetics - Special issue on human computing
Beyond total capture: a constructive critique of lifelogging
Communications of the ACM
Darwin phones: the evolution of sensing and inference on mobile phones
Proceedings of the 8th international conference on Mobile systems, applications, and services
Proceedings of the 12th ACM international conference on Ubiquitous computing
The Jigsaw continuous sensing engine for mobile phone applications
Proceedings of the 8th ACM Conference on Embedded Networked Sensor Systems
ACM Transactions on Intelligent Systems and Technology (TIST)
Identifying emergent leadership in small groups using nonverbal communicative cues
International Conference on Multimodal Interfaces and the Workshop on Machine Learning for Multimodal Interaction
TaintDroid: an information-flow tracking system for realtime privacy monitoring on smartphones
OSDI'10 Proceedings of the 9th USENIX conference on Operating systems design and implementation
SpeakerSense: energy efficient unobtrusive speaker identification on mobile phones
Pervasive'11 Proceedings of the 9th international conference on Pervasive computing
Proceedings of the 9th ACM Conference on Embedded Networked Sensor Systems
MobiCon: a mobile context-monitoring platform
Communications of the ACM
Estimating Dominance in Multi-Party Meetings Using Speaker Diarization
IEEE Transactions on Audio, Speech, and Language Processing
New insights into the noise reduction Wiener filter
IEEE Transactions on Audio, Speech, and Language Processing
Multistage speaker diarization of broadcast news
IEEE Transactions on Audio, Speech, and Language Processing
Robust Speech Rate Estimation for Spontaneous Speech
IEEE Transactions on Audio, Speech, and Language Processing
CoMon: cooperative ambience monitoring platform with continuity and benefit awareness
Proceedings of the 10th international conference on Mobile systems, applications, and services
Speaker Diarization: A Review of Recent Research
IEEE Transactions on Audio, Speech, and Language Processing
Sense and sensibility in a pervasive world
Pervasive'12 Proceedings of the 10th international conference on Pervasive Computing
SymPhoney: a coordinated sensing flow execution engine for concurrent mobile sensing applications
Proceedings of the 10th ACM Conference on Embedded Network Sensor Systems
FaceLog: capturing user's everyday face using mobile devices
Proceedings of the 2013 ACM conference on Pervasive and ubiquitous computing adjunct publication
SocialWeaver: collaborative inference of human conversation networks using smartphones
Proceedings of the 11th ACM Conference on Embedded Networked Sensor Systems
TalkBetter: family-driven mobile intervention care for children with language delay
Proceedings of the 17th ACM conference on Computer supported cooperative work & social computing
| Hi-index | 0.00 |
In this paper, we propose SocioPhone, a novel initiative to build a mobile platform for face-to-face interaction monitoring. Face-to-face interaction, especially conversation, is a fundamental part of everyday life. Interaction-aware applications aimed at facilitating group conversations have been proposed, but have not proliferated yet. Useful contexts to capture and support face-to-face interactions need to be explored more deeply. More important, recognizing delicate conversational contexts with commodity mobile devices requires solving a number of technical challenges. As a first step to address such challenges, we identify useful meta-linguistic contexts of conversation, such as turn-takings, prosodic features, a dominant participant, and pace. These serve as cornerstones for building a variety of interaction-aware applications. SocioPhone abstracts such useful meta-linguistic contexts as a set of intuitive APIs. Its runtime efficiently monitors registered contexts during in-progress conversations and notifies applications on-the-fly. Importantly, we have noticed that online turn monitoring is the basic building block for extracting diverse meta-linguistic contexts, and have devised a novel volume-topography-based method. We show the usefulness of SocioPhone with several interesting applications: SocioTherapist, SocioDigest, and Tug-of-War. Also, we show that our turn-monitoring technique is highly accurate and energy-efficient under diverse real-life situations.