Passive and In-Situ assessment of mental and physical well-being using mobile sensors

Authors:
Mashfiqui Rabbi;Shahid Ali;Tanzeem Choudhury;Ethan Berke
Affiliations:
Cornell University, Ithaca, NY, USA;Dartmouth Medical School, Lebanon, NH, USA;Cornell University, Ithaca, NY, USA;Dartmouth Medical School, Lebanon, NH, USA
Venue:
Proceedings of the 13th international conference on Ubiquitous computing
Year:
2011

Citing 11
Cited 7

Robust Real-Time Face Detection

International Journal of Computer Vision
Sharing Visual Features for Multiclass and Multiview Object Detection

IEEE Transactions on Pattern Analysis and Machine Intelligence
Activity sensing in the wild: a field trial of ubifit garden

Proceedings of the SIGCHI Conference on Human Factors in Computing Systems
The Mobile Sensing Platform: An Embedded Activity Recognition System

IEEE Pervasive Computing
Towards the automated social analysis of situated speech data

UbiComp '08 Proceedings of the 10th international conference on Ubiquitous computing
Daily Routine Recognition through Activity Spotting

LoCA '09 Proceedings of the 4th International Symposium on Location and Context Awareness
A hybrid discriminative/generative approach for modeling human activities

IJCAI'05 Proceedings of the 19th international joint conference on Artificial intelligence
Sensible organizations: technology and methodology for automatically measuring organizational behavior

IEEE Transactions on Systems, Man, and Cybernetics, Part B: Cybernetics - Special issue on human computing
Social sensing for epidemiological behavior change

Proceedings of the 12th ACM international conference on Ubiquitous computing
Inferring colocation and conversation networks from privacy-sensitive audio with implications for computational social science

ACM Transactions on Intelligent Systems and Technology (TIST)
A practical approach to recognizing physical activities

PERVASIVE'06 Proceedings of the 4th international conference on Pervasive Computing

Activity recognition using a spectral entropy signature

Proceedings of the 2012 ACM Conference on Ubiquitous Computing
Lowering the barriers to large-scale mobile crowdsensing

Proceedings of the 14th Workshop on Mobile Computing Systems and Applications
Crowd++: unsupervised speaker count with smartphones

Proceedings of the 2013 ACM international joint conference on Pervasive and ubiquitous computing
CoenoFire: monitoring performance indicators of firefighters in real-world missions using smartphones

Proceedings of the 2013 ACM international joint conference on Pervasive and ubiquitous computing
The latency, accuracy, and battery (LAB) abstraction: programmer productivity and energy efficiency for continuous mobile context sensing

Proceedings of the 2013 ACM SIGPLAN international conference on Object oriented programming systems languages & applications
Towards in situ affect detection in mobile devices: a multimodal approach

Proceedings of the 2013 Research in Adaptive and Convergent Systems
In situ affect detection in mobile devices: a multimodal approach for advertisement using social network

ACM SIGAPP Applied Computing Review

Quantified Score

Hi-index	0.00

Visualization

Abstract

The idea of continuously monitoring well-being using mobile-sensing systems is gaining popularity. In-situ measurement of human behavior has the potential to overcome the short comings of gold-standard surveys that have been used for decades by the medical community. However, current sensing systems have mainly focused on tracking physical health; some have approximated aspects of mental health based on proximity measurements but have not been compared against medically accepted screening instruments. In this paper, we show the feasibility of a multi-modal mobile sensing system to simultaneously assess mental and physical health. By continuously capturing fine-grained motion and privacy-sensitive audio data, we are able to derive different metrics that reflect the results of commonly used surveys for assessing well-being by the medical community. In addition, we present a case study that highlights how errors in assessment due to the subjective nature of the responses could potentially be avoided by continuous mobile sensing.