An introduction to computerized experience sampling in psychology
Social Science Computer Review
Usability Engineering
Voice-mail diary studies for naturalistic data capture under mobile conditions
CSCW '02 Proceedings of the 2002 ACM conference on Computer supported cooperative work
Proceedings of the third Nordic conference on Human-computer interaction
When participants do the capturing: the role of media in diary studies
Proceedings of the SIGCHI Conference on Human Factors in Computing Systems
ContextPhone: A Prototyping Platform for Context-Aware Mobile Applications
IEEE Pervasive Computing
Gather customer's real usage on mobile phones
Proceedings of the 7th international conference on Human computer interaction with mobile devices & services
Momento: support for situated ubicomp experimentation
Proceedings of the SIGCHI Conference on Human Factors in Computing Systems
MyExperience: a system for in situ tracing and capturing of user feedback on mobile phones
Proceedings of the 5th international conference on Mobile systems, applications and services
User segmentation & UI optimization through mobile phone log analysis
Proceedings of the 10th international conference on Human computer interaction with mobile devices and services
Proceedings of the SIGCHI Conference on Human Factors in Computing Systems
Ubiquitous Computing Fundamentals
Ubiquitous Computing Fundamentals
Ubiquitous Computing Fundamentals
Ubiquitous Computing Fundamentals
Proceedings of the 8th international conference on Mobile systems, applications, and services
Research Methods in Human-Computer Interaction
Research Methods in Human-Computer Interaction
Empowerment through seamfulness: smart phones in everyday life
Personal and Ubiquitous Computing
Proceedings of the 13th International Conference on Human Computer Interaction with Mobile Devices and Services
A practical approach to recognizing physical activities
PERVASIVE'06 Proceedings of the 4th international conference on Pervasive Computing
Proceedings of the SIGCHI Conference on Human Factors in Computing Systems
| Hi-index | 0.01 |
Self-reporting techniques, such as data logging or a diary, are frequently used in long-term studies, but prone to subjects' forgetfulness and other sources of inaccuracy. We conducted a six-week self-reporting study on smartphone usage in order to investigate the accuracy of self-reported information, and used logged data as ground truth to compare the subjects' reports against. Subjects never recorded more than 70% and, depending on the requested reporting interval, down to less than 40% of actual app usages. They significantly overestimated how long they used apps. While subjects forgot self-reports when no automatic reminders were sent, a high reporting frequency was perceived as uncomfortable and burdensome. Most significantly, self-reporting even changed the actual app usage of users and hence can lead to deceptive measures if a study relies on no other data sources. With this contribution, we provide empirical quantitative long-term data on the reliability of self-reported data collected with mobile devices. We aim to make researchers aware of the caveats of self-reporting and give recommendations for maximizing the reliability of results when conducting large-scale, long-term app usage studies.