The state of the art in automating usability evaluation of user interfaces
ACM Computing Surveys (CSUR)
MyExperience: a system for in situ tracing and capturing of user feedback on mobile phones
Proceedings of the 5th international conference on Mobile systems, applications and services
Automated usability testing framework
AUIC '08 Proceedings of the ninth conference on Australasian user interface - Volume 76
Interactive usability instrumentation
Proceedings of the 1st ACM SIGCHI symposium on Engineering interactive computing systems
A Multidimensional Approach for the Evaluation of Mobile Application User Interfaces
Proceedings of the 13th International Conference on Human-Computer Interaction. Part I: New Trends
A Methodology and Framework to Simplify Usability Analysis of Mobile Applications
ASE '09 Proceedings of the 2009 IEEE/ACM International Conference on Automated Software Engineering
Remote evaluation of mobile applications
TAMODIA'07 Proceedings of the 6th international conference on Task models and diagrams for user interface design
LiveLab: measuring wireless networks and smartphone users in the field
ACM SIGMETRICS Performance Evaluation Review
AnonySense: A system for anonymous opportunistic sensing
Pervasive and Mobile Computing
SystemSens: a tool for monitoring usage in smartphone research deployments
MobiArch '11 Proceedings of the sixth international workshop on MobiArch
Proceedings of the 11th Brazilian Symposium on Human Factors in Computing Systems
Proceedings of the 19th Brazilian symposium on Multimedia and the web
Hi-index | 0.00 |
Evaluating the usability of smartphone applications is crucial for their success, so developers can learn how to adapt them considering the dynamicity of mobile scenarios. The HCI community recommends considering different requirements when evaluating those applications, such as quantitative data (metrics), subjective evaluation (users' impressions) and context data (e.g. environment and devices conditions). We observed a lack in the literature of approaches that support those three requirements combined into a single experiment; generally one or a pair of them is used. Besides, performing usability evaluation on real mobile scenarios is hard to achieve and most proposals are based on laboratory-controlled experiments. In this paper, we present our proposal for a hybrid usability evaluation of smartphone applications, which is composed by a model and an infrastructure that implements it. The model describes how to automatically monitor and collect context data and usability metrics, how those data can be processed for analysis support and how users' impressions can be collected. An infrastructure is provided to implement the model allowing it to be plugged into any smartphone Android-based application. To evaluate our proposal, we performed a field experiment, with 21 users using three mobile applications during a 6-month period, in their day-to-day scenarios.