The active badge location system
ACM Transactions on Information Systems (TOIS)
Charting past, present, and future research in ubiquitous computing
ACM Transactions on Computer-Human Interaction (TOCHI) - Special issue on human-computer interaction in the new millennium, Part 1
An epidemic model for information diffusion in MANETs
MSWiM '02 Proceedings of the 5th ACM international workshop on Modeling analysis and simulation of wireless and mobile systems
MANET simulation studies: the incredibles
ACM SIGMOBILE Mobile Computing and Communications Review - Special Issue on Medium Access and Call Admission Control Algorithms for Next Generation Wireless Networks.: The Digital Library version of this issue has a corrected special issue title compared to the one in the print version of the issue.
Interweaving mobile games with everyday life
Proceedings of the SIGCHI Conference on Human Factors in Computing Systems
Supporting ethnographic studies of ubiquitous computing in the wild
DIS '06 Proceedings of the 6th conference on Designing Interactive systems
Why we tag: motivations for annotation in mobile and online media
Proceedings of the SIGCHI Conference on Human Factors in Computing Systems
The role of a cohort in the design and evaluation of pervasive systems
Proceedings of the 7th ACM conference on Designing interactive systems
Transforming the social networking experience with sensing presence from mobile phones
Proceedings of the 6th ACM conference on Embedded network sensor systems
A survey of platforms for mobile networks research
ACM SIGMOBILE Mobile Computing and Communications Review
Why it's worth the hassle: the value of in-situ studies when designing Ubicomp
UbiComp '07 Proceedings of the 9th international conference on Ubiquitous computing
AppAware: which mobile applications are hot?
Proceedings of the 12th international conference on Human computer interaction with mobile devices and services
Experiments in the wild: public evaluation of off-screen visualizations in the Android market
Proceedings of the 6th Nordic Conference on Human-Computer Interaction: Extending Boundaries
Ethics, logs and videotape: ethics in large scale user trials and user generated content
CHI '11 Extended Abstracts on Human Factors in Computing Systems
Further into the wild: running worldwide trials of mobile systems
Pervasive'10 Proceedings of the 8th international conference on Pervasive Computing
A Comparison of Distribution Channels for Large-Scale Deployments of iOS Applications
International Journal of Mobile Human Computer Interaction
International Journal of Mobile Human Computer Interaction
Categorised ethical guidelines for large scale mobile HCI
Proceedings of the SIGCHI Conference on Human Factors in Computing Systems
Informing future design via large-scale research methods and big data
Proceedings of the 15th international conference on Human-computer interaction with mobile devices and services
| Hi-index | 0.01 |
User trials of mobile applications have followed a steady march out of the lab, and progressively further ''into the wild', recently involving ''app store'-style releases of software to the general public. Yet from our experiences on these mass participation systems and a survey of the literature, we identify a number of reported difficulties. We propose a hybrid methodology that aims to address these, by combining a global software release with a concurrent local trial. A phone-based game, created to explore the uptake and use of ad hoc peer-to-peer networking, was evaluated using this new hybrid trial method, combining a small-scale local trial (11 users) with a ''mass participation' trial (over 10,000 users). Our hybrid method offers many benefits, allowing locally observed findings to be verified, patterns in globally collected data to be explained and addresses ethical issues raised by the mass participation approach. We note trends in the local trial that did not appear in the larger scale deployment, and which would therefore have led to misleading results were the application trialed using ''traditional' methods alone. Based on this study and previous experience, we provide a set of guidelines to researchers working in this area.