Controlled experiments on the web: survey and practical guide
Data Mining and Knowledge Discovery
Tribler: P2P media search and sharing
MM '11 Proceedings of the 19th ACM international conference on Multimedia
| Hi-index | 0.00 |
Conducting a conventional experiment to test an application's user interface in a lab environment is a costly and time-consuming process. In this paper, we show that it is feasible to carry out A/B tests for a multimedia application through Amazon's crowdsourcing platform Mechanical Turk involving hundreds of workers at low costs. We let workers test user interfaces within a remote virtual machine that is embedded within the HIT and we show that technical issues that arise in this approach can be overcome.