Quadrant of euphoria: a crowdsourcing platform for QoE assessment

Authors:
Kuan-Ta Chen;Chi-Jui Chang;Chen-Chi Wu;Yu-Chun Chang;Chin-Laung Lei
Affiliations:
Academia Sinica;Academia Sinica;National Taiwan University;National Taiwan University;National Taiwan University
Venue:
IEEE Network: The Magazine of Global Internetworking - Special issue on improving quality of experience for network services
Year:
2010

Citing 2
Cited 7

Measuring perceived quality of speech and video in multimedia conferencing applications

MULTIMEDIA '98 Proceedings of the sixth ACM international conference on Multimedia
A crowdsourceable QoE evaluation framework for multimedia content

MM '09 Proceedings of the 17th ACM international conference on Multimedia

Towards a research agenda for enterprise crowdsourcing

ISoLA'10 Proceedings of the 4th international conference on Leveraging applications of formal methods, verification, and validation - Volume Part I
Quantifying QoS requirements of network services: a cheat-proof framework

MMSys '11 Proceedings of the second annual ACM conference on Multimedia systems
Temporal quality assessment for mobile videos

Proceedings of the 18th annual international conference on Mobile computing and networking
Assessing internet video quality using crowdsourcing

Proceedings of the 2nd ACM international workshop on Crowdsourcing for multimedia
Crowdsourcing-based multimedia subjective evaluations: a case study on image recognizability and aesthetic appeal

Proceedings of the 2nd ACM international workshop on Crowdsourcing for multimedia
From packets to people: quality of experience as a new measurement challenge

DataTraffic Monitoring and Analysis
Approaches for utility-based qoe-driven optimization of network resource allocation for multimedia services

DataTraffic Monitoring and Analysis

Quantified Score

Hi-index	0.00

Visualization

Abstract

Existing quality of experience assessment methods, subjective or objective, suffer from either or both problems of inaccurate experiment tools and expensive personnel cost. The panacea for them, as we have come to realize, lies in the joint application of paired comparison and crowdsourcing, the latter being a Web 2.0 practice of organizations asking ordinary unspecific Internet users to carry out internal tasks. We present in this article Quadrant of Euphoria, a user-friendly web-based platform facilitating QoE assessments in network and multimedia studies, which features low cost, participant diversity, meaningful and interpretable QoE scores, subject consistency assurance, and a burdenless experiment process.