On the subjectivity and bias of web content credibility evaluations

Authors:
Michał Kąkol;Michał Jankowski-Lorek;Katarzyna Abramczuk;Adam Wierzbicki;Michele Catasta
Affiliations:
Polish-Japanese Institute of Information Technology, Warsaw, Poland;Polish-Japanese Institute of Information Technology, Warsaw, Poland;Institute of Political Studies, Polish Academy of Sciences, Warsaw, Poland;Polish-Japanese Institute of Information Technology, Warsaw, Poland;Ecole Polytechnique Fédérale de Lausanne, Lausanne, Switzerland
Venue:
Proceedings of the 22nd international conference on World Wide Web companion
Year:
2013

Citing 10
Cited 0

Prominence-interpretation theory: explaining how people assess credibility online

CHI '03 Extended Abstracts on Human Factors in Computing Systems
How do users evaluate the credibility of Web sites?: a study with over 2,500 participants

Proceedings of the 2003 conference on Designing for user experiences
The Wisdom of Crowds

The Wisdom of Crowds
Countering web spam with credibility-based link analysis

Proceedings of the twenty-sixth annual ACM symposium on Principles of distributed computing
Combating web spam with trustrank

VLDB '04 Proceedings of the Thirtieth international conference on Very large data bases - Volume 30
Ranking Comments on the Social Web

CSE '09 Proceedings of the 2009 International Conference on Computational Science and Engineering - Volume 04
Information credibility on twitter

Proceedings of the 20th international conference on World wide web
Augmenting web pages and search results to support credibility assessment

Proceedings of the SIGCHI Conference on Human Factors in Computing Systems
Succinct Survey Measures of Web-Use Skills

Social Science Computer Review
Reliability prediction of webpages in the medical domain

ECIR'12 Proceedings of the 34th European conference on Advances in Information Retrieval

Quantified Score

Hi-index	0.00

Visualization

Abstract

In this paper we describe the initial outcomes of the Reconcile1 study concerning Web content credibility evaluations. The study was run with a balanced sample of 1503 respondents who independently evaluated 154 web pages from several thematic categories. Users taking part in the study not only evaluated credibility, but also filled a questionnaire covering additional respondents' traits. Using the gathered information about socio-economic status and psychological features of the users, we studied the influence of subjectivity and bias in the credibility ratings. Subjectivity and bias, in fact, represent a key design issue for Web Credibility systems, to the extent that they could jeopardize the system performance if not taken into account. We found out that evaluations of Web content credibility are slightly subjective. On the other hand, the evaluations exhibit a strong acquiescence bias.