Michał Kąkol
ABSTRACT
In this paper we describe the initial outcomes of the Reconcile1 study concerning Web content credibility evaluations. The study was run with a balanced sample of 1503 respondents who independently evaluated 154 web pages from several thematic categories. Users taking part in the study not only evaluated credibility, but also filled a questionnaire covering additional respondents' traits. Using the gathered information about socio-economic status and psychological features of the users, we studied the influence of subjectivity and bias in the credibility ratings. Subjectivity and bias, in fact, represent a key design issue for Web Credibility systems, to the extent that they could jeopardize the system performance if not taken into account.
We found out that evaluations of Web content credibility are slightly subjective. On the other hand, the evaluations exhibit a strong acquiescence bias.
- Castillo, C., Mendoza, M., and Poblete, B., 2011. Information credibility on twitter. In Proc. of WWW. Google Scholar
Digital Library
- Cavarlee, J. and Liu, L., 2007. Countering Web spam with credibility-based link analysis. PODC 2007, 157--166. Google ScholarDigital Library
- Hsu, C., Khabiri, E., and Caverlee, J., 2009. Ranking Comments on the Social Web. In Proc. of CSE, Volume 04, pages 90--97. Google ScholarDigital Library
- Diaz, J. A., Griffith, R. A., Ng, J. J., Reinert, S. E., Friedmann, P. D. and Moulton, A. W., 2002. Patients' Use of the Internet for Medical Information. Journal of General Internal Medicine, volume 17: pages 180--185.Google ScholarCross Ref
- Fogg, B. J., 2003. Prominence-interpretation theory: explaining how people assess credibility online. In Proc. of CHI. Google ScholarDigital Library
- Fogg, B. J., Soohoo, C., Danielson, D. R., Marable, L., Stanford, J., and Tauber, E. R., 2003. How do users evaluate the credibility of web sites?: a study with over 2,500 participants. In Proc. of DUX. Google ScholarDigital Library
- Gyöngyi, Z., Garcia-Molina, H, Pedersen, J., 2004. Combating web spam with trustrank. In Proc. of VLDB. Google ScholarDigital Library
- Hargittai, E., and Hsieh, Y. P., 2011. Succinct Survey Measures of Web-Use Skills, Social Science Computer Review, February 2012 30: 95--107, first published on February 28. Google ScholarDigital Library
- Landis, J. R., Koch, G. G., 1977. The measurement of observer agreement for categorical data. Biometrics 33:159--174.Google ScholarCross Ref
- Schwarz, J., and Morris, M., 2011. Augmenting web pages and search results to support credibility assessment. In Proc. of CHI. Google ScholarDigital Library
- Parikshit Sondhi, V. G. Vinod Vydiswaran, and ChengXiang Zhai, 2012. Reliability prediction of webpages in the medical domain. In Proc. of ECIR. Google ScholarDigital Library
- Surowiecki, J., The Wisdom of Crowds, Anchor, 2005. Google ScholarDigital Library
- Wagner, C., and Vinaimont, T., 2010. Evaluating the wisdom of crowds. In Proceedings of Issues in Information Systems, volume XI, no. 1, pages.724--732.Google Scholar
- Yamamoto, Y., and Tanaka, K., 2011. Enhancing credibility judgment of web search results. In Proc. ofGoogle Scholar
Index Terms
- On the subjectivity and bias of web content credibility evaluations
Recommendations
What makes Web sites credible?: a report on a large quantitative study
CHI '01: Proceedings of the SIGCHI Conference on Human Factors in Computing SystemsThe credibility of web sites is becoming an increasingly important area to understand. To expand knowledge in this domain, we conducted an online study that investigated how different elements of Web sites affect people's perception of credibility. Over ...
Factors and effects of information credibility
ICEC '07: Proceedings of the ninth international conference on Electronic commerceWebsite success hinges on how credible the consumers consider the information on the website. Unless consumers believe the website's information is credible, they are not likely to be willing to act on the advice and will not develop loyalty to the ...
Elements that affect web credibility: early results from a self-report study
CHI EA '00: CHI '00 Extended Abstracts on Human Factors in Computing SystemsWe conducted an online survey about Web credibility, which included over 1400 participants. People reported that Web site credibility increases when the site conveys a real-world presence, is easy to use, and is updated often. People reported that a Web ...
Comments