skip to main content
10.1145/1978942.1979126acmconferencesArticle/Chapter ViewAbstractPublication PageschiConference Proceedingsconference-collections
research-article

Enhancing credibility judgment of web search results

Published:07 May 2011Publication History

ABSTRACT

In this paper, we propose a system for helping users to judge the credibility of Web search results and to search for credible Web pages. Conventional Web search engines present only titles, snippets, and URLs for users, which give few clues to judge the credibility of Web search results. Moreover, ranking algorithms of the conventional Web search engines are often based on relevance and popularity of Web pages. Towards credibility-oriented Web search, our proposed system provides users with the following three functions: (1) calculation and visualization of several scores of Web search results on the main credibility aspects, (2) prediction of user's credibility judgment model through user's credibility feedback for Web search results, and (3) re-ranking of Web search results based on user's predicted credibility model. Experimental results suggest that our system enables users - in particular, users with knowledge about search topics - to find credible Web pages from a list of Web search results more efficiently than conventional Web search interfaces.

Skip Supplemental Material Section

Supplemental Material

1979126.mp4

mp4

113.1 MB

References

  1. B. T. Adler and L. de Alfaro. A Content-Driven Reputation System for the Wikipedia. In Proceedings of the 16th international conference on World Wide Web (WWW 2007), pages 261--270, 2007. Google ScholarGoogle ScholarDigital LibraryDigital Library
  2. E. Agichtein, C. Castillo, D. Donato, A. Gionis, and G. Mishne. Finding High-Quality Content in Social Media. In Proceedings of the international conference on Web search and web data mining (WSDM 2008), pages 183--194, 2008. Google ScholarGoogle ScholarDigital LibraryDigital Library
  3. J. Cho, S. Roy, and R. E. Adams. Page Quality: in Search of an Unbiased Web Ranking. In Proceedings of the 2005 ACM SIGMOD international conference on Management of data (SIGMOD 2005), pages 551--562, 2005. Google ScholarGoogle ScholarDigital LibraryDigital Library
  4. P. Denning, J. Horning, D. Parnas, and L. Weinstein. Wikipedia Risks. Communication of ACM, 48(12):152--152, 2005. Google ScholarGoogle ScholarDigital LibraryDigital Library
  5. M. Eisend. Source Credibility Dimensions in Marketing Communication - A Generalized Solution. Journal of Empirical Generalisations in Marketing Science, 10(2):1--33, 2006.Google ScholarGoogle Scholar
  6. R. Ennals, B. Trushkowsky, and J. M. Agosta. Highlighting Disputed Claims on the Web. In Proceedings of the 19th international conference on World wide web (WWW 2010), pages 341--350, 2010. Google ScholarGoogle ScholarDigital LibraryDigital Library
  7. G. Erkan and D. Radev. LexRank: Graph-based lexical centrality as salience in text summarization. Journal of Artificial Intelligence Research, 22(2004):457--479, 2004. Google ScholarGoogle ScholarDigital LibraryDigital Library
  8. B. J. Fogg, J. Marshall, O. Laraki, A. Osipovich, C. Varma, N. Fang, J. Paul, A. Rangnekar, J. Shon, P. Swani, and M. Treinen. What Makes Web Sites Credible? A Report on a Large Quantitative Study. In Proceedings of the SIGCHI conference on Human factors in computing systems (CHI 2001), pages 61--68, 2001. Google ScholarGoogle ScholarDigital LibraryDigital Library
  9. B. J. Fogg and H. Tseng. The Elements of Computer Credibility. In Proceedings of the SIGCHI conference on Human factors in computing systems (CHI 1999), pages 80--87, 1999. Google ScholarGoogle ScholarDigital LibraryDigital Library
  10. R. Guha, R. Kumar, P. Raghavan, and A. Tomkins. Propagation of Trust and Distrust. In Proceedings of the 13th international conference on World Wide Web (WWW 2004), pages 403--412, 2004. Google ScholarGoogle ScholarDigital LibraryDigital Library
  11. C. Hovland and W. Weiss. The Influence of Source Credibility on Communication Effectiveness. Public Opinion Quarterly, 15(4):635--650, 1951.Google ScholarGoogle ScholarCross RefCross Ref
  12. Y. Liu, B. Gao, T.-Y. Liu, Y. Zhang, Z. Ma, S. He, and H. Li. BrowseRank: Letting Web Users Vote for Page Importance. In Proceedings of the 31st annual international ACM SIGIR conference on Research and development in information retrieval (SIGIR 2008), pages 451--458, 2008. Google ScholarGoogle ScholarDigital LibraryDigital Library
  13. M. Meola. Chucking the Checklist: A Contextual Approach to Teaching Undergraduates Web-Site Evaluation. portal: Libraries and the Academy, 4(3):331--344, 2004.Google ScholarGoogle ScholarCross RefCross Ref
  14. M. Metzger, A. Flanagin, K. Eyal, D. Lemus, and R. McCann. Credibility for the 21st century: Integrating perspectives on source, message, and media credibility in the contemporary media environment. Communication yearbook, 27:293--336, 2003.Google ScholarGoogle ScholarCross RefCross Ref
  15. M. J. Metzger, A. J. Flanagin, and L. Zwarun. College student Web use, perceptions of information credibility, and verification behavior. Computer & Education, 41(3):271--290, 2003. Google ScholarGoogle ScholarDigital LibraryDigital Library
  16. S. Nakamura, S. Konishi, A. Jatowt, H. Ohshima, H. Kondo, T. Tezuka, S. Oyama, and K. Tanaka. Trustworthiness Analysis of Web Search Results. In Proceedings of the 11th European Conference on Research and Advanced Technology for Digital Libraries (ECDL 2007), pages 38--49, 2007. Google ScholarGoogle ScholarDigital LibraryDigital Library
  17. M. Nakatani, A. Jatowt, H. Ohshima, and K. Tanaka. Quality Evaluation of Search Results by Typicality and Speciality of Terms Extracted from Wikipedia. In Proceedings of the 14th International Conference on Database Systems for Advanced Applications (DASFAA 2009), pages 570--584, 2009. Google ScholarGoogle ScholarDigital LibraryDigital Library
  18. R. Petty and J. Cacioppo. The elaboration likelihood model of persuasion. Advances in experimental social psychology, 19(1):123--205, 1986.Google ScholarGoogle Scholar
  19. P. Pirolli, E. Wollny, and B. Suh. So You Know You"re Getting the Best Possible Information: A Tool that Increases Wikipedia Credibility. In Proceedings of the 27th international conference on Human factors in computing systems (CHI 2009), pages 1505--1508, 2009. Google ScholarGoogle ScholarDigital LibraryDigital Library
  20. S. Rieh and D. Danielson. Credibility: A Multidisciplinary Framework. Annual Review of Information Science and Technology, 41(1):307--364, 2007. Google ScholarGoogle ScholarDigital LibraryDigital Library
  21. S. Y. Rieh. Judgement of Information Quality and Cognitive Authority in the Web. Journal of the American Society for Information Science and Technology, 53(2):145--161, 2002. Google ScholarGoogle ScholarDigital LibraryDigital Library
  22. G. Salton and C. Buckley. Improving Retrieval Performance by Relevance Feedback. Journal of the American society for information science, 41(4):288--297, 1990.Google ScholarGoogle Scholar
  23. E. Sillence, P. Briggs, L. Fishwick, and P. Harris. Trust and Mistrust of Online Health Sites. In Proceedings of the SIGCHI conference on Human factors in computing systems (CHI 2004), pages 663--670, 2004. Google ScholarGoogle ScholarDigital LibraryDigital Library
  24. J. Stiff and P. Mongeau. Persuasive communication. Guilford Publications, 2002.Google ScholarGoogle Scholar
  25. B. Suh, E. H. Chi, A. Kittur, and B. A. Pendleton. Lifting the Veil: Improving Accountability and Social Transparency in Wikipedia with WikiDashBoard. In Proceeding of the twenty-sixth annual SIGCHI conference on Human factors in computing systems (CHI 2008), pages 1037--1040, 2008. Google ScholarGoogle ScholarDigital LibraryDigital Library
  26. M. A. Suryanto, E. P. Lim, A. Sun, and R. H. L. Chiang. Quality-Aware Collaborative Question Answering: Methods and Evaluation. In Proceedings of the Second ACM International Conference on Web Search and Data Mining (WSDM 2009), pages 142--151, 2009. Google ScholarGoogle ScholarDigital LibraryDigital Library
  27. J. Teevan, S. T. Dumais, and E. Horvitz. Personalizing Search via Automated Analysis of Interests and Activities. In Proceedings of the 28th annual international ACM SIGIR conference on Research and development in information retrieval (SIGIR 2005), 2005. Google ScholarGoogle ScholarDigital LibraryDigital Library
  28. B.-Q. Vuong, E.-P. Lim, A. Sun, M.-T. Le, and H. W. Lauw. On Ranking Controversies in Wikipedia: Models and Evaluation. In Proceedings of the international conference on Web search and web data mining (WSDM 2008), pages 171--182, 2008. Google ScholarGoogle ScholarDigital LibraryDigital Library
  29. X. S. Zheng, I. Chakraborty, J. J.-W. Lin, and R. Rauschenberger. Correlating Low-Level Image Statistics with Users' Rapid Aesthetic and Affective Judgments of Web Pages. In Proceedings of the 27th international conference on Human factors in computing systems (CHI 2009), pages 1--10, 2009. Google ScholarGoogle ScholarDigital LibraryDigital Library

Index Terms

  1. Enhancing credibility judgment of web search results
            Index terms have been assigned to the content through auto-classification.

            Recommendations

            Comments

            Login options

            Check if you have access through your login credentials or your institution to get full access on this article.

            Sign in
            • Published in

              cover image ACM Conferences
              CHI '11: Proceedings of the SIGCHI Conference on Human Factors in Computing Systems
              May 2011
              3530 pages
              ISBN:9781450302289
              DOI:10.1145/1978942

              Copyright © 2011 ACM

              Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

              Publisher

              Association for Computing Machinery

              New York, NY, United States

              Publication History

              • Published: 7 May 2011

              Permissions

              Request permissions about this article.

              Request Permissions

              Check for updates

              Qualifiers

              • research-article

              Acceptance Rates

              CHI '11 Paper Acceptance Rate410of1,532submissions,27%Overall Acceptance Rate6,199of26,314submissions,24%

              Upcoming Conference

              CHI '24
              CHI Conference on Human Factors in Computing Systems
              May 11 - 16, 2024
              Honolulu , HI , USA

            PDF Format

            View or Download as a PDF file.

            PDF

            eReader

            View online with eReader.

            eReader