Hendrik Heuer
Elena Leah Glassman
ABSTRACT
During the COVID-19 pandemic, the World Health Organization provided a checklist to help people distinguish between accurate and misinformation. In controlled experiments in the United States and Germany, we investigated the utility of this ordered checklist and designed an interactive version to lower the cost of acting on checklist items. Across interventions, we observe non-trivial differences in participants’ performance in distinguishing accurate and misinformation between the two countries and discuss some possible reasons that may predict the future helpfulness of the checklist in different environments. The checklist item that provides source labels was most frequently followed and was considered most helpful. Based on our empirical findings, we recommend practitioners focus on providing source labels rather than interventions that support readers performing their own fact-checks, even though this recommendation may be influenced by the WHO’s chosen order. We discuss the complexity of providing such source labels and provide design recommendations.
Supplemental Material
- John H Aldrich, John L Sullivan, and Eugene Borgida. 1989. Foreign affairs and issue voting: Do presidential candidates “waltz before a blind audience?”. American Political Science Review 83, 1 (1989), 123–141.Google Scholar
Cross Ref
- Sacha Altay, Emma de Araujo, and Hugo Mercier. 2021. “If This account is True, It is Most Enormously Wonderful”: Interestingness-If-True and the Sharing of True and False News. Digital Journalism 0, 0 (2021), 1–22. https://doi.org/10.1080/21670811.2021.1941163 arXiv:https://doi.org/10.1080/21670811.2021.1941163Google ScholarCross Ref
- Oscar Alvarado, Hendrik Heuer, Vero Vanden Abeele, Andreas Breiter, and Katrien Verbert. 2020. Middle-Aged Video Consumers’ Beliefs About Algorithmic Recommendations on YouTube. Proc. ACM Hum.-Comput. Interact. 4, CSCW2, Article 121 (Oct. 2020), 24 pages. https://doi.org/10.1145/3415192Google ScholarDigital Library
- Jason Ross Arnold, Alexandra Reckendorf, and Amanda L Wintersieck. 2021. Source alerts can reduce the harms of foreign disinformation. Harvard Kennedy School Misinformation Review (2021).Google Scholar
- Fatemeh Torabi Asr and Maite Taboada. 2019. Big Data and quality data for fake news and misinformation detection. Big Data & Society 6, 1 (2019), 2053951719843310. https://doi.org/10.1177/2053951719843310 arXiv:https://doi.org/10.1177/2053951719843310Google ScholarCross Ref
- Douglas Bates, Martin Mächler, Ben Bolker, and Steve Walker. 2015. Fitting Linear Mixed-Effects Models Using lme4. Journal of Statistical Software 67, 1 (2015), 1–48. https://doi.org/10.18637/jss.v067.i01Google ScholarCross Ref
- Jan Panero Benway. 1998. Banner Blindness: The Irony of Attention Grabbing on the World Wide Web. Proceedings of the Human Factors and Ergonomics Society Annual Meeting 42, 5(1998), 463–467. https://doi.org/10.1177/154193129804200504 arXiv:https://doi.org/10.1177/154193129804200504Google ScholarCross Ref
- Adam J Berinsky. 2017. Rumors and health care reform: Experiments in political misinformation. British journal of political science 47, 2 (2017), 241–262.Google Scholar
- Md Momen Bhuiyan, Amy X Zhang, Connie Moon Sehat, and Tanushree Mitra. 2020. Investigating differences in crowdsourced news credibility assessment: Raters, tasks, and expert criteria. Proceedings of the ACM on Human-Computer Interaction 4, CSCW2(2020), 1–26.Google ScholarDigital Library
- Md Momen Bhuiyan, Kexin Zhang, Kelsey Vick, Michael A. Horning, and Tanushree Mitra. 2018. FeedReflect: A Tool for Nudging Users to Assess News Credibility on Twitter. In Companion of the 2018 ACM Conference on Computer Supported Cooperative Work and Social Computing (Jersey City, NJ, USA) (CSCW ’18). Association for Computing Machinery, New York, NY, USA, 205–208. https://doi.org/10.1145/3272973.3274056Google ScholarDigital Library
- Paul Bleakley. 0. Panic, pizza and mainstreaming the alt-right: A social media analysis of Pizzagate and the rise of the QAnon conspiracy. Current Sociology 0, 0 (0), 00113921211034896. https://doi.org/10.1177/00113921211034896 arXiv:https://doi.org/10.1177/00113921211034896Google ScholarCross Ref
- [12] Christian Bommarius.2009. https://www.fr.de/kultur/bisschen-zensur-11504177.htmlGoogle Scholar
- danah boyd. 2018. Did Media Literacy Backfire?https://points.datasociety.net/did-media-literacy-backfire-7418c084d88dGoogle Scholar
- Joel Breakstone, Mark Smith, Priscilla Connors, Teresa Ortega, Darby Kerr, and Sam Wineburg. 2021. Lateral reading: College students learn to critically evaluate internet sources in an online course. The Harvard Kennedy School Misinformation Review (2021).Google Scholar
- J Scott Brennen, Felix Simon, Philip N Howard, and Rasmus Kleis Nielsen. 2020. Types, sources, and claims of COVID-19 misinformation. Reuters Institute 7(2020), 3–1.Google Scholar
- Violet A Brown. 2021. An Introduction to Linear Mixed-Effects Modeling in R. Advances in Methods and Practices in Psychological Science 4, 1(2021), 2515245920960351.Google ScholarCross Ref
- John Brummette, Marcia DiStaso, Michail Vafeiadis, and Marcus Messner. 2018. Read All About It: The Politicization of “Fake News” on Twitter. Journalism & Mass Communication Quarterly 95, 2 (2018), 497–517. https://doi.org/10.1177/1077699018769906 arXiv:https://doi.org/10.1177/1077699018769906Google ScholarCross Ref
- Carlos Castillo, Marcelo Mendoza, and Barbara Poblete. 2011. Information Credibility on Twitter. In Proceedings of the 20th International Conference on World Wide Web (Hyderabad, India) (WWW ’11). Association for Computing Machinery, New York, NY, USA, 675–684. https://doi.org/10.1145/1963405.1963500Google ScholarDigital Library
- Pew Research Center. 2021. Facts on News Media & Political Polarization in Germany. https://www.pewresearch.org/global/fact-sheet/news-media-and-political-attitudes-in-germany/Google Scholar
- Katherine Clayton, Spencer Blair, Jonathan A Busam, Samuel Forstner, John Glance, Guy Green, Anna Kawata, Akhila Kovvuri, Jonathan Martin, Evan Morgan, 2020. Real solutions for fake news? Measuring the effectiveness of general warnings and fact-check tags in reducing belief in false stories on social media. Political Behavior 42, 4 (2020), 1073–1095.Google ScholarCross Ref
- Alexander Coppock and Oliver A. McClellan. 2019. Validating the demographic, political, psychological, and experimental results obtained from a new source of online survey respondents. Research & Politics 6, 1 (2019), 2053168018822174. https://doi.org/10.1177/2053168018822174 arXiv:https://doi.org/10.1177/2053168018822174Google ScholarCross Ref
- Clayton Allen Davis, Onur Varol, Emilio Ferrara, Alessandro Flammini, and Filippo Menczer. 2016. BotOrNot: A System to Evaluate Social Bots. In Proceedings of the 25th International Conference Companion on World Wide Web (Montréal, Québec, Canada) (WWW ’16 Companion). International World Wide Web Conferences Steering Committee, Republic and Canton of Geneva, CHE, 273–274. https://doi.org/10.1145/2872518.2889302Google ScholarDigital Library
- Nicholas Dias, Gordon Pennycook, and David G Rand. 2020. Emphasizing publishers does not effectively reduce susceptibility to misinformation on social media. Harvard Kennedy School Misinformation Review 1, 1 (2020).Google Scholar
- C. D’Ignazio and L.F. Klein. 2020. Data Feminism. MIT Press. https://books.google.dk/books?id=zZnSDwAAQBAJGoogle Scholar
- Ullrich KH Ecker, Stephan Lewandowsky, and David TW Tang. 2010. Explicit warnings reduce but do not eliminate the continued influence of misinformation. Memory & cognition 38, 8 (2010), 1087–1100.Google Scholar
- Allen L Edwards. 1958. The social desirability variable in personality assessment and research. Academic Medicine 33, 8 (1958), 610–611.Google Scholar
- Adam M Enders, Joseph E Uscinski, Casey Klofstad, and Justin Stoler. 2020. The different forms of COVID-19 misinformation and their consequences. The Harvard Kennedy School Misinformation Review (2020).Google Scholar
- Motahhare Eslami, Aimee Rickman, Kristen Vaccaro, Amirhossein Aleyasen, Andy Vuong, Karrie Karahalios, Kevin Hamilton, and Christian Sandvig. 2015. ”I Always Assumed That I Wasn’T Really That Close to [Her]”: Reasoning About Invisible Algorithms in News Feeds. In Proceedings of the 33rd Annual ACM Conference on Human Factors in Computing Systems(CHI ’15). ACM, New York, NY, USA, 153–162. https://doi.org/10.1145/2702123.2702556Google ScholarDigital Library
- Virginia Eubanks. 2019. Automating Inequality: How High-Tech Tools Profile, Police, and Punish the Poor. Picador. https://books.google.dk/books?id=WrJTuwEACAAJGoogle Scholar
- Jenny Fan and Amy X. Zhang. 2020. Digital Juries: A Civics-Oriented Approach to Platform Governance. In Proceedings of the 2020 CHI Conference on Human Factors in Computing Systems (Honolulu, HI, USA) (CHI ’20). Association for Computing Machinery, New York, NY, USA, 1–14. https://doi.org/10.1145/3313831.3376293Google ScholarDigital Library
- Federal Republic of Germany. 2016. Interstate Broadcasting Agreement (Rundfunkstaatsvertrag). https://germanlawarchive.iuscomp.org/?p=655Google Scholar
- Martin Flintham, Christian Karner, Khaled Bachour, Helen Creswick, Neha Gupta, and Stuart Moran. 2018. Falling for Fake News: Investigating the Consumption of News via Social Media. In Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems. Association for Computing Machinery, New York, NY, USA, 1–10. https://doi.org/10.1145/3173574.3173950Google ScholarDigital Library
- Center for Countering Digital Hate. 2021. The Disinformation Dozen – Why Platforms Must Act on Twelve Leading Online Anti-Vaxxers. Technical Report.Google Scholar
- Eugene Freeman. 2014. Objectivity as “Intersubjective Agreement”*. The Monist 57, 2 (12 2014), 168–175. https://doi.org/10.5840/monist19735722 arXiv:https://academic.oup.com/monist/article-pdf/57/2/168/3289700/monist57-0168.pdfGoogle ScholarCross Ref
- Mingkun Gao, Ziang Xiao, Karrie Karahalios, and Wai-Tat Fu. 2018. To Label or Not to Label: The Effect of Stance and Credibility Labels on Readers’ Selection and Perception of News Articles. Proc. ACM Hum.-Comput. Interact. 2, CSCW, Article 55 (Nov. 2018), 16 pages. https://doi.org/10.1145/3274324Google ScholarDigital Library
- Matthew H. Goldberg, Abel Gustafson, Seth A. Rosenthal, and Anthony Leiserowitz. 2021. Shifting Republican views on climate change through targeted advertising. Nature Climate Change 11, 7 (01 Jul 2021), 573–577. https://doi.org/10.1038/s41558-021-01070-1Google ScholarCross Ref
- Kelly M Greenhill and Ben Oppenheim. 2017. Rumor has it: The adoption of unverified information in conflict zones. International Studies Quarterly 61, 3 (2017), 660–676.Google ScholarCross Ref
- Maurício Gruppi, Benjamin D. Horne, and Sibel Adalı. 2020. NELA-GT-2019: A Large Multi-Labelled News Dataset for The Study of Misinformation in News Articles. arxiv:2003.08444 [cs.CY]Google Scholar
- Naeemul Hassan, Mohammad Yousuf, Md Mahfuzul Haque, Javier A. Suarez Rivas, and Md Khadimul Islam. 2019. Examining the Roles of Automation, Crowds and Professionals Towards Sustainable Fact-Checking. In Companion Proceedings of The 2019 World Wide Web Conference (San Francisco, USA) (WWW ’19). Association for Computing Machinery, New York, NY, USA, 1001–1006. https://doi.org/10.1145/3308560.3316734Google ScholarDigital Library
- Guillaume Hervet, Katherine Guérard, Sébastien Tremblay, and Mohamed Saber Chtourou. 2011. Is banner blindness genuine? Eye tracking internet text advertising. Applied cognitive psychology 25, 5 (2011), 708–716.Google Scholar
- Hendrik Heuer and Andreas Breiter. 2018. Trust in News on Social Media. In Proceedings of the 10th Nordic Conference on Human-Computer Interaction (Oslo, Norway) (NordiCHI ’18). Association for Computing Machinery, New York, NY, USA, 137–147. https://doi.org/10.1145/3240167.3240172Google ScholarDigital Library
- Sascha Hölig and Uwe Hasebrink. 2020. Reuters Institute Digital News Report 2020. Ergebnisse für Deutschland. Arbeitspapiere des Hans-Bredow-Instituts 50(2020).Google Scholar
- Xinlan Emily Hu, Mark E Whiting, and Michael S. Bernstein. 2021. Can Online Juries Make Consistent, Repeatable Decisions?Association for Computing Machinery, New York, NY, USA. https://doi.org/10.1145/3411764.3445433Google ScholarDigital Library
- Edda Humprecht, Frank Esser, and Peter Van Aelst. 2020. Resilience to Online Disinformation: A Framework for Cross-National Comparative Research. The International Journal of Press/Politics 25, 3 (2020), 493–516. https://doi.org/10.1177/1940161219900126 arXiv:https://doi.org/10.1177/1940161219900126Google ScholarCross Ref
- Farnaz Jahanbakhsh, Amy X. Zhang, Adam J. Berinsky, Gordon Pennycook, David G. Rand, and David R. Karger. 2021. Exploring Lightweight Interventions at Posting Time to Reduce the Sharing of Misinformation on Social Media. Proc. ACM Hum.-Comput. Interact. 5, CSCW1, Article 18 (apr 2021), 42 pages. https://doi.org/10.1145/3449092Google ScholarDigital Library
- Joseph Kahne and Benjamin Bowyer. 2017. Educating for democracy in a partisan age: Confronting the challenges of motivated reasoning and misinformation. American Educational Research Journal 54, 1 (2017), 3–34.Google ScholarCross Ref
- Jooyeon Kim, Behzad Tabibian, Alice Oh, Bernhard Schölkopf, and Manuel Gomez-Rodriguez. 2018. Leveraging the Crowd to Detect and Reduce the Spread of Fake News and Misinformation. In Proceedings of the Eleventh ACM International Conference on Web Search and Data Mining (Marina Del Rey, CA, USA) (WSDM ’18). Association for Computing Machinery, New York, NY, USA, 324–332. https://doi.org/10.1145/3159652.3159734Google ScholarDigital Library
- Jan Kirchner and Christian Reuter. 2020. Countering Fake News: A Comparison of Possible Solutions Regarding User Acceptance and Effectiveness. Proc. ACM Hum.-Comput. Interact. 4, CSCW2, Article 140 (Oct. 2020), 27 pages. https://doi.org/10.1145/3415211Google ScholarDigital Library
- Hans J Kleinsteuber. 2011. The Control of Public Service Broadcasting in Germany: Norm and Reality of the German Broadcasting Councils (“Rundfunkräte”)’. Public Service Broadcasting: A German-Ukrainian Exchange of Opinions. Working Papers of the Institute for Broadcasting Economics at the University of Cologne 276, 2 (2011), 71–86.Google Scholar
- David MJ Lazer, Matthew A Baum, Yochai Benkler, Adam J Berinsky, Kelly M Greenhill, Filippo Menczer, Miriam J Metzger, Brendan Nyhan, Gordon Pennycook, David Rothschild, and others. 2018. The science of fake news. Science 359, 6380 (2018), 1094–1096.Google Scholar
- Stephan Lewandowsky, Ullrich K. H. Ecker, Colleen M. Seifert, Norbert Schwarz, and John Cook. 2012. Misinformation and Its Correction: Continued Influence and Successful Debiasing. Psychological Science in the Public Interest 13, 3 (2012), 106–131. https://doi.org/10.1177/1529100612451018 arXiv:https://doi.org/10.1177/1529100612451018PMID: 26173286.Google ScholarCross Ref
- Chao Liu, Ryen W. White, and Susan Dumais. 2010. Understanding Web Browsing Behaviors through Weibull Analysis of Dwell Time. In Proceedings of the 33rd International ACM SIGIR Conference on Research and Development in Information Retrieval (Geneva, Switzerland) (SIGIR ’10). Association for Computing Machinery, New York, NY, USA, 379–386. https://doi.org/10.1145/1835449.1835513Google ScholarDigital Library
- I. Scott MacKenzie. 2013. Human-Computer Interaction: An Empirical Research Perspective. Morgan Kaufmann, Amsterdam. http://www.sciencedirect.com/science/book/9780124058651Google Scholar
- Henry B Mann and Donald R Whitney. 1947. On a test of whether one of two random variables is stochastically larger than the other. The annals of mathematical statistics(1947), 50–60.Google Scholar
- Paul Mena. 2020. Cleaning up social media: The effect of warning labels on likelihood of sharing false news on Facebook. Policy & internet 12, 2 (2020), 165–183.Google Scholar
- Solomon Messing, Christina DeGregorio, Bennett Hillenbrand, Gary King, Saurav Mahanti, Zagreb Mukerjee, Chaya Nayak, Nate Persily, Bogdan State, and Arjun Wilkins. 2020. Facebook Privacy-Protected Full URLs Data Set. https://doi.org/10.7910/DVN/TDOAPGGoogle ScholarCross Ref
- Miriam J Metzger, Andrew J Flanagin, and Ryan B Medders. 2010. Social and heuristic approaches to credibility evaluation online. Journal of communication 60, 3 (2010), 413–439.Google ScholarCross Ref
- Amy Mitchell, Jeffrey Gottfried, Galen Stocking, Mason Walker, and Sophia Fedeli. 2019. Many Americans Say Made-Up News Is a Critical Problem That Needs To Be Fixed. https://www.journalism.org/2019/06/05/many-americans-say-made-up-news-is-a-critical-problem-that-needs-to-be-fixed/Google Scholar
- Meredith Ringel Morris, Scott Counts, Asta Roseway, Aaron Hoff, and Julia Schwarz. 2012. Tweeting is Believing? Understanding Microblog Credibility Perceptions. In Proceedings of the ACM 2012 Conference on Computer Supported Cooperative Work (Seattle, Washington, USA) (CSCW ’12). Association for Computing Machinery, New York, NY, USA, 441–450. https://doi.org/10.1145/2145204.2145274Google ScholarDigital Library
- Mohsen Mosleh, Cameron Martel, Dean Eckles, and David Rand. 2021. Perverse Downstream Consequences of Debunking: Being Corrected by Another User for Posting False Political News Increases Subsequent Sharing of Low Quality, Partisan, and Toxic Content in a Twitter Field Experiment. In Proceedings of the 2021 CHI Conference on Human Factors in Computing Systems (Yokohama, Japan) (CHI ’21). Association for Computing Machinery, New York, NY, USA, Article 182, 13 pages. https://doi.org/10.1145/3411764.3445642Google ScholarDigital Library
- Nic Newman. 2020. Overview and Key Findings of the 2020 Digital News Report. https://www.digitalnewsreport.org/survey/2020/overview-key-findings-2020/Google Scholar
- Nic Newman, Richard Fletcher, Anne Schulz, Simge Andi, Craig T Robertson, and Rasmus Kleis Nielsen. 2021. Reuters Institute Digital News Report 2021. Reuters Institute for the Study of Journalism (2021).Google Scholar
- S.U. Noble. 2018. Algorithms of Oppression: How Search Engines Reinforce Racism. NYU Press. https://books.google.dk/books?id=-ThDDwAAQBAJGoogle Scholar
- Brendan Nyhan, Ethan Porter, Jason Reifler, and Thomas J Wood. 2020. Taking fact-checks literally but not seriously? The effects of journalistic fact-checking on factual beliefs and candidate favorability. Political Behavior 42, 3 (2020), 939–960.Google ScholarCross Ref
- Office of the Surgeon General. 2021. Confronting Health Misinformation: The U.S. Surgeon General’s Advisory on Building a Healthy Information Environment. https://books.google.dk/books?id=Hj6WzgEACAAJGoogle Scholar
- World Health Organization. 2020. Let’s flatten the infodemic curve. https://www.who.int/news-room/spotlight/let-s-flatten-the-infodemic-curveGoogle Scholar
- Irene V Pasquetto, Briony Swire-Thompson, Michelle A Amazeen, Fabrício Benevenuto, Nadia M Brashier, Robert M Bond, Lia C Bozarth, Ceren Budak, Ullrich KH Ecker, Lisa K Fazio, 2020. Tackling misinformation: What researchers could do with social media data. The Harvard Kennedy School Misinformation Review (2020).Google Scholar
- Gordon Pennycook, Adam Bear, Evan T Collins, and David G Rand. 2020. The implied truth effect: Attaching warnings to a subset of fake news headlines increases perceived accuracy of headlines without warnings. Management Science 66, 11 (2020), 4944–4957.Google ScholarDigital Library
- Gordon Pennycook, Tyrone D Cannon, and David G Rand. 2018. Prior exposure increases perceived accuracy of fake news.Journal of experimental psychology: general 147, 12 (2018), 1865.Google Scholar
- Gordon Pennycook, Ziv Epstein, Mohsen Mosleh, Antonio A. Arechar, Dean Eckles, and David G. Rand. 2021. Shifting attention to accuracy can reduce misinformation online. Nature 592, 7855 (01 Apr 2021), 590–595. https://doi.org/10.1038/s41586-021-03344-2Google ScholarCross Ref
- Gordon Pennycook, Jonathon McPhetres, Bence Bago, and David G. Rand. 0. Beliefs About COVID-19 in Canada, the United Kingdom, and the United States: A Novel Test of Political Polarization and Motivated Reasoning. Personality and Social Psychology Bulletin 0, 0 (0), 01461672211023652. https://doi.org/10.1177/01461672211023652 arXiv:https://doi.org/10.1177/01461672211023652PMID: 34180276.Google ScholarCross Ref
- Gordon Pennycook, Jonathon McPhetres, Yunhao Zhang, Jackson G Lu, and David G Rand. 2020. Fighting COVID-19 misinformation on social media: Experimental evidence for a scalable accuracy-nudge intervention. Psychological science 31, 7 (2020), 770–780.Google Scholar
- Gordon Pennycook and David G Rand. 2019. Fighting misinformation on social media using crowdsourced judgments of news source quality. Proceedings of the National Academy of Sciences 116, 7 (2019), 2521–2526.Google ScholarCross Ref
- Gordon Pennycook and David G Rand. 2019. Lazy, not biased: Susceptibility to partisan fake news is better explained by lack of reasoning than by motivated reasoning. Cognition 188(2019), 39–50.Google ScholarCross Ref
- Gordon Pennycook and David G Rand. 2020. Who falls for fake news? The roles of bullshit receptivity, overclaiming, familiarity, and analytic thinking. Journal of personality 88, 2 (2020), 185–200.Google ScholarCross Ref
- Verónica Pérez-Rosas, Bennett Kleinberg, Alexandra Lefevre, and Rada Mihalcea. 2018. Automatic Detection of Fake News. In Proceedings of the 27th International Conference on Computational Linguistics. Association for Computational Linguistics, Santa Fe, New Mexico, USA, 3391–3401. https://www.aclweb.org/anthology/C18-1287Google Scholar
- Whitney Phillips. 2020. We Need to Talk About Talking About QAnon. https://www.wired.com/story/we-need-to-talk-about-talking-about-qanon/Google Scholar
- Chanthika Pornpitakpan. 2004. The persuasiveness of source credibility: A critical review of five decades’ evidence. Journal of applied social psychology 34, 2 (2004), 243–281.Google ScholarCross Ref
- Martin Potthast, Sebastian Köpsel, Benno Stein, and Matthias Hagen. 2016. Clickbait Detection. In Advances in Information Retrieval, Nicola Ferro, Fabio Crestani, Marie-Francine Moens, Josiane Mothe, Fabrizio Silvestri, Giorgio Maria Di Nunzio, Claudia Hauff, and Gianmaria Silvello (Eds.). Springer International Publishing, Cham, 810–817.Google Scholar
- George Rabinowitz and Stuart Elaine Macdonald. 1989. A directional theory of issue voting. American political science review 83, 1 (1989), 93–121.Google Scholar
- Amanda Robb. 2020. Pizzagate: Anatomy of a Fake News Scandal. https://www.rollingstone.com/feature/anatomy-of-a-fake-news-scandal-125877/Google Scholar
- Dietram A. Scheufele and Nicole M. Krause. 2019. Science audiences, misinformation, and fake news. Proceedings of the National Academy of Sciences 116, 16(2019), 7662–7669. https://doi.org/10.1073/pnas.1805871115 arXiv:https://www.pnas.org/content/116/16/7662.full.pdfGoogle ScholarCross Ref
- Chengcheng Shao, Giovanni Luca Ciampaglia, Alessandro Flammini, and Filippo Menczer. 2016. Hoaxy: A Platform for Tracking Online Misinformation. In Proceedings of the 25th International Conference Companion on World Wide Web (Montréal, Québec, Canada) (WWW ’16 Companion). International World Wide Web Conferences Steering Committee, Republic and Canton of Geneva, CHE, 745–750. https://doi.org/10.1145/2872518.2890098Google ScholarDigital Library
- Karishma Sharma, Feng Qian, He Jiang, Natali Ruchansky, Ming Zhang, and Yan Liu. 2019. Combating Fake News: A Survey on Identification and Mitigation Techniques. ACM Trans. Intell. Syst. Technol. 10, 3, Article 21 (April 2019), 42 pages. https://doi.org/10.1145/3305260Google ScholarDigital Library
- Anuragini Shirish, Shirish C. Srivastava, and Shalini Chandra. 2021. Impact of mobile connectivity and freedom on fake news propensity during the COVID-19 pandemic: a cross-country empirical examination. European Journal of Information Systems 30, 3 (2021), 322–341. https://doi.org/10.1080/0960085X.2021.1886614 arXiv:https://doi.org/10.1080/0960085X.2021.1886614Google ScholarCross Ref
- Kai Shu, H. Russell Bernard, and Huan Liu. 2019. Studying Fake News via Network Analysis: Detection and Mitigation. In Emerging Research Challenges and Opportunities in Computational Social Network Analysis and Mining, Nitin Agarwal, Nima Dokoohaki, and Serpil Tokdemir (Eds.). Springer International Publishing, Cham, 43–65. https://doi.org/10.1007/978-3-319-94105-9_3Google ScholarCross Ref
- Kai Shu, Amy Sliva, Suhang Wang, Jiliang Tang, and Huan Liu. 2017. Fake News Detection on Social Media: A Data Mining Perspective. SIGKDD Explor. Newsl. 19, 1 (Sept. 2017), 22–36. https://doi.org/10.1145/3137597.3137600Google ScholarDigital Library
- S. Sloman and P. Fernbach. 2017. The Knowledge Illusion: Why We Never Think Alone. Penguin Publishing Group. https://books.google.dk/books?id=2xuMDAAAQBAJGoogle Scholar
- Matthew L Stanley, Paul Henne, Brenda W Yang, and Felipe De Brigard. 2020. Resistance to position change, motivated reasoning, and polarization. Political Behavior 42, 3 (2020), 891–913.Google ScholarCross Ref
- Sebastian Stier, Nora Kirkizh, Caterina Froio, and Ralph Schroeder. 2020. Populist attitudes and selective exposure to online news – A cross-country analysis combining web tracking and surveys. The International Journal of Press/Politics 3, 25 (2020), 426–446. https://doi.org/10.1177/1940161220907018Google ScholarCross Ref
- S Shyam Sundar. 1998. Effect of source attribution on perception of online news stories. Journalism & Mass Communication Quarterly 75, 1 (1998), 55–68.Google ScholarCross Ref
- Briony Swire, Adam J Berinsky, Stephan Lewandowsky, and Ullrich KH Ecker. 2017. Processing political misinformation: comprehending the Trump phenomenon. Royal Society open science 4, 3 (2017), 160802.Google Scholar
- Briony Swire-Thompson, Ullrich KH Ecker, Stephan Lewandowsky, and Adam J Berinsky. 2020. They might be a liar but they’re my liar: Source evaluation and the prevalence of misinformation. Political Psychology 41, 1 (2020), 21–34.Google ScholarCross Ref
- Jan-Willem van Prooijen. 2017. Why Education Predicts Decreased Belief in Conspiracy Theories. Applied Cognitive Psychology 31, 1 (2017), 50–58. https://doi.org/10.1002/acp.3301 arXiv:https://onlinelibrary.wiley.com/doi/pdf/10.1002/acp.3301Google ScholarCross Ref
- Soroush Vosoughi, Deb Roy, and Sinan Aral. 2018. The spread of true and false news online. Science 359, 6380 (2018), 1146–1151.Google Scholar
- William Yang Wang. 2017. “Liar, Liar Pants on Fire”: A New Benchmark Dataset for Fake News Detection. In Proceedings of the 55th Annual Meeting of the Association for Computational Linguistics (Volume 2: Short Papers). Association for Computational Linguistics, Vancouver, Canada, 422–426. https://doi.org/10.18653/v1/P17-2067Google ScholarCross Ref
- Claire Wardle, Hossein Derakhshan, 2018. Thinking about ‘information disorder’: formats of misinformation, disinformation, and mal-information. Ireton, Cherilyn; Posetti, Julie. Journalism,‘fake news’& disinformation. Paris: Unesco(2018), 43–54.Google Scholar
- Wikipedia contributors. 2021. Der Spiegel — Wikipedia, The Free Encyclopedia. https://en.wikipedia.org/w/index.php?title=Der_Spiegel&oldid=1020503053. [Online; accessed 12-July-2021].Google Scholar
- Wikipedia contributors. 2021. List of controversies involving The New York Times — Wikipedia, The Free Encyclopedia. https://en.wikipedia.org/w/index.php?title=List_of_controversies_involving_The_New_York_Times&oldid=1032880882. [Online; accessed 12-July-2021].Google Scholar
- Frank Wilcoxon. 1992. Individual Comparisons by Ranking Methods. In Breakthroughs in Statistics: Methodology and Distribution, Samuel Kotz and Norman L. Johnson (Eds.). Springer New York, New York, NY, 196–202. https://doi.org/10.1007/978-1-4612-4380-9_16Google ScholarCross Ref
- Sam Wineburg and Sarah McGrew. 2019. Lateral Reading and the Nature of Expertise: Reading Less and Learning More When Evaluating Digital Information. Teachers College Record 121, 11 (2019), 1–40. https://doi.org/10.1177/016146811912101102 arXiv:https://doi.org/10.1177/016146811912101102Google ScholarCross Ref
- Thomas Wood and Ethan Porter. 2019. The elusive backfire effect: Mass attitudes’ steadfast factual adherence. Political Behavior 41, 1 (2019), 135–163.Google ScholarCross Ref
- World Health Organization. 2020. Managing the COVID-19 infodemic: Promoting healthy behaviours and mitigating the harm from misinformation and disinformation. https://www.who.int/news/item/23-09-2020-managing-the-covid-19-infodemic-promoting-healthy-behaviours-and-mitigating-the-harm-from-misinformation-and-disinformationGoogle Scholar
- Liang Wu and Huan Liu. 2018. Tracing Fake-News Footprints: Characterizing Social Media Messages by How They Propagate. In Proceedings of the Eleventh ACM International Conference on Web Search and Data Mining (Marina Del Rey, CA, USA) (WSDM ’18). Association for Computing Machinery, New York, NY, USA, 637–645. https://doi.org/10.1145/3159652.3159677Google ScholarDigital Library
- Xinyi Zhou, Atishay Jain, Vir V. Phoha, and Reza Zafarani. 2020. Fake News Early Detection: A Theory-Driven Model. Digital Threats: Research and Practice 1, 2, Article 12 (June 2020), 25 pages. https://doi.org/10.1145/3377478Google ScholarDigital Library
Index Terms
- A Comparative Evaluation of Interventions Against Misinformation: Augmenting the WHO Checklist
Recommendations
Russian trolls speaking Russian: Regional Twitter operations and MH17
WebSci '20: Proceedings of the 12th ACM Conference on Web ScienceThe role of social media in promoting media pluralism was initially viewed as wholly positive as social media could break the oligopoly of (often state-owned) mainstream media. However, some governments are allegedly manipulating social media by hiring ...
Combating Misinformation by Sharing the Truth: a Study on the Spread of Fact-Checks on Social Media
AbstractMisinformation on social media has become a horrendous problem in our society. Fact-checks on information often fall behind the diffusion of misinformation, which can lead to negative impacts on society. This research studies how different factors ...
Are Mutated Misinformation More Contagious? A Case Study of COVID-19 Misinformation on Twitter
WebSci '22: Proceedings of the 14th ACM Web Science Conference 2022The spread of online misinformation has become a major global risk. Understanding how misinformation propagates on social media is vital. While prior studies suggest that the content factors, such as emotion and topic in texts, are closely related to the ...
Comments