Upasana Dutta
Skip Abstract Section
Abstract
Social media platforms have been exploited to conduct election interference in recent years. In particular, the Russian-backed Internet Research Agency (IRA) has been identified as a key source of misinformation spread on Twitter prior to the 2016 U.S. presidential election. The goal of this research is to understand whether general Twitter users changed their behavior in the year following first contact from an IRA account. We compare the before and after behavior of contacted users to determine whether there were differences in their mean tweet count, the sentiment of their tweets, and the frequency and sentiment of tweets mentioning @realDonaldTrump or @HillaryClinton. Our results indicate that users overall exhibited statistically significant changes in behavior across most of these metrics, and that those users that engaged with the IRA generally showed greater changes in behavior.
- Maggie Haberman Adam Goldman, Julian E. Barnes and Nicholas Fandos. 2020. Lawmakers Are Warned That Russia Is Meddling to Re-elect Trump. https://www.nytimes.com/2020/02/20/us/politics/russian-interference-trump-democrats.html [Online; accessed 15-May-2020].Google Scholar
- Nuha Albadi, Maram Kurdi, and Shivakant Mishra. 2019. Hateful People or Hateful Bots? Detection and Characterization of Bots Spreading Religious Hatred in Arabic Social Media. Proceedings of the ACM on Human-Computer Interaction 3, CSCW (2019), 1--25.Google Scholar
- Dan Arnaudo. 2017. Computational propaganda in Brazil: Social bots during elections. (2017).Google Scholar
- Christopher A Bail, Brian Guay, Emily Maloney, Aidan Combs, D Sunshine Hillygus, Friedolin Merhout, Deen Freelon, and Alexander Volfovsky. 2020. Assessing the Russian Internet Research Agency's impact on the political attitudes and behaviors of American Twitter users in late 2017. Proceedings of the National Academy of Sciences 117, 1 (2020).Google Scholar
- Shelly Banjo. 2019. Facebook, Twitter and the Digital Disinformation Mess. https://www.washingtonpost.com/ business/facebook-twitter-and-the-digital-disinformation-mess/2019/10/01/53334c08-e4b4-11e9-b0a6-3d03721b85ef_story.htmlGoogle Scholar
- Matthew C Benigni, Kenneth Joseph, and Kathleen M Carley. 2017. Online extremism and the communities that sustain it: Detecting the ISIS supporting community on Twitter. PloS one 12, 12 (2017).Google Scholar
- Alessandro Bessi and Emilio Ferrara. 2016. Social bots distort the 2016 US Presidential election online discussion. First Monday 21, 11--7 (2016).Google ScholarCross Ref
- Brandon C Boatwright, Darren L Linvill, and Patrick L Warren. 2018. Troll factories: The internet research agency and state-sponsored agenda building. Resource Centre on Media Freedom in Europe (2018).Google Scholar
- Ryan L Boyd, Alexander Spangher, Adam Fourney, Besmira Nushi, Gireeja Ranade, James Pennebaker, and Eric Horvitz. 2018. Characterizing the Internet Research Agency's Social Media Operations During the 2016 US Presidential Election using Linguistic Analyses. (2018).Google Scholar
- Joanna M Burkhardt. 2017. Combating fake news in the digital age. Vol. 53. American Library Association.Google Scholar
- Sebastian Shukla Gianluca Mezzofiore Clarissa Ward, Katie Polglase and Tim Lister. 2020. Russian election meddling is back -- via Ghana and Nigeria -- and in your feeds. https://www.cnn.com/2020/03/12/world/russia-ghana-troll-farms-2020-ward/index.html [Online; accessed 15-May-2020].Google Scholar
- Nicole A Cooke. 2018. Fake news and alternative facts: Information literacy in a post-truth era. American Library Association.Google Scholar
- Stefano Cresci, Roberto Di Pietro, Marinella Petrocchi, Angelo Spognardi, and Maurizio Tesconi. 2017. The Paradigm-Shift of Social Spambots. Proceedings of the 26th International Conference on World Wide Web Companion - WWW '17 Companion (2017). https://doi.org/10.1145/3041021.3055135Google ScholarDigital Library
- Michal Mimino Danilak. 2020. langdetect 1.0.8. https://pypi.org/project/langdetect/ [Online; accessed 15-May-2020].Google Scholar
- Renee DiResta, Kris Shaffer, Becky Ruppel, David Sullivan, Robert Matney, Ryan Fox, Jonathan Albright, and Ben Johnson. 2018. The tactics and tropes of the Internet Research Agency. (2018).Google Scholar
- Emilio Ferrara. 2017. Disinformation and social bot operations in the run up to the 2017 French presidential election. arXiv preprint arXiv:1707.00086 (2017).Google Scholar
- Emilio Ferrara, Onur Varol, Clayton Davis, Filippo Menczer, and Alessandro Flammini. 2016. The rise of social bots. Commun. ACM 59, 7 (2016), 96--104.Google ScholarDigital Library
- Vijaya Gadde and Kayvon Beykpour. 2018. Setting the record straight on shadow banning. https://blog.twitter. com/en_us/topics/company/2018/Setting-the-record-straight-on-shadow-banning.htmlGoogle Scholar
- Leo A. Goodman. 1961. Snowball Sampling. The Annals of Mathematical Statistics 32, 1 (1961), 148--170. http: //www.jstor.org/stable/2237615Google ScholarCross Ref
- Garrett M. Graff. 2018. Russian Trolls Are Still Playing Both Sides-Even With the Mueller Probe. https://www.wired. com/story/russia-indictment-twitter-facebook-play-both-sides/Google Scholar
- Philip N Howard, Bharath Ganesh, Dimitra Liotsiou, John Kelly, and Camille François. 2019. The IRA, Social Media and Political Polarization in the United States, 2012--2018. U.S. Senate Documents (2019).Google Scholar
- Philip N Howard and Bence Kollanyi. 2016. Bots,# StrongerIn, and# Brexit: computational propaganda during the UK-EU referendum. Available at SSRN 2798311 (2016).Google Scholar
- C.J. Hutto and E.E. Gilbert. 2014. VADER: A Parsimonious Rule-based Model for Sentiment Analysis of Social Media Text. Eighth International Conference on Weblogs and Social Media. https://pypi.org/project/vaderSentiment/.Google Scholar
- Franziska B Keller, David Schoch, Sebastian Stier, and JungHwan Yang. 2020. Political Astroturfing on Twitter: How to coordinate a disinformation Campaign. Political Communication 37, 2 (2020), 256--280.Google ScholarCross Ref
- Castulus Kolo and Florian Haumer. 2018. Social media celebrities as influencers in brand communication: An empirical study on influencer content, its advertising relevance and audience expectations. Journal of Digital & Social Media Marketing 6, 3 (2018), 273--282.Google Scholar
- Charles Kriel and Alexa Pavliuc. 2019. Reverse Engineering Russian Internet Research Agency Tactics through Network Analysis. Defence Strategic Communication (2019), 199--227.Google Scholar
- Hubert W Lilliefors. 1967. On the Kolmogorov-Smirnov test for normality with mean and variance unknown. Journal of the American statistical Association 62, 318 (1967), 399--402.Google ScholarCross Ref
- Natasha Lomas. 2020. Instagram says growth hackers are behind spate of fake Stories. https://techcrunch.com/2019/ 08/15/instagram-says-growth-hackers-are-behind-spate-of-fake-stories-views/ [Online; accessed 15- May-2020].Google Scholar
- Chen Lou and Shupei Yuan. 2019. Influencer marketing: how message value and credibility affect consumer trust of branded content on social media. Journal of Interactive Advertising 19, 1 (2019), 58--73.Google ScholarCross Ref
- Gianluca Mezzofiore Mary Ilyushina and Tim Lister. 2019. Russia's 'troll factory' is alive and well in Africa. https: //www.cnn.com/2019/10/31/europe/russia-africa-propaganda-intl/index.html [Online; accessed 15-May-2020].Google Scholar
- Frank J Massey Jr. 1951. The Kolmogorov-Smirnov test for goodness of fit. Journal of the American statistical Association 46, 253 (1951), 68--78.Google ScholarCross Ref
- Robert S Mueller and Man With A. Cat. 2019. Report on the investigation into Russian interference in the 2016 presidential election. Vol. 1. US Department of Justice Washington, DC.Google Scholar
- US House of Representatives Permanent Select Committee on Intelligence. 2018. Exposing Russia's Effort to Sow Discord Online: The Internet Research Agency and Advertisements. (2018).Google Scholar
- Donie O'Sullivan. 2020. Facebook: Russian trolls are back. And they're here to meddle with 2020. https://www.cnn.com/ 2019/10/21/tech/russia-instagram-accounts-2020-election/index.html [Online; accessed 15-May-2020].Google Scholar
- Twitter Public Policy. 2018. Update on Twitter's review of the 2016 US election. https://blog.twitter.com/en_ us/topics/company/2018/2016-election-update.html. [Online; accessed 15-May-2020].Google Scholar
- Joshua Roesslein. 2019. Tweepy Documentation. http://docs.tweepy.org/en/latest/ [Online; accessed 15-May-2020].Google Scholar
- Damian J Ruck, Natalie M Rice, Joshua Borycz, and R Alexander Bentley. 2019. Internet Research Agency Twitter activity predicted 2016 US election polls. First Monday 24, 7 (2019).Google Scholar
- Chengcheng Shao, Giovanni Luca Ciampaglia, Onur Varol, Alessandro Flammini, and Filippo Menczer. 2017. The spread of fake news by social bots. arXiv preprint arXiv:1707.07592 96 (2017), 104.Google Scholar
- Luke Sloan and Jeffrey Morgan. 2015. Who tweets with their location? Understanding the relationship between demographic characteristics and the use of geoservices and geotagging on Twitter. PloS one 10, 11 (2015).Google ScholarCross Ref
- Statistics Solutions. 2020. How to Conduct the Wilcoxon Sign Test. https://www.statisticssolutions.com/how-to-conduct-the-wilcox-sign-test/ [Online; accessed 15-May-2020].Google Scholar
- Liam Stack. 2018. What Is a 'Shadow Ban,' and Is Twitter Doing It to Republican Accounts? https://www.nytimes. com/2018/07/26/us/politics/twitter-shadowbanning.htmlGoogle Scholar
- Kate Starbird, Ahmer Arif, and Tom Wilson. 2019. Disinformation as collaborative work: Surfacing the participatory nature of strategic information operations. Proceedings of the ACM on Human-Computer Interaction 3, CSCW (2019), 1--26.Google ScholarDigital Library
- OSINT team. 2020. TWINT - Twitter Intelligence Tool. https://github.com/twintproject/twint [Online; accessed 15-May-2020].Google Scholar
- Nicholas Thompson. 2018. How Russian Trolls Used Meme Warfare to Divide America. https://www.wired.com/ story/russia-ira-propaganda-senate-report/ [Online; accessed 15-May-2020].Google Scholar
- Tom Wilson and Kate Starbird. 2020. Cross-platform disinformation campaigns: lessons learned and next steps. Harvard Kennedy School Misinformation Review 1, 1 (2020).Google Scholar
- Stefan Wojcik, Solomon Messing, Aaron Smith, Lee Rainie, and Paul Hitlin. 2018. Bots in the Twittersphere. Pew Research Center 18 (2018).Google Scholar
- Samuel C Woolley and Philip Howard. 2017. Computational propaganda worldwide: Executive summary. (2017).Google Scholar
- Kaicheng Yang. 2020. Botometer Python API. https://github.com/yangkcatiu/botometer-pythonGoogle Scholar
- Kai-Cheng Yang, Onur Varol, Clayton A. Davis, Emilio Ferrara, Alessandro Flammini, and Filippo Menczer. 2019. Arming the public with artificial intelligence to counter social bots. Human Behavior and Emerging Technologies 1, 1 (2019), 48--61. https://doi.org/10.1002/hbe2.115 arXiv:https://onlinelibrary.wiley.com/doi/pdf/10.1002/hbe2.115Google ScholarCross Ref
Index Terms
- Analyzing Twitter Users' Behavior Before and After Contact by the Russia's Internet Research Agency
Recommendations
Analyzing behavioral changes of Twitter users after exposure to misinformation
ASONAM '21: Proceedings of the 2021 IEEE/ACM International Conference on Advances in Social Networks Analysis and MiningSocial media platforms have been exploited to disseminate misinformation in recent years. The widespread online misinformation has been shown to affect users' beliefs and is connected to social impact such as polarization. In this work, we focus on ...
IRA Propaganda on Twitter: Stoking Antagonism and Tweeting Local News
SMSociety '18: Proceedings of the 9th International Conference on Social Media and SocietyThis paper presents preliminary findings of a content analysis of tweets posted by false accounts operated by the Internet Research Agency (IRA) in St Petersburg. We relied on a historical database of tweets to retrieve 4,539 tweets posted by IRA-linked ...
Analyzing User Retweet Behavior on Twitter
ASONAM '12: Proceedings of the 2012 International Conference on Advances in Social Networks Analysis and Mining (ASONAM 2012)This paper provides a deep analysis of user retweet behavior on Twitter. While previous works about analyzing retweet have mainly focused on predicting the retweetability of each tweet, they lacked interpretations at an individual level. In this paper, ...
Comments