research-article

Conformity of Eating Disorders through Content Moderation

Authors:
Jessica L. Feuston

Northwestern University, Evanston, IL, USA

Northwestern University, Evanston, IL, USA
View Profile

,
Alex S. Taylor

City, University of London, London, United Kingdom

City, University of London, London, United Kingdom
View Profile

,
Anne Marie Piper

Northwestern University, Evanston, IL, USA

Northwestern University, Evanston, IL, USA
View Profile

Proceedings of the ACM on Human-Computer Interaction Volume 4 Issue CSCW1Article No.: 40pp 1–28https://doi.org/10.1145/3392845

Published:29 May 2020Publication History

Proceedings of the ACM on Human-Computer Interaction

Abstract

For individuals with mental illness, social media platforms are considered spaces for sharing and connection. However, not all expressions of mental illness are treated equally on these platforms. Different aggregates of human and technical control are used to report and ban content, accounts, and communities. Through two years of digital ethnography, including online observation and interviews, with people with eating disorders, we examine the experience of content moderation. We use a constructivist grounded theory approach to analysis that shows how practices of moderation across different platforms have particular consequences for members of marginalized groups, who are pressured to conform and compelled to resist. Above all, we argue that platform moderation is enmeshed with wider processes of conformity to specific versions of mental illness. Practices of moderation reassert certain bodies and experiences as 'normal' and valued, while rejecting others. At the same time, navigating and resisting these normative pressures further inscribes the marginal status of certain individuals. We discuss changes to the ways that platforms handle content related to eating disorders by drawing on the concept of multiplicity to inform design.

References

Nazanin Andalibi. 2019. What Happens After Disclosing Stigmatized Experiences on Identified Social Media: Individual, Dyadic, and Social/Network Outcomes. In Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems. ACM, 137.Google ScholarDigital Library
Nazanin Andalibi and Andrea Forte. 2018. Announcing pregnancy loss on Facebook: A decision-making framework for stigmatized disclosures on identified social network sites. In Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems. 1--14.Google ScholarDigital Library
Nazanin Andalibi, Pinar Ozturk, and Andrea Forte. 2017. Sensitive Self-disclosures, Responses, and Social Support on Instagram: The Case of #Depression. In Proceedings of the 2017 ACM Conference on Computer Supported Cooperative Work and Social Computing (CSCW '17). ACM, New York, NY, USA, 1485--1500. https://doi.org/10.1145/2998181.2998243Google ScholarDigital Library
Monica Anderson, Skye Toor, Lee Rainie, and Aaron Smith. 2018. Activism in the Social Media Age. Pew Research Center (11 July 2018). https://www.pewinternet.org/2018/07/11/activism-in-the-social-media-age/Google Scholar
Natalya N Bazarova, Yoon Hyung Choi, Victoria Schwanda Sosik, Dan Cosley, and Janis Whitlock. 2015. Social sharing of emotions on Facebook: Channel differences, satisfaction, and replies. In Proceedings of the 18th ACM conference on computer supported cooperative work & social computing. ACM, 154--164.Google ScholarDigital Library
Rena Bivens. 2017. The gender binary will not be deprogrammed: Ten years of coding gender on Facebook. New Media & Society, Vol. 19, 6 (2017), 880--898.Google ScholarCross Ref
Rena Bivens and Oliver L Haimson. 2016. Baking gender into social media design: How platforms shape categories for users and advertisers. Social Media+Society, Vol. 2, 4 (2016), 2056305116672486.Google Scholar
Lindsay Blackwell, Jill Dimond, Sarita Schoenebeck, and Cliff Lampe. 2017. Classification and Its Consequences for Online Harassment: Design Insights from HeartMob. Proc. ACM Hum.-Comput. Interact., Vol. 1, CSCW (Dec. 2017), 24:1--24:19. https://doi.org/10.1145/3134659Google ScholarDigital Library
Leah Boepple and J Kevin Thompson. 2016. A content analytic comparison of fitspiration and thinspiration websites. International Journal of Eating Disorders, Vol. 49, 1 (2016), 98--101.Google ScholarCross Ref
Dina L. G. Borzekowski, Summer Schenk, Jenny L. Wilson, and Rebecka Peebles. 2010. e-Ana and e-Mia: A Content Analysis of Pro-Eating Disorder Web Sites. American Journal of Public Health, Vol. 100, 8 (Aug. 2010), 1526--1534. https://doi.org/10.2105/AJPH.2009.172700Google ScholarCross Ref
Leanne Bowler, Eleanor Mattern, Wei Jeng, Jung Sun Oh, and Daqing He. 2013. I know what you are going through: answers to informational questions about eating disorders in Yahoo! Answers: a qualitative study. In Proceedings of the 76th ASIS&T Annual Meeting: Beyond the Cloud: Rethinking Information Boundaries. American Society for Information Science, 6.Google ScholarCross Ref
Leanne Bowler, Jung Sun Oh, Daqing He, Eleanor Mattern, and Wei Jeng. 2012. Eating disorder questions in Yahoo! Answers: Information, conversation, or reflection? Proceedings of the American Society for Information Science and Technology, Vol. 49, 1 (2012), 1--11.Google ScholarCross Ref
Danah Boyd. 2010. Social network sites as networked publics: Affordances, dynamics, and implications. In A networked self. Routledge, 47--66.Google Scholar
Danah Boyd. 2014. It's complicated: The social lives of networked teens .Yale University Press.Google ScholarDigital Library
Rosi Braidotti. 2000. Teratologies. In Deleuze and Feminist Theory,, Ian Buchanan and Claire Colebrook (Eds.). Edinburgh University Press, Edinburgh, 156--172. https://edinburghuniversitypress.com/book-deleuze-and-feminist-theory.htmlGoogle Scholar
Amy Bruckman. 2006. Teaching students to study online communities ethically. Journal of Information Ethics, Vol. 15, 2 (2006), 82.Google ScholarCross Ref
Eleanor R. Burgess, Kathryn E. Ringland, Jennifer Nicholas, Ashley A. Knapp, Jordan Eschler, David C. Mohr, and Madhu C. Reddy. 2019. “I think people are powerful”: The sociality of individuals managing depression. Proc. ACM Hum.-Comput. Interact., Vol. 3, CSCW (Nov 2019), 41:1--41:29. https://doi.org/10.1145/3359143Google ScholarDigital Library
Judith Butler. 1993. Bodies That Matter: On the Discursive Limits of `Sex' .Routledge, New York.Google Scholar
Kellie E Carlyle, Jeanine PD Guidry, Kofoworola Williams, Ariella Tabaac, and Paul B Perrin. 2018. Suicide conversations on Instagram: contagion or caring? Journal of Communication in Healthcare, Vol. 11, 1 (2018), 12--18.Google ScholarCross Ref
Patricia A Cavazos-Rehg, Melissa J Krauss, Shaina J Costello, Nina Kaiser, Elizabeth S Cahn, Ellen E Fitzsimmons-Craft, and Denise E Wilfley. 2019. “I just want to be skinny.”: A content analysis of tweets expressing eating disorder symptoms. PloS one, Vol. 14, 1 (2019), e0207506.Google ScholarCross Ref
Stevie Chancellor, Andrea Hu, and Munmun De Choudhury. 2018. Norms Matter: Contrasting Social Support Around Behavior Change in Online Weight Loss Communities. In Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems (CHI '18). ACM, New York, NY, USA, 666:1--666:14. https://doi.org/10.1145/3173574.3174240Google ScholarDigital Library
Stevie Chancellor, Yannis Kalantidis, Jessica A. Pater, Munmun De Choudhury, and David A. Shamma. 2017. Multimodal Classification of Moderated Online Pro-Eating Disorder Content. In Proceedings of the 2017 CHI Conference on Human Factors in Computing Systems (CHI '17). ACM, New York, NY, USA, 3213--3226. https://doi.org/10.1145/3025453.3025985Google ScholarDigital Library
Stevie Chancellor, Zhiyuan (Jerry) Lin, and Munmun De Choudhury. 2016a. "This Post Will Just Get Taken Down": Characterizing Removed Pro-Eating Disorder Social Media Content. In Proceedings of the 2016 CHI Conference on Human Factors in Computing Systems (CHI '16). ACM, New York, NY, USA, 1157--1162. https://doi.org/10.1145/2858036.2858248Google ScholarDigital Library
Stevie Chancellor, Tanushree Mitra, and Munmun De Choudhury. 2016b. Recovery Amid Pro-Anorexia: Analysis of Recovery in Social Media. In Proceedings of the 2016 CHI Conference on Human Factors in Computing Systems (CHI '16). ACM, New York, NY, USA, 2111--2123. https://doi.org/10.1145/2858036.2858246Google ScholarDigital Library
Stevie Chancellor, Jessica Annette Pater, Trustin Clear, Eric Gilbert, and Munmun De Choudhury. 2016c. #Thyghgapp: Instagram Content Moderation and Lexical Variation in Pro-Eating Disorder Communities. In Proceedings of the 19th ACM Conference on Computer-Supported Cooperative Work & Social Computing (CSCW '16). ACM, New York, NY, USA, 1201--1213. https://doi.org/10.1145/2818048.2819963Google ScholarDigital Library
Eshwar Chandrasekharan, Umashanthi Pavalanathan, Anirudh Srinivasan, Adam Glynn, Jacob Eisenstein, and Eric Gilbert. 2017. You can't stay here: The efficacy of reddit's 2015 ban examined through hate speech. Proceedings of the ACM on Human-Computer Interaction, Vol. 1, CSCW (2017), 31.Google ScholarDigital Library
Eshwar Chandrasekharan, Mattia Samory, Shagun Jhaver, Hunter Charvat, Amy Bruckman, Cliff Lampe, Jacob Eisenstein, and Eric Gilbert. 2018. The Internet's Hidden Rules: An Empirical Study of Reddit Norm Violations at Micro, Meso, and Macro Scales. Proc. ACM Hum.-Comput. Interact., Vol. 2, CSCW (Nov. 2018), 32:1--32:25. https://doi.org/10.1145/3274301Google ScholarDigital Library
Jonathan P Chang and Cristian Danescu-Niculescu-Mizil. 2019. Trouble on the Horizon: Forecasting the Derailment of Online Conversations as they Develop. arXiv preprint arXiv:1909.01362 (2019).Google Scholar
Pamara F Chang and Natalya N Bazarova. 2016. Managing stigma: Disclosure-response communication patterns in pro-anorexic websites. Health Communication, Vol. 31, 2 (2016), 217--229.Google ScholarCross Ref
Kathy Charmaz. 2014. Constructing Grounded Theory. SAGE.Google Scholar
Robert B Cialdini and Noah J Goldstein. 2004. Social influence: Compliance and conformity. Annu. Rev. Psychol., Vol. 55 (2004), 591--621.Google ScholarCross Ref
Kate Crawford and Tarleton Gillespie. 2016. What is a flag for? Social media reporting tools and the vocabulary of complaint. New Media & Society, Vol. 18, 3 (March 2016), 410--428. https://doi.org/10.1177/1461444814543163Google ScholarCross Ref
Sky Croeser. 2016. Thinking Beyond `Free Speech' in Responding to Online Harassment. Ada: a journal of new media, gender, and culture, Vol. 10 (2016), online--online.Google Scholar
Munmun De Choudhury. 2015. Anorexia on Tumblr: A Characterization Study. In Proceedings of the 5th International Conference on Digital Health 2015 (DH '15). ACM, New York, NY, USA, 43--50. https://doi.org/10.1145/2750511.2750515Google ScholarDigital Library
Tisha Dejmanee. 2013. Bodies of technology : performative flesh, pleasure and subversion in cyberspace. Gender Questions, Vol. 1, 1 (Jan. 2013), 3--17. https://journals.co.za/content/genderq/1/1/EJC167619Google Scholar
Michael A. DeVito, Ashley Marie Walker, and Jeremy Birnholtz. 2018. `Too Gay for Facebook': Presenting LGBTQGoogle Scholar
Identity Throughout the Personal Social Media Ecosystem. Proc. ACM Hum.-Comput. Interact., Vol. 2, CSCW (Nov. 2018), 44:1--44:23. https://doi.org/10.1145/3274313Google ScholarDigital Library
Jill P Dimond, Michaelanne Dye, Daphne LaRose, and Amy S Bruckman. 2013. Hollaback!: the role of storytelling online in a social movement organization. In Proceedings of the 2013 conference on Computer supported cooperative work. ACM, 477--490.Google ScholarDigital Library
Bryan Dosono and Bryan Semaan. 2019. Moderation Practices as Emotional Labor in Sustaining Online Communities: The Case of AAPI Identity Work on Reddit. In Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems. ACM, 142.Google ScholarDigital Library
Paul Dourish. 2006. Implications for design. In Proceedings of the SIGCHI conference on Human Factors in computing systems. 541--550.Google ScholarDigital Library
Maeve Duggan. 2017. Online harassment 2017. (2017).Google Scholar
Brianna Dym, Jed R Brubaker, Casey Fiesler, and Bryan Semaan. 2019. "Coming Out Okay": Community Narratives for LGBTQ Identity Recovery Work. Proc. ACM Hum.-Comput. Interact., Vol. 3, CSCW (Nov. 2019), 29. https://doi.org/10.1145/3359256Google ScholarDigital Library
Elizabeth V Eikey. 2016. Privacy and weight loss apps: a first look at how women with eating disorders use social features. In Proceedings of the 19th International Conference on Supporting Group Work. 413--415.Google ScholarDigital Library
Elizabeth V Eikey and Kayla M Booth. 2017. Recovery and maintenance: how women with eating disorders use Instagram. iConference 2017 Proceedings (2017).Google Scholar
Elizabeth V Eikey and Madhu C Reddy. 2017. ?It's Definitely Been a Journey": A Qualitative Study on How Women with Eating Disorders Use Weight Loss Apps. In Proceedings of the 2017 CHI conference on human factors in computing systems. 642--654.Google ScholarDigital Library
Elizabeth Victoria Eikey, Madhu C Reddy, Kayla M Booth, Lynette Kvasny, Johnna L Blair, Victor Li, and Erika S Poole. 2017. Desire to be underweight: Exploratory study on a weight loss app community and user perceptions of the impact on disordered eating behaviors. JMIR mHealth and uHealth, Vol. 5, 10 (2017), e150.Google Scholar
Jessica L. Feuston and Anne Marie Piper. 2018. Beyond the Coded Gaze: Analyzing Expression of Mental Health and Illness on Instagram. Proc. ACM Hum.-Comput. Interact., Vol. 2, CSCW (Nov. 2018), 51:1--51:21. https://doi.org/10.1145/3274320Google ScholarDigital Library
Jessica L. Feuston and Anne Marie Piper. 2019. Everyday Experiences: Small Stories and Mental Illness on Instagram. In Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems (CHI '19). ACM, New York, NY, USA, 265:1--265:14. https://doi.org/10.1145/3290605.3300495 event-place: Glasgow, Scotland Uk.Google ScholarDigital Library
Casey Fiesler, Michaelanne Dye, Jessica L Feuston, Chaya Hiruncharoenvate, Clayton J Hutto, Shannon Morrison, Parisa Khanipour Roshan, Umashanthi Pavalanathan, Amy S Bruckman, Munmun De Choudhury, et al. 2017. What (or who) is public?: Privacy settings and social media content sharing. In Proceedings of the 2017 ACM Conference on Computer Supported Cooperative Work and Social Computing. ACM, 567--580.Google ScholarDigital Library
Casey Fiesler, Jialun "Aaron" Jiang, Joshua McCann, Kyle Frye, and Jed R. Brubaker. 2018. Reddit Rules! Characterizing an Ecosystem of Governance. In Twelfth International AAAI Conference on Web and Social Media. https://www.aaai.org/ocs/index.php/ICWSM/ICWSM18/paper/view/17898Google Scholar
Casey Fiesler and Nicholas Proferes. 2018. “Participant” perceptions of Twitter research ethics. Social Media+Society, Vol. 4, 1 (2018), 2056305118763366.Google Scholar
Rachel A Fleming-May and Laura E Miller. 2010. I'm scared to look but I'm dying to know: information seeking and sharing on Pro-Ana weblogs. In Proceedings of the 73rd ASIS&T Annual Meeting on Navigating Streams in an Information Ecosystem-Volume 47. American Society for Information Science, 61.Google ScholarCross Ref
Michel Foucault. 2003. Madness and civilization .Routledge.Google Scholar
Michel Foucault. 2012. Discipline and punish: The birth of the prison .Vintage.Google Scholar
Arthur W. Frank. [n. d.]. The Wounded Storyteller. https://www.press.uchicago.edu/ucp/books/book/chicago/W/bo14674212.htmlGoogle Scholar
Mary Anne Franks. [n. d.]. The Free Speech Black Hole: Can The Internet Escape the Gravitational Pull of the First Amendment? Knight First Amendment Institute at Columbia University ([n. d.]). https://knightcolumbia.org/content/the-free-speech-black-hole-can-the-internet-escape-the-gravitational-pull-of-the-first-amendmentGoogle Scholar
Christian Fuchs. 2013. Internet and Surveillance: The Challenges of Web 2.0 and Social Media. Routledge.Google Scholar
Ysabel Gerrard. 2018. Beyond the hashtag: Circumventing content moderation on social media. New Media & Society, Vol. 20, 12 (2018), 4492--4511.Google ScholarCross Ref
Tarleton Gillespie. 2018. Custodians of the Internet: Platforms, Content Moderation, and the Hidden Decisions that Shape Social Media. Yale University Press.Google Scholar
Debbie Ging and Sarah Garvey. 2018. `Written in these scars are the stories I can't explain': A content analysis of pro-ana and thinspiration image sharing on Instagram. New Media & Society, Vol. 20, 3 (2018), 1181--1200.Google ScholarCross Ref
Eric Goldman. 2010. Unregulating Online Harassment. Denver University Law Review Online, Vol. 57 (2010), 59.Google Scholar
Mary L Gray and Siddharth Suri. 2019. Ghost Work: How to Stop Silicon Valley from Building a New Global Underclass .Eamon Dolan Books, New York.Google Scholar
James Grimmelmann. 2015. The Virtues of Moderation. Yale Journal of Law and Technology (2015), 42--109. https://heinonline.org/HOL/P?h=hein.journals/yjolt17&i=42Google Scholar
Oliver L Haimson, Jed R Brubaker, Lynn Dombrowski, and Gillian R Hayes. 2015a. Disclosure, stress, and support during gender transition on Facebook. In Proceedings of the 18th ACM Conference on Computer Supported Cooperative Work & Social Computing. ACM, 1176--1190.Google ScholarDigital Library
Oliver L Haimson, Jed R Brubaker, Lynn Dombrowski, and Gillian R Hayes. 2016. Digital footprints and changing networks during online identity transitions. In Proceedings of the 2016 CHI Conference on Human Factors in Computing Systems. ACM, 2895--2907.Google ScholarDigital Library
Oliver L Haimson and Anna Lauren Hoffmann. 2016. Constructing and enforcing" authentic" identity online: Facebook, real names, and non-normative identities. First Monday, Vol. 21, 6 (2016).Google ScholarCross Ref
Oliver L Haimson, Kathryn E Ringland, and Gillian R Hayes. 2015b. Marginalized populations and research ethics online. In CSCW Workshop on Ethics for Studying Sociotechnical Systems in a Big Data World (CSCW Workshop on Ethics for Studying Sociotechnical Systems in a Big Data World), Vol. 5.Google Scholar
Max Halupka. 2014. Clicktivism: A systematic heuristic. Policy & Internet, Vol. 6, 2 (2014), 115--132.Google ScholarCross Ref
Foad Hamidi, Morgan Klaus Scheuerman, and Stacy M Branham. 2018. Gender recognition or gender reductionism?: The social implications of embedded gender recognition systems. In Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems. ACM, 8.Google ScholarDigital Library
Donna J Haraway. 2013. When species meet. Vol. 3. U of Minnesota Press.Google Scholar
Libby Hemphill and Andrew J Roback. 2014. Tweet acts: how constituents lobby congress via Twitter. In Proceedings of the 17th ACM conference on Computer supported cooperative work & social computing. ACM, 1200--1210.Google ScholarDigital Library
Dorothy Howard and Lilly Irani. 2019. Ways of Knowing When Research Subjects Care. In Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems. ACM, 97.Google ScholarDigital Library
Lilly C. Irani and M. Six Silberman. 2013. Turkopticon: Interrupting worker invisibility in amazon mechanical turk. In Proceedings of the SIGCHI conference on human factors in computing systems. ACM, 611--620.Google Scholar
Grace YoungJoo Jeon, Nicole B Ellison, Bernie Hogan, and Christine Greenhow. 2016. First-generation students and college: The role of Facebook networks as information sources. In Proceedings of the 19th ACM Conference on Computer-Supported Cooperative Work & Social Computing. ACM, 887--899.Google Scholar
Shagun Jhaver, Darren Scott Appling, Eric Gilbert, and Amy Bruckman. 2019 a. “Did You Suspect the Post Would be Removed?”: Understanding User Reactions to Content Removals on Reddit. ACM Trans. Comput.-Hum. Interact., Vol. 3, CSCW (Nov. 2019), 33. https://doi.org/10.1145/3359294Google ScholarDigital Library
Shagun Jhaver, Iris Birman, Eric Gilbert, and Amy Bruckman. 2019 b. Human-Machine Collaboration for Content Regulation: The Case of Reddit Automoderator. ACM Trans. Comput.-Hum. Interact., Vol. 26, 5 (July 2019), 31:1--31:35. https://doi.org/10.1145/3338243Google ScholarDigital Library
Shagun Jhaver, Amy Bruckman, and Eric Gilbert. 2019 c. Does Transparency in Moderation Really Matter?: User Behavior After Content Removal Explanations on Reddit. ACM Trans. Comput.-Hum. Interact., Vol. 3, CSCW (Nov. 2019), 27. https://doi.org/10.1145/3359252Google ScholarDigital Library
Shagun Jhaver, Sucheta Ghoshal, Amy Bruckman, and Eric Gilbert. 2018. Online Harassment and Content Moderation: The Case of Blocklists. ACM Trans. Comput.-Hum. Interact., Vol. 2, CSCW (March 2018), 12:1--12:33. https://doi.org/10.1145/3185593Google ScholarDigital Library
Jialun “Aaron” Jiang, Charles Kiene, Skyler Middler, Jed R. Brubaker, and Casey Fiesler. 2019. Moderation Challenges in Voice-based Online Communities on Discord. Proc. ACM Hum.-Comput. Interact., Vol. 3, CSCW (Nov. 2019), 23.Google Scholar
Adrienne S Juarascio, Amber Shoaib, and C Alix Timko. 2010. Pro-eating disorder communities on social networking sites: a content analysis. Eating disorders, Vol. 18, 5 (2010), 393--407.Google Scholar
Anna Keski-Rahkonen and Federica Tozzi. 2005. The process of recovery in eating disorder sufferers' own words: An Internet-based study. International Journal of Eating Disorders, Vol. 37, S1 (2005), S80--S86.Google ScholarCross Ref
Charles Kiene, Jialun “Aaron” Jiang, and Benjamin Mako Hill. 2019. Technological Frames and User Innovation: Exploring Technological Change in Community Moderation Teams. Proceedings of the ACM on Human-Computer Interaction, Vol. 3, CSCW (Nov. 2019), 23.Google Scholar
Arthur Kleinman. 1989. The Illness Narratives: Suffering, Healing, And The Human Condition reprint edition ed.). Basic Books, New York.Google Scholar
Priya Kumar and Sarita Schoenebeck. 2015. The modern day baby book: Enacting good mothering and stewarding privacy on Facebook. In Proceedings of the 18th ACM Conference on Computer Supported Cooperative Work & Social Computing. ACM, 1302--1312.Google ScholarDigital Library
Lakesha Lafayett. 2017. The Problematic Whitewashing of Eating Disorder Recovery. https://www.nationaleatingdisorders.org/blog/problematic-whitewashing-eating-disorder-recoveryGoogle Scholar
Cliff Lampe and Paul Resnick. 2004. Slash(Dot) and Burn: Distributed Moderation in a Large Online Conversation Space. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI '04). ACM, New York, NY, USA, 543--550. https://doi.org/10.1145/985692.985761 event-place: Vienna, Austria.Google ScholarDigital Library
Cliff A.C. Lampe, Erik Johnston, and Paul Resnick. 2007. Follow the Reader: Filtering Comments on Slashdot. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI '07). ACM, New York, NY, USA, 1253--1262. https://doi.org/10.1145/1240624.1240815 event-place: San Jose, California, USA.Google ScholarDigital Library
landoflobsters. 2019. Changes to Our Policy Against Bullying and Harassment. Reddit (30 September 2019). https://www.reddit.com/r/announcements/comments/dbf9nj/changes_to_our_policy_against_bullying_and/Google Scholar
Yu-Hao Lee and Gary Hsieh. 2013. Does slacktivism hurt activism?: the effects of moral balancing and consistency in online activism. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems. ACM, 811--820.Google ScholarDigital Library
Brenda A LeFrancc ois, Robert Menzies, and Geoffrey Reaume. 2013. Mad matters: A critical reader in Canadian mad studies .Canadian Scholars' Press.Google Scholar
A Lenhart, M Ybarra, K Zickuhr, and M Price-Feeney. 2016. Online Harassment, Digital Abuse, and Cyberstalking in America. Data & Society Research Institute. Center for Innovative Public Health Research. Retrieved from: https://datasociety. net/pubs/oh/Online_Harassment_2016. pdf (2016).Google Scholar
Philip LeVine and Ron Scollon. 2004. Multimodal Discourse Analysis as the Confluence of Discourse and Technology. In Discourse and technology: Multimodal discourse analysis, Philip LeVine and Ron Scollon (Eds.). Georgetown University Press, 1--6.Google Scholar
Stephen P Lewis and Alexis E Arbuthnott. 2012. Searching for thinspiration: the nature of internet searches for pro-eating disorder websites. Cyberpsychology, Behavior, and Social Networking, Vol. 15, 4 (2012), 200--204.Google ScholarCross Ref
Ian Li, Anind Dey, and Jodi Forlizzi. 2010. A stage-based model of personal informatics systems. In Proceedings of the SIGCHI conference on human factors in computing systems. 557--566.Google ScholarDigital Library
Jessa Lingel. 2019. The gentrification of the internet. http://culturedigitally.org/2019/03/the-gentrification-of-the-internet/Google Scholar
Deanna Linville, Tiffany Brown, Katrina Sturm, and Tori McDougal. 2012. Eating disorders and social support: perspectives of recovered individuals. Eating Disorders, Vol. 20, 3 (2012), 216--231.Google ScholarCross Ref
Fannie Liu, Denae Ford, Chris Parnin, and Laura Dabbish. 2017. Selfies as social movements: Influences on participation and perceived impact on stereotypes. Proceedings of the ACM on Human-Computer Interaction, Vol. 1, CSCW (2017), 72.Google ScholarDigital Library
James D. Livingston and Jennifer E. Boyd. 2010. Correlates and consequences of internalized stigma for people living with mental illness: A systematic review and meta-analysis. Social Science & Medicine, Vol. 71, 12 (Dec. 2010), 2150--2161. https://doi.org/10.1016/j.socscimed.2010.09.030Google ScholarCross Ref
Helen Malson. 1999. Womæn under erasure: Anorexic bodies in postmodern context. Journal of community & applied social psychology, Vol. 9, 2 (1999), 137--153.Google ScholarCross Ref
Ben Marder, Adam Joinson, Avi Shankar, and David Houghton. 2016. The extended `chilling' effect of Facebook: The cold reality of ubiquitous social networking. Computers in Human Behavior, Vol. 60 (2016), 582--592.Google ScholarDigital Library
Aiden McGillicuddy, Jean-Gregoire Bernard, and Jocelyn Cranefield. 2016. Controlling Bad Behavior in Online Communities: An Examination of Moderation Work. ICIS 2016 Proceedings (Dec. 2016). https://aisel.aisnet.org/icis2016/SocialMedia/Presentations/23Google Scholar
Bharat Mehra, Cecelia Merkel, and Ann Peterson Bishop. 2004. The internet for empowerment of minority and marginalized users. New media & society, Vol. 6, 6 (2004), 781--802.Google Scholar
Kaitlynn Mendes, Jessica Ringrose, and Jessalynn Keller. 2018. #MeToo and the promise and pitfalls of challenging rape culture through digital feminist activism. European Journal of Women's Studies, Vol. 25, 2 (May 2018), 236--246. https://doi.org/10.1177/1350506818765318Google ScholarCross Ref
Annemarie Mol. 2002. The body multiple: Ontology in medical practice .Duke University Press.Google Scholar
Dhiraj Murthy. 2008. Digital ethnography: An examination of the use of new technologies for social research. Sociology, Vol. 42, 5 (2008), 837--855.Google ScholarCross Ref
Dhiraj Murthy. 2011. Emergent digital ethnographic methods for social research. Handbook of emergent technologies in social research (2011), 158--179.Google Scholar
Sarah Myers West. 2018. Censored, suspended, shadowbanned: User interpretations of content moderation on social media platforms. New Media & Society, Vol. 20, 11 (Nov. 2018), 4366--4383. https://doi.org/10.1177/1461444818773059Google Scholar
Jung Sun Oh, Daqing He, Wei Jeng, Eleanor Mattern, and Leanne Bowler. 2013. Linguistic characteristics of eating disorder questions on Yahoo! Answers-content, style, and emotion. In Proceedings of the 76th ASIS&T Annual Meeting: Beyond the Cloud: Rethinking Information Boundaries. American Society for Information Science, 87.Google ScholarCross Ref
Kathleen O'Leary, Arpita Bhattacharya, Sean A Munson, Jacob O Wobbrock, and Wanda Pratt. 2017. Design opportunities for mental health peer support technologies. In Proceedings of the 2017 ACM Conference on Computer Supported Cooperative Work and Social Computing. ACM, 1470--1484.Google ScholarDigital Library
Alexandra Olteanu, Sarah Vieweg, and Carlos Castillo. 2015. What to expect when the unexpected happens: Social media communications across crises. In Proceedings of the 18th ACM conference on computer supported cooperative work & social computing. ACM, 994--1009.Google ScholarDigital Library
Onlinecensorship.org. 2019. Offline-Online. https://onlinecensorship.org/content/infographics Retrieved September 20, 2019.Google Scholar
John E Pachankis. 2007. The psychological implications of concealing a stigma: A cognitive-affective-behavioral model. Psychological bulletin, Vol. 133, 2 (2007), 328.Google Scholar
Jessica A. Pater, Oliver L. Haimson, Nazanin Andalibi, and Elizabeth D. Mynatt. 2016a. “Hunger Hurts but Starving Works”: Characterizing the Presentation of Eating Disorders Online. In Proceedings of the 19th ACM Conference on Computer-Supported Cooperative Work & Social Computing (CSCW '16). ACM, New York, NY, USA, 1185--1200. https://doi.org/10.1145/2818048.2820030Google ScholarDigital Library
Jessica A. Pater, Moon K. Kim, Elizabeth D. Mynatt, and Casey Fiesler. 2016b. Characterizations of Online Harassment: Comparing Policies Across Social Media Platforms. In Proceedings of the 19th International Conference on Supporting Group Work (GROUP '16). ACM, New York, NY, USA, 369--374. https://doi.org/10.1145/2957276.2957297 event-place: Sanibel Island, Florida, USA.Google ScholarDigital Library
Jessica A. Pater, Lauren E. Reining, Andrew D. Miller, Tammy Toscos, and Elizabeth D. Mynatt. 2019. "Notjustgirls": Exploring Male-related Eating Disordered Content Across Social Media Platforms. In Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems (CHI '19). ACM, New York, NY, USA, 651:1--651:13. https://doi.org/10.1145/3290605.3300881 event-place: Glasgow, Scotland Uk.Google ScholarDigital Library
Jon Penney. 2017. Internet surveillance, regulation, and chilling effects online: A comparative case study. Internet Policy Review (2017).Google Scholar
Shruti Phadke, Jonathan Lloyd, James Hawdon, Mattia Samory, and Tanushree Mitra. 2018. Framing Hate with Hate Frames: Designing the Codebook. In Companion of the 2018 ACM Conference on Computer Supported Cooperative Work and Social Computing. ACM, 201--204.Google ScholarDigital Library
Sarah Pink, Heather A. Horst, John Postill, Larissa Hjorth, Tania Lewis, and Jo Tacchi. 2016. Digital ethnography: Principles and Practice .SAGE.Google Scholar
Radha Iyengar Plumb. 2019. An Independent Report on How We Measure Content Moderation. Facebook Newsroom (23 May 2019). https://newsroom.fb.com/news/2019/05/dtag-report/Google Scholar
Rebecca Puhl and Young Suh. 2015. Stigma and eating and weight disorders. Current psychiatry reports, Vol. 17, 3 (2015), 10.Google Scholar
Bryce J Renninger. 2015. “Where I can be myself... where I can speak my mind”: Networked counterpublics in a polymedia environment. New Media & Society, Vol. 17, 9 (2015), 1513--1529.Google ScholarCross Ref
Sarah Roberts. 2016. Digital Refuse: Canadian Garbage, Commercial Content Moderation and the Global Circulation of Social Media's Waste. Wi: Journal of Mobile Media (Jan. 2016). https://ir.lib.uwo.ca/commpub/14Google Scholar
Sarah T Roberts. 2019. Behind the Screen: Content Moderation in the Shadows of Social Media .Yale University Press.Google Scholar
James P Roehrig and Carmen P McLean. 2010. A comparison of stigma toward eating disorders versus depression. International Journal of Eating Disorders, Vol. 43, 7 (2010), 671--674.Google ScholarCross Ref
Nicolas Rüsch, Matthias C. Angermeyer, and Patrick W. Corrigan. 2005. Mental illness stigma: Concepts, consequences, and initiatives to reduce stigma. European Psychiatry, Vol. 20, 8 (Dec. 2005), 529--539. https://doi.org/10.1016/j.eurpsy.2005.04.004Google ScholarCross Ref
Shruti Sannon, Elizabeth L. Murnane, Natalya N. Bazarova, and Geri Gay. 2019. "I Was Really, Really Nervous Posting It": Communicating About Invisible Chronic Illnesses Across Social Media Platforms. In Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems (CHI '19). ACM, New York, NY, USA, 353:1--353:13. https://doi.org/10.1145/3290605.3300583 event-place: Glasgow, Scotland Uk.Google ScholarDigital Library
Morgan Klaus Scheuerman, Stacy M. Branham, and Foad Hamidi. 2018. Safe Spaces and Safe Places: Unpacking Technology-Mediated Experiences of Safety and Harm with Transgender People. Proc. ACM Hum.-Comput. Interact., Vol. 2, CSCW (Nov. 2018), 155:1--155:27. https://doi.org/10.1145/3274424Google ScholarDigital Library
Lynne Schrum. 1995. Framing the debate: Ethical research in the information age. Qualitative Inquiry, Vol. 1, 3 (1995), 311--326.Google ScholarCross Ref
Andrew Scull. 2015. Madness in Civilization: A Cultural History of Insanity, from the Bible to Freud, from the Madhouse to Modern Medicine .Princeton University Press. 432 pages.Google Scholar
Joseph Seering, Robert Kraut, and Laura Dabbish. 2017. Shaping Pro and Anti-Social Behavior on Twitch Through Moderation and Example-Setting. In Proceedings of the 2017 ACM Conference on Computer Supported Cooperative Work and Social Computing (CSCW '17). ACM, New York, NY, USA, 111--125. https://doi.org/10.1145/2998181.2998277 event-place: Portland, Oregon, USA.Google ScholarDigital Library
Joseph Seering, Tony Wang, Jina Yoon, and Geoff Kaufman. 2019. Moderator engagement and community development in the age of algorithms. New Media & Society, Vol. 21, 7 (July 2019), 1417--1443. https://doi.org/10.1177/1461444818821316Google ScholarCross Ref
Leslie Regan Shade. 2003. Weborexics: The ethical issues surrounding pro-ana websites. (2003).Google Scholar
Heather Anne Swanson. 2018. Landscapes, by comparison. In The World Multiple: The Quotidian Politics of Knowing and Generating Entangled Worlds,, Kei'ichi Omura, Grant Otsuki, Shiho Satsuka, and Atsuro Morita (Eds.). Routledge, Chapter 7.Google Scholar
Marika Tiggemann and Mia Zaccardo. 2018. `Strong is the new skinny': A content analysis of #fitspiration images on Instagram. Journal of health psychology, Vol. 23, 8 (2018), 1003--1011.Google ScholarCross Ref
Walter Vandereycken and Ina Van Humbeeck. 2008. Denial and concealment of eating disorders: a retrospective survey. European Eating Disorders Review, Vol. 16, 2 (2008), 109--114. https://doi.org/10.1002/erv.857Google ScholarCross Ref
Aditya Vashistha, Abhinav Garg, Richard Anderson, and Agha Ali Raza. 2019. Threats, Abuses, Flirting, and Blackmail: Gender Inequity in Social Media Voice Forums. In Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems. ACM, 72.Google ScholarDigital Library
Jessica Vitak, Kalyani Chadha, Linda Steiner, and Zahra Ashktorab. 2017. Identifying Women's Experiences With and Strategies for Mitigating Negative Effects of Online Harassment. In Proceedings of the 2017 ACM Conference on Computer Supported Cooperative Work and Social Computing. ACM, 1231--1245.Google ScholarDigital Library
Tao Wang, Markus Brede, Antonella Ianni, and Emmanouil Mentzakis. 2017. Detecting and characterizing eating-disorder communities on social media. In Proceedings of the Tenth ACM International Conference on Web Search and Data Mining. ACM, 91--100.Google ScholarDigital Library
Donghee Yvette Wohn. 2019. Volunteer Moderators in Twitch Micro Communities: How They Get Involved, the Roles They Play, and the Emotional Labor They Experience. In Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems. ACM, 160.Google ScholarDigital Library
David Wood. 2003. Foucault and panopticism revisited. Surveillance & Society, Vol. 1, 3 (2003), 234--239.Google ScholarCross Ref
Diyi Yang, Zheng Yao, Joseph Seering, and Robert Kraut. 2019. The Channel Matters: Self-disclosure, Reciprocity and Social Support in Online Cancer Support Groups. In Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems (CHI '19). ACM, New York, NY, USA, 31:1--31:15. https://doi.org/10.1145/3290605.3300261 event-place: Glasgow, Scotland Uk.Google ScholarDigital Library

Index Terms

Conformity of Eating Disorders through Content Moderation
1. Human-centered computing
  1. Collaborative and social computing
    1. Empirical studies in collaborative and social computing
  2. Human computer interaction (HCI)
    1. Empirical studies in HCI

Recommendations

Disproportionate Removals and Differing Content Moderation Experiences for Conservative, Transgender, and Black Social Media Users: Marginalization and Moderation Gray Areas
CSCW2

Social media sites use content moderation to attempt to cultivate safe spaces with accurate information for their users. However, content moderation decisions may not be applied equally for all types of users, and may lead to disproportionate censorship ...
Read More
"Do You Ladies Relate?": Experiences of Gender Diverse People in Online Eating Disorder Communities
CSCW

The study of eating disorders online has a long tradition within CSCW and HCI scholarship. Research within this body of work highlights the types of content people with eating disorders post as well as the ways in which individuals use online spaces for ...
Read More
A Trade-off-centered Framework of Content Moderation
Content moderation research typically prioritizes representing and addressing challenges for one group of stakeholders or communities in one type of context. While taking a focused approach is reasonable or even favorable for empirical case studies, it ...
Read More

Comments

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Article

Published in
Proceedings of the ACM on Human-Computer Interaction Volume 4, Issue CSCW1
CSCW
May 2020
1285 pages
EISSN:2573-0142
DOI:10.1145/3403424
Editors:
Cliff Lampe
University of Michigan
,
Jeff Nichols
Google
,
Karrie Karahalios
University of Illinois Urbana-Champaign
,
Geraldine Fitzpatrick
Vienna University of Technology
,
Uichin Lee
KAIST
,
Andres Monroy-Hernandez
Microsoft Research
,
Wolfgang Stuerzlinger
Simon Fraser University, Canada
Issue’s Table of Contents
Copyright © 2020 ACM
Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than the author(s) must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected].
Sponsors
In-Cooperation
Publisher
Association for Computing Machinery
New York, NY, United States
Publication History
- Published: 29 May 2020
Published in pacmhci Volume 4, Issue CSCW1

Permissions
Request permissions about this article.
Request Permissions

Check for updates
Author Tags
conformity
content moderation
digital ethnography
eating disorders
mental illness
multiplicity
online communities
social media
Qualifiers
- research-article
Conference
Funding Sources
Other Metrics
View Article Metrics

Article Metrics
- 46
  Total Citations
  View Citations
- 1,206
  Total Downloads
- Downloads (Last 12 months)283
- Downloads (Last 6 weeks)25
Other Metrics
View Author Metrics
Cited By
View all

PDF Format

View or Download as a PDF file.

PDF

eReader

View online with eReader.

eReader

Conformity of Eating Disorders through Content Moderation

Proceedings of the ACM on Human-Computer Interaction

Abstract

References

Cited By

Index Terms

Recommendations

Disproportionate Removals and Differing Content Moderation Experiences for Conservative, Transgender, and Black Social Media Users: Marginalization and Moderation Gray Areas

"Do You Ladies Relate?": Experiences of Gender Diverse People in Online Eating Disorder Communities

A Trade-off-centered Framework of Content Moderation