skip to main content
10.1145/1979742.1979618acmconferencesArticle/Chapter ViewAbstractPublication PageschiConference Proceedingsconference-collections
abstract

The trouble with social computing systems research

Published:07 May 2011Publication History

ABSTRACT

Social computing has led to an explosion of research in understanding users, and it has the potential to similarly revolutionize systems research. However, the number of papers designing and building new sociotechnical systems has not kept pace. We analyze challenges facing social computing systems research, ranging from misaligned methodological incentives, evaluation expectations, double standards, and relevance compared to industry. We suggest improvements for the community to consider so that we can chart the future of our field.

References

  1. Ackerman, M. 1994. Augmenting the Organizational Memory: A Field Study of Answer Garden. In Proc. CSCW '94. Google ScholarGoogle ScholarDigital LibraryDigital Library
  2. Ackerman, M.S. 2000. The Intellectual Challenge of CSCW: The Gap Between Social Requirements and Technical Feasibility. Human-Computer Interaction 15(2). Google ScholarGoogle ScholarDigital LibraryDigital Library
  3. Barkhuus, L., and Rode, J.A. 2007. From Mice to Men -- 24 years of evaluation in CHI. In Proc. alt.chi '07. Google ScholarGoogle ScholarDigital LibraryDigital Library
  4. Beenen, G., Ling, K., Wang, X., et al. 2004. Using social psychology to motivate contributions to online communities. In Proc. CSCW '04. Google ScholarGoogle ScholarDigital LibraryDigital Library
  5. Bernstein, M.S., Little, G., Miller, R.C., et al. Soylent: A Word Processor with a Crowd Inside. In Proc. UIST '10. Google ScholarGoogle ScholarDigital LibraryDigital Library
  6. Bernstein, M.S., Suh, B., Hong, L., Chen, J., Kairam, S., and Chi, E.H. 2010. Eddi: Interactive topic-based browsing of social streams. In Proc. UIST 2010. Google ScholarGoogle ScholarDigital LibraryDigital Library
  7. Bernstein, M.S., Tan, D., Smith, G., et al. 2010. Personalization via Friendsourcing. TOCHI 17(2). Google ScholarGoogle ScholarDigital LibraryDigital Library
  8. Brooks, F. 1996. The computer scientist as toolsmith II. Communications of the ACM 39(3). Google ScholarGoogle ScholarDigital LibraryDigital Library
  9. Brooks, F. 2010. The Design of Design. Addison Wesley: Upper Saddle River, NJ.Google ScholarGoogle Scholar
  10. Chi, E.H. 2009. A position paper on 'Living Laboratories': rethinking ecological designs and experimentation in human-computer interaction. HCI International 2009. Google ScholarGoogle ScholarDigital LibraryDigital Library
  11. Christensen, C.M. 1997. The Innovator's Dilemma. Harvard Business Press.Google ScholarGoogle Scholar
  12. DiMicco, J., Millen, D.R., Geyer, W., et al. 2008. Motivations for social networking at work. In Proc. CSCW 2008. Google ScholarGoogle ScholarDigital LibraryDigital Library
  13. Erickson, T., and Kellogg, W. 2000. Social Translucence: An approach to designing systems that support social processes. TOCHI 7(1). Google ScholarGoogle ScholarDigital LibraryDigital Library
  14. Greenberg, S., and Buxton, B. 2008. Evaluation considered harmful (some of the time). In Proc. CHI '08. Google ScholarGoogle ScholarDigital LibraryDigital Library
  15. Grudin, J. 1989. Why groupware applications fail: problems in design and evaluation. Office: Technology and People 4(3): 187--211.Google ScholarGoogle Scholar
  16. Hoffmann, R., Amershi, S., Patel, K., et al. 2009. Amplifying community content creation with mixed initiative information extraction. In Proc. CHI '09. Google ScholarGoogle ScholarDigital LibraryDigital Library
  17. Ishii, H., and Kobayashi, M. 1992. ClearBoard: a seamless medium for shared drawing and conversation with eye contact. In Proc. CHI '92. Google ScholarGoogle ScholarDigital LibraryDigital Library
  18. Kaye, J., and Sengers, P. 2007. The evolution of evaluation. In Proc. alt.chi 2007. Google ScholarGoogle ScholarDigital LibraryDigital Library
  19. Kriplean, T., Toomim, M., Morgan, J., et al. 2011. REFLECT: Supporting Active Listening and Grounding on the Web through Restatement. In Proc. CSCW '11 Horizon.Google ScholarGoogle Scholar
  20. Lampe, C. 2010. The machine in the ghost: a socio-technical approach to user-generated content research. WikiSym keynote. http://www.slideshare.net/clifflampe/the-machine-in-the-ghost-a-sociotechnical-perspectiveGoogle ScholarGoogle Scholar
  21. Landauer, T. 1995. The Trouble with Computers: usefulness, usability and productivity. MIT Press, Cambridge. Google ScholarGoogle ScholarDigital LibraryDigital Library
  22. Landay, J.A. 2009. I give up on CHI/UIST. Blog. http://dubfuture.blogspot.com/2009/11/i-give-up-on-chiuist.html.Google ScholarGoogle Scholar
  23. Lieberman, H. 2003. Tyranny of Evaluation. CHI Fringe.Google ScholarGoogle Scholar
  24. Little, G., Chilton, L., Goldman, M., and Miller, R.C. TurKit: Human Computation Algorithms on Mechanical Turk. UIST '10. Google ScholarGoogle ScholarDigital LibraryDigital Library
  25. Markus, L., 1987. Towards a "critical mass" theory of interactive media: Universal access, interdependence, and diffusion. Communication Research 14: 491--511.Google ScholarGoogle ScholarCross RefCross Ref
  26. Morris, M. Personal communication. December 22, 2010.Google ScholarGoogle Scholar
  27. Olsen Jr., D. 2007. Evaluating User Interface Systems Research. In Proc. UIST '07. Google ScholarGoogle ScholarDigital LibraryDigital Library
  28. Resnick, M., Maloney, J., Monroy-Hernández, A., et al. 2009. Scratch: programming for all. Commun. ACM 52(11). Google ScholarGoogle ScholarDigital LibraryDigital Library
  29. Rittel, H.W.J. and Webber, M.M. 1973. Dilemmas in a general theory of planning. Policy Sciences 4:2, pp. 155--169.Google ScholarGoogle ScholarCross RefCross Ref
  30. Roseman, M., and Greenberg, S. 1996. Building real-time groupware with GroupKit, a groupware toolkit. TOCHI 3(1). Google ScholarGoogle ScholarDigital LibraryDigital Library
  31. Ross, L., and Nisbett, R. 1991. The person and the situation. Temple University Press.Google ScholarGoogle Scholar
  32. Shamma, D., Kennedy, L., and Churchill, E. Tweetgeist: Can the twitter timeline reveal the structure of broadcast events? In CSCW 2010 Horizon.Google ScholarGoogle Scholar
  33. Suh, B., Chi, E.H., Kittur, A., and Pendleton, B.A. 2008. Lifting the veil: improving accountability and social transparency in Wikipedia with WikiDashboard. Proc. CHI '08. Google ScholarGoogle ScholarDigital LibraryDigital Library
  34. Viegas, F., Wattenberg, M., van Ham, F., et al. 2007. ManyEyes: a Site for Visualization at Internet Scale. IEEE Trans. Viz. and Comp. Graph. Nov/Dec 2007: 1121--1128. Google ScholarGoogle ScholarDigital LibraryDigital Library
  35. Zhai, S. 2003. Evaluation is the worst form of HCI research except all those other forms that have been tried. Essay published at CHI Place.Google ScholarGoogle Scholar

Index Terms

  1. The trouble with social computing systems research

    Recommendations

    Comments

    Login options

    Check if you have access through your login credentials or your institution to get full access on this article.

    Sign in
    • Published in

      cover image ACM Conferences
      CHI EA '11: CHI '11 Extended Abstracts on Human Factors in Computing Systems
      May 2011
      2554 pages
      ISBN:9781450302685
      DOI:10.1145/1979742

      Copyright © 2011 Authors

      Publisher

      Association for Computing Machinery

      New York, NY, United States

      Publication History

      • Published: 7 May 2011

      Permissions

      Request permissions about this article.

      Request Permissions

      Check for updates

      Qualifiers

      • abstract

      Acceptance Rates

      Overall Acceptance Rate6,164of23,696submissions,26%

    PDF Format

    View or Download as a PDF file.

    PDF

    eReader

    View online with eReader.

    eReader