skip to main content
10.1145/2858036.2858464acmconferencesArticle/Chapter ViewAbstractPublication PageschiConference Proceedingsconference-collections
research-article

The Proficiency-Congruency Dilemma: Virtual Team Design and Performance in Multiplayer Online Games

Authors Info & Claims
Published:07 May 2016Publication History

ABSTRACT

Multiplayer online battle arena games provide an excellent opportunity to study team performance. When designing a team, players must negotiate a proficiency-congruency dilemma between selecting roles that best match their experience and roles that best complement the existing roles on the team. We adopt a mixed-methods approach to explore how players negotiate this dilemma. Using data from League of Legends, we define a similarity space to operationalize team design constructs about role proficiency, generality, and congruency. We collect publicly available data from 3.36 million players to test the influence of these constructs on team performance. We also conduct focus groups with novice and elite players to understand how players' team design practices vary with expertise. We find that the two factors, player proficiency and team congruency, both increase team performance, with the former having a stronger impact. We also find that elite players are better at balancing the two factors than the novice players. These findings have implications for players, designers, and theorists about how to recommend team designs that jointly prioritize individuals' expertise and teams' compatibility.

References

  1. Albert Bandura. 1977. Self-efficacy: Toward a unifying theory of behavioral change. Psychological Review 84, 2 (1977), 191-215. DOI: http://dx.doi.org/10.1037/0033295X.84.2.191Google ScholarGoogle ScholarCross RefCross Ref
  2. Shaowen Bardzell, Jeffrey Bardzell, Tyler Pace, and Kayce Reed. 2008. Blissfully Productive: Grouping and Cooperation in World of Warcraft Instance Runs. In Proceedings of the 2008 ACM Conference on Computer Supported Cooperative Work (CSCW '08). ACM, NY, NY, USA, 357-360. DOI: http://dx.doi.org/10.1145/1460563.1460621 Google ScholarGoogle ScholarDigital LibraryDigital Library
  3. Beth A. Bechky. 2006. Gaffers, Gofers, and Grips: Role-Based Coordination in Temporary Organizations. Organization Science 17, 1 (2006), 3-21. DOI: http://dx.doi.org/10.1287/orsc.1050.0149 Google ScholarGoogle ScholarDigital LibraryDigital Library
  4. Jeremy Blackburn and Haewoon Kwak. 2014. STFU NOOB!: Predicting Crowdsourced Decisions on Toxic Behavior in Online Games. In Proceedings of the 23rd International Conference on World Wide Web (WWW '14). ACM, NY, NY, USA, 877-888. DOI: http://dx.doi.org/10.1145/2566486.2567987 Google ScholarGoogle ScholarDigital LibraryDigital Library
  5. Bret H. Bradley, John E. Baur, Christopher G. Banford, and Bennett E. Postlethwaite. 2013. Team Players and Collective Performance How Agreeableness Affects Team Performance Over Time. Small Group Research 44, 6 (2013), 680-711. DOI: http://dx.doi.org/10.1177/1046496413507609Google ScholarGoogle ScholarCross RefCross Ref
  6. J. Stuart Bunderson and Kathleen M. Sutcliffe. 2002. Comparing Alternative Conceptualizations of Functional Diversity in Management Teams: Process and Performance Effects. Academy of Management Journal 45, 5 (2002), 875-893. DOI: http://dx.doi.org/10.2307/3069319Google ScholarGoogle Scholar
  7. Janis A. Cannon-Bowers, SI Tannenbaum, Eduardo Salas, and C.E. Volpe. Defining team competencies and establishing team training requirements. In Team Effectiveness and Decision Making in Organizations.Google ScholarGoogle Scholar
  8. Susan G Cohen and Diane E Bailey. 1997. What makes teams work: Group effectiveness research from the shop floor to the executive suite. Journal of management 23, 3 (1997), 239-290.Google ScholarGoogle ScholarCross RefCross Ref
  9. David V. Day, Sandy Gordon, and Corinna Fink. 2012. The Sporting Life: Exploring Organizations through the Lens of Sport. The Academy of Management Annals 6, 1 (2012), 397-433. DOI: http://dx.doi.org/10.1080/19416520.2012.678697Google ScholarGoogle ScholarCross RefCross Ref
  10. Rajeev H. Dehejia and Sadek Wahba. 2002. Propensity Score-Matching Methods for Nonexperimental Causal Studies. Review of Economics and Statistics 84, 1 (2002), 151-161. DOI: http://dx.doi.org/10. 1162/003465302317331982Google ScholarGoogle ScholarCross RefCross Ref
  11. D. Scott DeRue and John R. Hollenbeck. 2007. The search for internal and external fit in teams. In Perspectives on organizational fit, Cheri Ostroff and Timothy A. Judge (Eds.). 259-285.Google ScholarGoogle Scholar
  12. Richard P. DeShon, Steve W. J. Kozlowski, Aaron M. Schmidt, Karen R. Milner, and Darin Wiechmann. 2004. A Multiple-Goal, Multilevel Model of Feedback Effects on the Regulation of Individual and Team Performance. Journal of Applied Psychology 89, 6 (2004), 1035-1056. DOI: http://dx.doi.org/10.1037/00219010.89.6.1035Google ScholarGoogle ScholarCross RefCross Ref
  13. Scott Donaldson. 2015. Mechanics and Metagame: Exploring Binary Expertise in League of Legends. Games and Culture (June 2015), 1555412015590063. DOI: http://dx.doi.org/10.1177/1555412015590063Google ScholarGoogle Scholar
  14. A. Drachen, M. Yancey, J. Maguire, D. Chu, I.Y. Wang, T. Mahlmann, M. Schubert, and D. Klabajan. 2014. Skill-based differences in spatio-temporal team behaviour in defence of the Ancients 2 (DotA 2). In Proceedings of Games Media Entertainment (GEM '14). 1-8. DOI: http://dx.doi.org/10.1109/GEM.2014.7048109Google ScholarGoogle Scholar
  15. Jeffrey R. Edwards. 2008. Person Environment Fit in Organizations: An Assessment of Theoretical Progress. The Academy of Management Annals 2, 1 (2008), 167-230. DOI: http://dx.doi.org/10.1080/19416520802211503Google ScholarGoogle ScholarCross RefCross Ref
  16. Christoph Eggert, Marc Herrlich, Jan Smeddinck, and Rainer Malaka. 2015. Classification of Player Roles in the Team-Based Multi-player Game Dota 2. In Proceedings of the 2015 International Conference on Entertainment Computing (ICEC'15). Springer International Publishing, 112-125. DOI: http://dx.doi.org/10.1007/978--3--31924589--8_9Google ScholarGoogle ScholarCross RefCross Ref
  17. Magy Seif El-Nasr, Anders Drachen, and Alessandro Canossa. 2013. Game analytics: Maximizing the value of player data. Springer Science & Business Media. Google ScholarGoogle ScholarDigital LibraryDigital Library
  18. Satu Elo and Helvi Kyngäs. 2008. The qualitative content analysis process. Journal of advanced nursing 62, 1 (2008), 107-115.Google ScholarGoogle ScholarCross RefCross Ref
  19. K. A. Ericsson and A. C. Lehmann. 1996. Expert and Exceptional Performance: Evidence of Maximal Adaptation to Task Constraints. Annual Review of Psychology 47, 1 (1996), 273-305. DOI: http://dx.doi.org/10.1146/annurev.psych.47.1.273Google ScholarGoogle ScholarCross RefCross Ref
  20. James H. Frey and D. Stanley Eitzen. 1991. Sport and Society. Annual Review of Sociology 17 (1991), 503-522. DOI: http://dx.doi.org/10.1146/annurev.soc.17.1.503Google ScholarGoogle ScholarCross RefCross Ref
  21. Riot Games. 2014. League Players Reach New Heights in 2014. (2014). http://www.riotgames.com/articles/20140711/1322/leagueplayers-reach-new-heights-2014.Google ScholarGoogle Scholar
  22. Riot Games. 2015a. Game Information -- Champions. (2015). http://gameinfo.na.leagueoflegends.com/en/game-info/champions/.Google ScholarGoogle Scholar
  23. Riot Games. 2015b. Matchmaking Guide. (2015). https://support.riotgames.com/hc/enus/articles/201752954-MatchmakingGuide.Google ScholarGoogle Scholar
  24. Riot Games. 2015c. Ranked Play FAQ. (2015). https://support.riotgames.com/hc/enus/articles/204010760-Ranked-Play-FAQ.Google ScholarGoogle Scholar
  25. Riot Games. 2015d. Riot Games API. (2015). https://developer.riotgames.com/.Google ScholarGoogle Scholar
  26. Riot Games. 2015e. Riot Games Support -- Separate Servers. (2015). https://support.riotgames.com/hc/enus/articles/201751684-SeparateServers.Google ScholarGoogle Scholar
  27. Riot Games. 2015f. Static Data API -- Champions. (2015). http://ddragon.leagueoflegends.com/cdn/5.22.3/data/en_US/champion.json.Google ScholarGoogle Scholar
  28. Michele J. Gelfand, Miriam Erez, and Zeynep Aycan. 2007. Cross-Cultural Organizational Behavior. Annual Review of Psychology 58, 1 (2007), 479-514. DOI: http://dx.doi.org/10.1146/annurev. psych.58.110405.085559Google ScholarGoogle ScholarCross RefCross Ref
  29. Robert Glaser and Michelene T. H. Chi. 1988. Overview. In The Nature of Expertise, Michelene T. H. Chi, Robert Glaser, and Marshall J. Farr (Eds.). Lawrence Erlbaum, xv - xxviii.Google ScholarGoogle Scholar
  30. Paul Goodman and Samir Shah. 1992. Familiarity and Work Group Outcomes. In Group Process and Productivity, Stephen Worchel, Wendy Wood, and Jeffry Simpson (Eds.). 276-298.Google ScholarGoogle Scholar
  31. Richard A. Guzzo and Marcus W. Dickson. 1996. Teams in Organizations: Recent Research on Performance and Effectiveness. Annual Review of Psychology 47, 1 (1996), 307-338. DOI: http://dx.doi.org/10.1146/annurev.psych.47.1.307Google ScholarGoogle ScholarCross RefCross Ref
  32. Harold. 2015. Match duration analysis. (2015). http://www.leaguemath.com/matchduration-analysis/.Google ScholarGoogle Scholar
  33. David A. Harrison, Susan Mohammed, Joseph E. McGrath, Anna T. Florey, and Scott W. Vanderstoep. 2003. Time matters in team performance: Effects of member familiarity, entrainment, and task discontinuity on speed and quality. Personnel Psychology 56, 3 (2003), 633-669.Google ScholarGoogle ScholarCross RefCross Ref
  34. HawatLoL. 2013. How likely will a Pro Team win after getting first blood? (2013). https://www.reddit.com/r/leagueoflegends/comments/1bb19p/how_likely_will_a_pro_team_win_after_getting/.Google ScholarGoogle Scholar
  35. Sujin K. Horwitz and Irwin B. Horwitz. 2007. The Effects of Team Diversity on Team Outcomes: A Meta-Analytic Review of Team Demography. Journal of Management 33, 6 (2007), 987-1015. DOI: http://dx.doi.org/10.1177/0149206307308587Google ScholarGoogle ScholarCross RefCross Ref
  36. Jeff Huang, Thomas Zimmermann, Nachiappan Nagapan, Charles Harrison, and Bruce C. Phillips. 2013b. Mastering the Art of War: How Patterns of Gameplay Influence Skill in Halo. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI '13). ACM, NY, NY, USA, 695-704. DOI: http://dx.doi.org/10.1145/2470654.2470753 Google ScholarGoogle ScholarDigital LibraryDigital Library
  37. Yun Huang, Wenyue Ye, Nicholas Bennett, and Noshir Contractor. 2013a. Functional or Social?: Exploring Teams in Online Games. In Proceedings of the 2013 Conference on Computer Supported Cooperative Work (CSCW '13). ACM, NY, NY, USA, 399-408. DOI: http://dx.doi.org/10.1145/2441776.2441822 Google ScholarGoogle ScholarDigital LibraryDigital Library
  38. Robert S. Huckman and Bradley R. Staats. 2011. Fluid Tasks and Fluid Teams: The Impact of Diversity in Experience and Team Familiarity on Team Performance. Manufacturing & Service Operations Management 13, 3 (2011), 310-328. DOI: http://dx.doi.org/10.1287/msom.1100.0321 Google ScholarGoogle ScholarDigital LibraryDigital Library
  39. Robert S. Huckman, Bradley R. Staats, and David M. Upton. 2008. Team Familiarity, Role Experience, and Performance: Evidence from Indian Software Services. Management Science 55, 1 (2008), 85-100. DOI: http://dx.doi.org/10.1287/mnsc.1080.0921 Google ScholarGoogle ScholarDigital LibraryDigital Library
  40. David Huffaker, Jing Wang, J. Treem, M.A. Ahmad, L. Fullerton, D. Williams, M.S. Poole, and N. Contractor. The Social Behaviors of Experts in Massive Multiplayer Online Role-Playing Games. In IEEE International Conference on Computational Science and Engineering, Vol. 4. DOI: http://dx.doi.org/10.1109/CSE.2009.13 Google ScholarGoogle ScholarDigital LibraryDigital Library
  41. Alexandru Iosup, Ruud Van De Bovenkamp, Siqi Shen, Adele Lu Jia, and Fernando Kuipers. 2014. An Analysis of Implicit Social Networks in Multiplayer Online Games. IEEE Internet Computing 18 (2014). Issue 3.Google ScholarGoogle Scholar
  42. Daniel Johnson, Lennart E. Nacke, and Peta Wyeth. 2015. All About That Base: Differing Player Experiences in Video Game Genres and the Unique Case of MOBA Games. In Proceedings of the 33rd Annual ACM Conference on Human Factors in Computing Systems (CHI '15). ACM, NY, NY, USA, 2265-2274. DOI: http://dx.doi.org/10.1145/2702123.2702447 Google ScholarGoogle ScholarDigital LibraryDigital Library
  43. Stefanie K. Johnson, Kenneth Bettenhausen, and Ellie Gibbons. 2009. Realities of Working in Virtual Teams: Affective and Attitudinal Outcomes of Using Computer-Mediated Communication. Small Group Research 40, 6 (2009), 623-649. DOI: http://dx.doi.org/10.1177/1046496409346448Google ScholarGoogle ScholarCross RefCross Ref
  44. Brian C. Keegan, Shakked Lev, and Ofer Arazy. 2016. Analyzing Organizational Routines in Online Knowledge Collaborations: A Case for Sequence Analysis in CSCW. In Proceedings of the 2016 ACM Conference on Computer Supported Cooperative Work and Social Computing (CSCW '16). ACM, NY, NY, USA, 257-266. Google ScholarGoogle ScholarDigital LibraryDigital Library
  45. Norbert L. Kerr and R. Scott Tindale. 2004. Group Performance and Decision Making. Annual Review of Psychology 55, 1 (2004), 623-655. DOI: http://dx.doi.org/10.1146/annurev. psych.55.090902.142009Google ScholarGoogle ScholarCross RefCross Ref
  46. Richard Klimoski and Susan Mohammed. 1994. Team mental model: construct or metaphor? Journal of Management 20, 2 (1994). DOI: http://dx.doi.org/10.1016/01492063(94)90021--3Google ScholarGoogle ScholarCross RefCross Ref
  47. Peter Kollock. 1998. Social Dilemmas: The Anatomy of Cooperation. Annual Review of Sociology 24, 1 (1998), 183-214. DOI: http://dx.doi.org/10.1146/annurev.soc.24.1.183Google ScholarGoogle ScholarCross RefCross Ref
  48. Yubo Kou and Xinning Gui. 2014. Playing with Strangers: Understanding Temporary Teams in League of Legends. In Proceedings of the First ACM SIGCHI Annual Symposium on Computer-human Interaction in Play (CHI PLAY '14). ACM, NY, NY, USA, 161-169. DOI: http://dx.doi.org/10.1145/2658537.2658538 Google ScholarGoogle ScholarDigital LibraryDigital Library
  49. Steve W. J. Kozlowski and Bradford S. Bell. 2003. Work Groups and Teams in Organizations. In Handbook of Psychology. John Wiley & Sons, Inc.Google ScholarGoogle Scholar
  50. Steve W. J. Kozlowski and Daniel R. Ilgen. 2006. Enhancing the Effectiveness of Work Groups and Teams. Psychological Science in the Public Interest 7, 3 (2006), 77-124. DOI: http://dx.doi.org/10.1111/j.15291006.2006.00030.xGoogle ScholarGoogle ScholarCross RefCross Ref
  51. Amy L. Kristof. 1996. Person-Organization Fit: An Integrative Review of Its Conceptualizations, Measurement, and Implications. Personnel Psychology 49, 1 (1996), 1-49. DOI: http://dx.doi.org/10.1111/j.17446570.1996.tb01790.xGoogle ScholarGoogle ScholarCross RefCross Ref
  52. Amy L. Kristof-Brown, Ryan D. Zimmerman, and Erin C. Johnson. 2005. Consequences of Individuals' Fit at Work: A Meta-Analysis of Person-Job, Person-Organization, Person-Group, and Person-Supervisor Fit. Personnel Psychology 58, 2 (2005), 281-342. DOI: http://dx.doi.org/10.1111/j.17446570.2005.00672.xGoogle ScholarGoogle ScholarCross RefCross Ref
  53. Haewoon Kwak, Jeremy Blackburn, and Seungyeop Han. 2015. Exploring Cyberbullying and Other Toxic Behavior in Team Competition Online Games. In Proceedings of the 33rd Annual ACM Conference on Human Factors in Computing Systems (CHI '15). ACM, NY, NY, USA, 3739-3748. DOI: http://dx.doi.org/10.1145/2702123.2702529 Google ScholarGoogle ScholarDigital LibraryDigital Library
  54. Yannick LaJacq. 2014. Yes, The Blue Team Has An Advantage In League of Legends. Kotaku (2014). http://kotaku.com/yes-the-blue-teamhas-an-advantage-in-league-of-legend1578533860.Google ScholarGoogle Scholar
  55. Andrew James Latham, Lucy L. M. Patston, and Lynette J. Tippett. 2013. Just how expert are "expert" video-game players? Assessing the experience and expertise of video-game players across "action" video-game genres. Cognition 4 (2013), 941. DOI: http://dx.doi.org/10.3389/fpsyg.2013.00941Google ScholarGoogle Scholar
  56. Leaguepedia. 2013. Snowballing in Competitive Play: A look at the data. (2013). http://lol.gamepedia.com/Articles:Snowballing_in_Competitive_Play:_A_look_at_the_data.Google ScholarGoogle Scholar
  57. James G. March. 1991. Exploration and Exploitation in Organizational Learning. Organization Science 2, 1 (1991), 71-87. Google ScholarGoogle ScholarDigital LibraryDigital Library
  58. Michelle A. Marks, John E. Mathieu, and Stephen J. Zaccaro. 2001. A Temporally Based Framework and Taxonomy of Team Processes. The Academy of Management Review 26, 3 (2001), 356-376. DOI: http://dx.doi.org/10.2307/259182Google ScholarGoogle ScholarCross RefCross Ref
  59. Winter Mason and Aaron Clauset. 2013. Friends FTW! Friendship and Competition in Halo: Reach. In Proceedings of the 2013 Conference on Computer Supported Cooperative Work (CSCW '13). ACM, NY, NY, USA, 375-386. DOI: http://dx.doi.org/10.1145/2441776.2441820 Google ScholarGoogle ScholarDigital LibraryDigital Library
  60. John Mathieu, M. Travis Maynard, Tammy Rapp, and Lucy Gilson. 2008. Team Effectiveness 1997--2007: A Review of Recent Advancements and a Glimpse Into the Future. Journal of Management 34, 3 (2008), 410-476. DOI: http://dx.doi.org/10.1177/0149206308316061Google ScholarGoogle ScholarCross RefCross Ref
  61. Joseph E. Mcgrath, Holly Arrow, Deborah H. Gruenfeld, Andrea B. Hollingshead, and Kathleen M. O'Connor. 1993. Groups, Tasks, and Technology The Effects of Experience and Change. Small Group Research 24, 3 (1993), 406-420. DOI: http://dx.doi.org/10.1177/1046496493243007Google ScholarGoogle ScholarCross RefCross Ref
  62. Paul M Muchinsky and Carlyn J Monahan. 1987. What is person-environment congruence? Supplementary versus complementary models of fit. Journal of Vocational Behavior 31, 3 (1987), 268-277. DOI: http://dx.doi.org/10.1016/00018791(87)90043--1Google ScholarGoogle ScholarCross RefCross Ref
  63. Peter E. Mudrack. 1989. Defining Group Cohesiveness A Legacy of Confusion? Small Group Research 20, 1 (1989), 37-49. DOI: http://dx.doi.org/10. 1177/104649648902000103Google ScholarGoogle ScholarCross RefCross Ref
  64. Bonnie Nardi and Justin Harris. 2006. Strangers and Friends: Collaborative Play in World of Warcraft. In Proceedings of the 2006 20th Anniversary Conference on Computer Supported Cooperative Work (CSCW '06). ACM, NY, NY, USA. DOI: http://dx.doi.org/10.1145/1180875.1180898 Google ScholarGoogle ScholarDigital LibraryDigital Library
  65. League of Graphs. 2015. Win Stats -- Blue Team vs. Red Team. (2015). http://www.leagueofgraphs.com/rankings/win-stats.Google ScholarGoogle Scholar
  66. Hao Yi Ong, Sunil Deolalikar, and Mark Peng. 2015. Player Behavior and Optimal Team Composition for Online Multiplayer Games. arXiv preprint arXiv:1503.02230 (2015).Google ScholarGoogle Scholar
  67. Rabindra A. Ratan, Nicholas Taylor, Jameson Hogan, Tracy Kennedy, and Dmitri Williams. 2015. Stand by Your Man An Examination of Gender Disparity in League of Legends. Games and Culture 10, 5 (2015), 438-462. DOI: http://dx.doi.org/10.1177/1555412014567228Google ScholarGoogle ScholarCross RefCross Ref
  68. Stuart Reeves, Barry Brown, and Eric Laurier. 2009. Experts at Play Understanding Skilled Expertise. Games and Culture 4, 3 (2009), 205-227. DOI: http://dx.doi.org/10.1177/1555412009339730Google ScholarGoogle ScholarCross RefCross Ref
  69. Michael Rutter. 2007. Proceeding From Observed Correlation to Causal Inference: The Use of Natural Experiments. Perspectives on Psychological Science 2, 4 (2007), 377-395. DOI: http://dx.doi.org/10.1111/j.17456916.2007.00050.xGoogle ScholarGoogle ScholarCross RefCross Ref
  70. E. Salas. 2005. Is there a "Big Five" in Teamwork? Small Group Research 36, 5 (2005), 555-599. DOI: http://dx.doi.org/10.1177/1046496405277134Google ScholarGoogle ScholarCross RefCross Ref
  71. Magy Seif El-Nasr, Bardia Aghabeigi, David Milam, Mona Erfani, Beth Lameman, Hamid Maygoli, and Sang Mah. 2010. Understanding and Evaluating Cooperative Games. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI '10). ACM, NY, NY, USA, 253-262. DOI: http://dx.doi.org/10.1145/1753326.1753363 Google ScholarGoogle ScholarDigital LibraryDigital Library
  72. Jee Young Seong, Amy L. Kristof-Brown, Won-Woo Park, Doo-Seung Hong, and Yuhyung Shin. 2012. Person-Group Fit Diversity Antecedents, Proximal Outcomes, and Performance at the Group Level. Journal of Management (2012), 0149206312453738. DOI: http://dx.doi.org/10.1177/0149206312453738Google ScholarGoogle Scholar
  73. Kenneth B. Shores, Yilin He, Kristina L. Swanenburg, Robert Kraut, and John Riedl. 2014. The Identification of Deviance and Its Impact on Retention in a Multiplayer Game. In Proceedings of the 17th ACM Conference on Computer Supported Cooperative Work & Social Computing (CSCW '14). ACM, NY, NY, USA, 1356-1365. DOI: http://dx.doi.org/10.1145/2531602.2531724 Google ScholarGoogle ScholarDigital LibraryDigital Library
  74. D. Sandy Staples and Jane Webster. 2007. Exploring Traditional and Virtual Team Members' "Best Practices": A Social Cognitive Theory Perspective. Small Group Research 38, 1 (2007), 60-97. DOI: http://dx.doi.org/10.1177/1046496406296961Google ScholarGoogle ScholarCross RefCross Ref
  75. Michael J. Stevens and Michael A. Campion. 1994. The knowledge, skill, and ability requirements for teamwork: Implications for human resource management. Journal of Management 20, 2 (1994), 503-530. DOI: http://dx.doi.org/10.1016/01492063(94)90025--6Google ScholarGoogle ScholarCross RefCross Ref
  76. Greg L. Stewart. 2006. A Meta-Analytic Review of Relationships Between Team Design Features and Team Performance. Journal of Management 32, 1 (2006), 29-55. DOI: http://dx.doi.org/10.1177/0149206305277792Google ScholarGoogle ScholarCross RefCross Ref
  77. Andy Stirling. 2007. A general framework for analysing diversity in science, technology and society. Journal of The Royal Society Interface 4, 15 (2007), 707-719. DOI: http://dx.doi.org/10.1098/rsif.2007.0213Google ScholarGoogle ScholarCross RefCross Ref
  78. David R Thomas. 2006. A general inductive approach for analyzing qualitative evaluation data. American journal of evaluation 27, 2 (2006), 237-246.Google ScholarGoogle Scholar
  79. Bruce W. Tuckman and Mary Ann C. Jensen. Stages of Small-Group Development Revisited. Group & Organization Management 2, 4 (????). DOI: http://dx.doi.org/10.1177/105960117700200404Google ScholarGoogle Scholar
  80. Melissa A. Valentine and Amy C. Edmondson. 2014. Team Scaffolds: How Mesolevel Structures Enable Role-Based Coordination in Temporary Groups. Organization Science 26, 2 (2014), 405-422. DOI: http://dx.doi.org/10.1287/orsc.2014.0947 Google ScholarGoogle ScholarDigital LibraryDigital Library
  81. Rodrigo Vicencio-Moreira, Regan L. Mandryk, and Carl Gutwin. 2015. Now You Can Compete With Anyone: Balancing Players of Different Skill Levels in a First-Person Shooter Game. In Proceedings of the 33rd Annual ACM Conference on Human Factors in Computing Systems (CHI '15). ACM, NY, NY, USA, 2255-2264. DOI:http: //dx.doi.org/10.1145/2702123.2702242 Google ScholarGoogle ScholarDigital LibraryDigital Library
  82. Ruth Wageman, J. Richard Hackman, and Erin Lehman. 2005. Team Diagnostic Survey Development of an Instrument. The Journal of Applied Behavioral Science 41, 4 (2005), 373-398.Google ScholarGoogle ScholarCross RefCross Ref
  83. Wikia. 2015. League system. (2015). http://leagueoflegends.wikia.com/wiki/League_system.Google ScholarGoogle Scholar
  84. Dmitri Williams. 2010. The Mapping Principle, and a Research Framework for Virtual Worlds. Communication Theory 20, 4 (2010), 451-470. DOI: http://dx.doi.org/10.1111/j.14682885.2010.01371.xGoogle ScholarGoogle ScholarCross RefCross Ref
  85. J. Patrick Williams and David Kirschner. 2012. Coordinated Action in the Massively Multiplayer Online Game World of Warcraft. Symbolic Interaction 35, 3 (2012), 340-367. DOI: http://dx.doi.org/10.1002/symb.22Google ScholarGoogle ScholarCross RefCross Ref
  86. Richard A. Wolfe, Karl E. Weick, John M. Usher, James R. Terborg, Laura Poppo, Audrey J. Murrell, Janet M. Dukerich, Deborah Crown Core, Kevin E. Dickson, and Jessica Simmons Jourdan. 2005. Sport and Organizational Studies Exploring Synergy. Journal of Management Inquiry 14, 2 (2005), 182-210. DOI: http://dx.doi.org/10.1177/1056492605275245Google ScholarGoogle ScholarCross RefCross Ref
  87. Yan Xu, Xiang Cao, Abigail Sellen, Ralf Herbrich, and Thore Graepel. 2011. Sociable Killers: Understanding Social Relationships in an Online First-person Shooter Game. In Proceedings of the ACM 2011 Conference on Computer Supported Cooperative Work (CSCW '11). ACM, NY, NY, USA, 197-206. DOI: http://dx.doi.org/10.1145/1958824.1958854 Google ScholarGoogle ScholarDigital LibraryDigital Library
  88. Nick Yee. 2006. The Labor of Fun How Video Games Blur the Boundaries of Work and Play. Games and Culture 1, 1 (2006), 68-71. DOI: http://dx.doi.org/10.1177/1555412005281819Google ScholarGoogle ScholarCross RefCross Ref
  89. Mary E. Zellmer-Bruhn, Mary M. Maloney, Anita D. Bhappu, and Rommel (Bombie) Salvador. 2008. When and how do differences matter? An exploration of perceived similarity in teams. Organizational Behavior and Human Decision Processes 107, 1 (2008), 41-59. DOI: http://dx.doi.org/10.1016/j.obhdp.2008.01.004Google ScholarGoogle ScholarCross RefCross Ref

Index Terms

  1. The Proficiency-Congruency Dilemma: Virtual Team Design and Performance in Multiplayer Online Games

      Recommendations

      Comments

      Login options

      Check if you have access through your login credentials or your institution to get full access on this article.

      Sign in
      • Published in

        cover image ACM Conferences
        CHI '16: Proceedings of the 2016 CHI Conference on Human Factors in Computing Systems
        May 2016
        6108 pages
        ISBN:9781450333627
        DOI:10.1145/2858036

        Copyright © 2016 ACM

        Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

        Publisher

        Association for Computing Machinery

        New York, NY, United States

        Publication History

        • Published: 7 May 2016

        Permissions

        Request permissions about this article.

        Request Permissions

        Check for updates

        Qualifiers

        • research-article

        Acceptance Rates

        CHI '16 Paper Acceptance Rate565of2,435submissions,23%Overall Acceptance Rate6,199of26,314submissions,24%

        Upcoming Conference

        CHI '24
        CHI Conference on Human Factors in Computing Systems
        May 11 - 16, 2024
        Honolulu , HI , USA

      PDF Format

      View or Download as a PDF file.

      PDF

      eReader

      View online with eReader.

      eReader