Skip to main content
Log in

Team diversity, polarization, and productivity in online peer production

  • Original Article
  • Published:
Social Network Analysis and Mining Aims and scope Submit manuscript

Abstract

We define network-based indicators to characterize diversity of Wikipedia teams and contributing users. A team of Wikipedia users is diverse to the extent that its members edit different articles. An individual user has diverse interests to the extent that she contributes to articles that are not normally co-edited by the same users, i. e., if she contributes to an atypical combination of articles. For both indicators, we propose a model-based normalization by comparing observed and expected values computed on a reference random graph model that preserves expected degrees of users and articles. Using data on all articles of the English-language edition of Wikipedia, we show that diverse teams tend to produce high-quality (or “featured”) articles. In contrast, teams of users that individually have diverse interests tend to produce articles of lower quality. These findings are robust with respect to several alternative explanations for article quality. We also show that the proposed model-based normalization of network indicators outperforms an ad hoc normalization via more conventional cosine similarity measures. Finally, we analyze the interplay between team diversity and polarization sustained by adherence to behavioral norms predicted by balance theory. Results suggest that diversity can mitigate the—otherwise negative—effect of polarization on team productivity.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Fig. 1

Similar content being viewed by others

Notes

  1. https://en.wikipedia.org/wiki/Wikipedia:Featured_articles

References

  • Adler BT, de Alfaro L (2007) A content-driven reputation system for the Wikipedia. In: Proceedings of the 16th international conference on WWW. ACM, pp 261–270

  • Akerlof GA, Dickens WT (1982) The economic consequences of cognitive dissonance. Am Econ Rev 72(3):307–319

    Google Scholar 

  • Ancona DG, Caldwell DF (1992) Demography and design: predictors of new product team performance. Organ. Sci. 3(3):321–341

    Article  Google Scholar 

  • Arazy O, Nov O, Patterson R, Yeo L (2011) Information quality in Wikipedia: the effects of group composition and task conflict. J. Manag. Inf. Syst. 27(4):71–98

    Article  Google Scholar 

  • Arazy O, Morgan W, Patterson R (2006) Wisdom of the crowds: decentralized knowledge construction in Wikipedia. In: Proceedings of the 16th workshop information technologies and systems, pp 79–84

  • Baraniak K, Sydow M, Szejda J, Czerniawska D (2016) Studying the role of diversity in open collaboration network: experiments on Wikipedia. In: International conference and school on network science. Springer, pp 97–110

  • Barbosa S, Cosley D, Sharma A, Cesar Jr RM (2016) Averaging gone wrong: using time-aware analyses to better understand behavior. In: Proceedings of the 25th international conference on WWW. ACM, pp 829–841

  • Blumenstock JE (2008) Size matters: word count as a measure of quality on Wikipedia. In: Proceedings of the 17th international conference on WWW. ACM, pp 1095–1096

  • Blyth CR (1972) On Simpson’s paradox and the sure-thing principle. J Am Stat Assoc 67(338):364–366

    Article  MathSciNet  MATH  Google Scholar 

  • Borgan Ø, Goldstein L, Langholz B (1995) Methods for the analysis of sampled cohort data in the Cox proportional hazards model. Ann Stat 23:1749–1778

    Article  MathSciNet  MATH  Google Scholar 

  • Brandes U, Kenis P, Lerner J, van Raaij D (2009) Network analysis of collaboration structure in Wikipedia. In: Proceedings of the 18th international conference on WWW. ACM, pp 731–740

  • Bromham L, Dinnage R, Hua X (2016) Interdisciplinary research has consistently lower funding success. Nature 534(7609):684

    Article  Google Scholar 

  • Caldarelli G, Capocci A, De Los Rios P, Munoz MA (2002) Scale-free networks from varying vertex intrinsic fitness. Phys. Rev. Lett. 89(25):258702

    Article  Google Scholar 

  • Carroll RJ, Pederson S (1993) On robustness in the logistic regression model. J R Stat Soc Ser B (Methodol) 55:693–706

    MathSciNet  MATH  Google Scholar 

  • Cartwright D, Harary F (1956) Structural balance: a generalization of Heider’s theory. Psychol Rev 63(5):277–293

    Article  Google Scholar 

  • Conaldi G, Lomi A (2013) The dual network structure of organizational problem solving: a case study on open source software development. Soc Netw 35(2):237–250

    Article  Google Scholar 

  • De Masi G, Iori G, Caldarelli G (2006) Fitness model for the Italian interbank money market. Phys Rev E 74(6):066112

    Article  Google Scholar 

  • Esteban JM, Ray D (1994) On the measurement of polarization. Econometrica 62(4):819–851

    Article  MATH  Google Scholar 

  • Festinger L (1962) A theory of cognitive dissonance, vol 2. Stanford University Press, Stanford

    Google Scholar 

  • Flöck F, Acosta M (2014) Wikiwho: precise and efficient attribution of authorship of revisioned content. In: Proceedings of the 23rd international conference on WWW. ACM, pp 843–854

  • Flöck F, Vrandečić D, Simperl E (2011) Towards a diversity-minded Wikipedia. In: Proceedings of the 3rd international web science conference. ACM, p 5

  • Franzoni C, Sauermann H (2014) Crowd science: the organization of scientific research in open collaborative projects. Res Policy 43(1):1–20

    Article  Google Scholar 

  • Friedkin NE, Proskurnikov AV, Tempo R, Parsegov SE (2016) Network science on belief system dynamics under logic constraints. Science 354(6310):321–326

    Article  MathSciNet  MATH  Google Scholar 

  • Goldberg A, Hannan MT, Kovács B (2016) What does it mean to span cultural boundaries? Variety and atypicality in cultural consumption. Am Sociol Rev 81(2):215–241

    Article  Google Scholar 

  • Heider F (1946) Attitudes and cognitive organization. J Psychol 21:107–112

    Article  Google Scholar 

  • Hong L, Page SE (2004) Groups of diverse problem solvers can outperform groups of high-ability problem solvers. Proc Natl Acad Sci USA 101(46):16385–16389

    Article  Google Scholar 

  • Horwitz SK, Horwitz IB (2007) The effects of team diversity on team outcomes: a meta-analytic review of team demography. J Manag 33(6):987–1015

    Google Scholar 

  • Hsu G (2006) Jacks of all trades and masters of none: audiences’ reactions to spanning genres in feature film production. Adm Sci Q 51(3):420–450

    Article  Google Scholar 

  • Javanmardi S, Lopes C, Baldi P (2010) Modeling user reputation in wikis. Stat Anal Data Min 3(2):126–139

    MathSciNet  Google Scholar 

  • Jehn KA, Northcraft GB, Neale MA (1999) Why differences make a difference: a field study of diversity, conflict and performance in workgroups. Adm Sci Q 44(4):741–763

    Article  Google Scholar 

  • Joshi A, Roh H (2009) The role of context in work team diversity research: a meta-analytic review. Acad Manag J 52(3):599–627

    Article  Google Scholar 

  • Kittur A, Chi EH, Suh B (2009) What’s in Wikipedia? Mapping topics and conflict using socially annotated category structure. In: Proceedings of the SIGCHI conference on human factors in computing systems. ACM, pp 1509–1512

  • Kittur A, Chi E, Pendleton BA, Suh B, Mytkowicz T (2007) Power of the few vs. wisdom of the crowd: Wikipedia and the rise of the bourgeoisie. In: Proceedings of the 25th annual ACM conference on human factors in computing systems. ACM

  • Kittur A, Kraut RE (2008) Harnessing the wisdom of crowds in Wikipedia: quality through coordination. In: Proceedings of the 2008 ACM conference on computer supported cooperative work. ACM, New York, pp 37–46

  • Kovács B, Hannan MT (2010) The consequences of category spanning depend on contrast. In: Hsu G, Kocak O, Negro G (eds) Categories in markets: origins and evolution. Emerald Group Publishing Limited, Bingley, pp 175–201

    Chapter  Google Scholar 

  • Lam SK, Karim J, Riedl J (2010) The effects of group composition on decision quality in a social production community. In: Proceedings of the 16th ACM international conference on Supporting group work. ACM, pp 55–64

  • Lee GK, Cole RE (2003) From a firm-based to a community-based model of knowledge creation: the case of the linux kernel development. Organ Sci 14(6):633–649

    Article  Google Scholar 

  • Lerner J, Lomi A (2017) The third man: Hierarchy formation in Wikipedia. Appl Netw Sci 2(1):24

    Article  Google Scholar 

  • Lerner J, Lomi A (2018b) The free encyclopedia that anyone can dispute: an analysis of the micro-structural dynamics of positive and negative relations in the production of contentious Wikipedia articles. Soc Netw. https://doi.org/10.1016/j.socnet.2018.12.003

    Article  Google Scholar 

  • Lerner J, Lomi A (2018c) Knowledge categorization affects popularity and quality of Wikipedia articles. PloS ONE 13(1):e0190674

    Article  Google Scholar 

  • Lerner J, Tirole J (2001) The open source movement: key research questions. Eur Econ Rev 45(4):819–826

    Article  Google Scholar 

  • Lerner J, Lomi A (2018a) Diverse teams tend to do good work in Wikipedia (but jacks of all trades don’t). In: Proceedings of the 2018 international conference on advances in social network analysis and mining (ASONAM 2018). IEEE Computer Society, pp 214–221

  • Lerner J, Lomi A (2019) The network structure of successful collaboration in Wikipedia. In: Proceedings of the 52nd Hawaii international conference on system sciences (HICSS 2019). IEEE Computer Society, pp 2622–2631

  • Liu J, Ram S (2011) Who does what: collaboration patterns in the Wikipedia and their impact on article quality. ACM Trans Manag Inf Syst (TMIS) 2(2):11

    Google Scholar 

  • Lord CG, Ross L, Lepper MR (1979) Biased assimilation and attitude polarization: the effects of prior theories on subsequently considered evidence. J Personal Soc Psychol 37(11):2098

    Article  Google Scholar 

  • Maniu S, Cautis B, Abdessalem T (2011) Building a signed network from interactions in Wikipedia. In: Proceedings of the databases and social networks. ACM, pp 19–24

  • Mannix E, Neale MA (2005) What differences make a difference? The promise and reality of diverse teams in organizations. Psychol Sci Pub Interest 6(2):31–55

    Article  Google Scholar 

  • McPherson JM, Ranger-Moore JR (1991) Evolution on a dancing landscape: organizations and networks in dynamic blau space. Soc Forces 70(1):19–42

    Article  Google Scholar 

  • Phillips DJ, Turco CJ, Zuckerman EW (2013) Betrayal as market barrier: identity-based limits to diversification among high-status corporate law firms. Am J Sociol 118(4):1023–1054

    Article  Google Scholar 

  • Ransbotham S, Kane GC (2011) Membership turnover and collaboration success in online communities: explaining rises and falls from grace in Wikipedia. MIS Q 35(3):613–627

    Article  Google Scholar 

  • Ren Y, Chen J, Riedl J (2015) The impact and evolution of group diversity in online open collaboration. Manag Sci 62(6):1668–1686

    Article  Google Scholar 

  • Robert LP, Romero DM (2017) The influence of diversity and experience on the effects of crowd size. J Assoc Inf Sci Technol 68(2):321–332

    Article  Google Scholar 

  • Saperstein AM (2004) ’The enemy of my enemy is my friend’ is the enemy: dealing with the war-provoking rules of intent. Confl Manag Peace Sci 21(4):287–296

    Article  Google Scholar 

  • Shi F, Teplitskiy M, Duede E, Evans J (2017) The wisdom of polarized crowds. arXiv:1712.06414

  • Simpson EH (1951) The interpretation of interaction in contingency tables. J R Stat Soc Ser B (Methodolog) 13:238–241

    MathSciNet  MATH  Google Scholar 

  • Sydow M, Baraniak K, Teisseyre P (2017) Diversity of editors and teams versus quality of cooperative work: experiments on Wikipedia. J Intell Inf Syst 48(3):601–632

    Article  Google Scholar 

  • Szejda J, Sydow M, Czerniawska D (2014) Does a ’renaissance man’ create good Wikipedia articles? In: Proceedings of the international conference on knowledge discovery and information retrieval (KDIR-2014), pp 425–430

  • Tsvetkova M, García-Gavilanes R, Floridi L, Yasseri T (2017) Even good bots fight: the case of Wikipedia. PloS ONE 12(2):e0171774

    Article  Google Scholar 

  • Uzzi B, Mukherjee S, Stringer M, Jones B (2013) Atypical combinations and scientific impact. Science 342(6157):468–472

    Article  Google Scholar 

  • von Hippel E, von Krogh G (2003) Open source software and the “private-collective” innovation model: issues for organization science. Organ Sci 14(2):209–223

    Article  Google Scholar 

  • von Hippel E, von Krogh G (2006) Free revealing and the private-collective model for innovation incentives. R&D Manag 36(3):295–306

    Article  Google Scholar 

  • Wuchty S, Jones BF, Uzzi B (2007) The increasing dominance of teams in production of knowledge. Science 316(5827):1036–1039

    Article  Google Scholar 

  • Wu G, Harrigan M, Cunningham P (2011) Characterizing Wikipedia pages using edit network motif profiles. In: Proceedings of the 3rd international workshop search and mining user-generated contents, Glasgow, Scotland, UK. ACM, New York, pp 45–52

  • Zuckerman EW (1999) The categorical imperative: securities analysts and the illegitimacy discount. Am J Sociol 104(5):1398–1438

    Article  Google Scholar 

  • Zuckerman EW, Kim TY, Ukanwa K, Von Rittmann J (2003) Robust identities or nonentities? Typecasting in the feature-film labor market. Am J Sociol 108(5):1018–1074

    Article  Google Scholar 

Download references

Acknowledgements

This work has been supported by Deutsche Forschungsgemeinschaft (DFG Grant Nr. LE 2237/2-1) and Swiss National Science Foundation (FNS Project Nr. 100018_150126 and 100018_165764/1).

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Jürgen Lerner.

Additional information

Publisher's Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Lerner, J., Lomi, A. Team diversity, polarization, and productivity in online peer production. Soc. Netw. Anal. Min. 9, 29 (2019). https://doi.org/10.1007/s13278-019-0569-7

Download citation

  • Received:

  • Revised:

  • Accepted:

  • Published:

  • DOI: https://doi.org/10.1007/s13278-019-0569-7

Keywords

Navigation