Emerson Murphy-Hill
Thomas Zimmermann
Nachiappan Nagappan
ABSTRACT
Video games make up an important part of the software industry, yet the software engineering community rarely studies video games. This imbalance is a problem if video game development differs from general software development, as some game experts suggest. In this paper we describe a study with 14 interviewees and 364 survey respondents. The study elicited substantial differences between video game development and other software development. For example, in game development, “cowboy coders” are necessary to cope with the continuous interplay between creative desires and technical constraints. Consequently, game developers are hesitant to use automated testing because of these tests’ rapid obsolescence in the face of shifting creative desires of game designers. These differences between game and non-game development have implications for research, industry, and practice. For instance, as a starting point for impacting game development, researchers could create testing tools that enable game developers to create tests that assert flexible behavior with little up-front investment.
- T. Marsh, "Serious games continuum: Between games for purpose and experiential environments for purpose," Entertainment Computing, vol. 59, no. 2, pp. 61-68, 2012.Google Scholar
Cross Ref
- T. Connolly, E. A. Boyle, E. MacArthur, T. Hainey and J. M. Boyle, "A systematic literature review of empirical evidence on computer games and serious games," Computers & Education, vol. 59, no. 2, pp. 661-686, 2012. Google ScholarDigital Library
- M. Nayak, "A look at the $66 billion video-games industry," Reuters, June 2013.Google Scholar
- M. Nagappan, T. Zimmermann and C. Bird, "Diversity in Software Engineering Research," Proceedings of Foundations of Software Engineering, 2013. Google ScholarDigital Library
- H. Do, S. Elbaum and G. Rothermel, "Supporting controlled experimentation with testing techniques: An infrastructure and its potential impact," Empirical Software Engineering, vol. 10, no. 4, pp. 406-435, 2005. Google ScholarDigital Library
- E. Tempero, C. Anslow, J. Dietrich, T. Han, J. Li, M. Lumpe and H. a. N. J. Melton, "Qualitas Corpus: A Curated Collection of Java Code for Empirical Studies," Proceedings of the Asia Pacific Software Engineering Conference, pp. 336-345, December 2010. Google ScholarDigital Library
- T. A. Beery, "Gender bias in the diagnosis and treatment of coronary artery disease," Heart & Lung: The Journal of Acute and Critical Care, vol. 24, no. 6, pp. 427-435, 1995.Google ScholarCross Ref
- E. Bethke, Game Development and Production, 2003.Google ScholarDigital Library
- H. M. Chandler, The Game Production Handbook, 2008.Google Scholar
- M. McGuire and O. C. Jenkins, Creating Games: Mechanics, Content, and Technology, CRC Press, 2008.Google ScholarCross Ref
- M. McShaffry and D. Graham, Game Coding Complete, Fourth Edition, 4 ed., Cengage Learning PTR, 2012. Google ScholarDigital Library
- M. T. Wyman, Making Great Games: An Insider's Guide to Designing and Developing the World's Greatest Games, CRC Press, 2012. Google ScholarDigital Library
- J. Blow, "Game Development: Harder Than You Think," IEEE Software, pp. 28-37, February 2004. Google ScholarDigital Library
- A. Ampatzoglou and I. Stamelos, "Software engineering research for computer games: A systematic review," Information and Software Technology, vol. 52, no. 9, pp. 888-901, 2010. Google ScholarDigital Library
- F. T. Tschang, "Videogames as Interactive Experiential Products and Their Manner of Development," International Journal of Innovation Management, vol. 9, no. 1, 2005.Google ScholarCross Ref
- F. T. Tschang, "Balancing the Tensions Between Rationalization and Creativity in the Video Games Industry," Organization Science, vol. 18, pp. 989-1005, 01 Nov. 2007. Google ScholarDigital Library
- F. Tschang and J. Szczypula, "Idea Creation, Constructivism and Evolution as Key Characteristics in the Videogame Artifact Design Process," European Management Journal, vol. 24, pp. 270--287, Aug. 2006.Google ScholarCross Ref
- B. W. Boehm, "A spiral model of software development and enhancement," Computer, vol. 21, pp. 61-72, 1988. Google ScholarDigital Library
- Y. Baba and F. Tschang, "Product Development in Japanese TV Game Software: The Case of An Innovative Game," International Journal of Innovation Management, 2001.Google ScholarCross Ref
- T. Burger-Helmchen and P. Cohendet, "User Communities and Social Software in the Video Game Industry," Long Range Planning, vol. 44, pp. 317--343, oct 2011.Google ScholarCross Ref
- A. Kultima and K. Alha, ""Hopefully Everything I'm Doing Has to Do with Innovation": Games Industry Professionals on Innovation in 2009," in Games Innovations Conf., 2010.Google Scholar
- P. Stacy and J. Nandhakumar, "A temporal perspective of the computer game development process," Information Systems Journal, vol. 19, pp. 479-497, 2009.Google ScholarCross Ref
- D. Callele, E. Neufeld and K. Schneider, "Requirements engineering and the creative process in the video game industry," in 13th IEEE International Conference on Requirements Engineering (RE'05), 2005. Google ScholarDigital Library
- J. Kasurinen, J. P. Stranden and K. Smolander, "What do game developers expect from development and design tools?," in Proceedings of the Conf. on Evaluation and Assessment in Software Engineering, 2013. Google ScholarDigital Library
- J. Musil, A. Schweda, D. Winkler and S. Biffl, "A Survey on a State of the Practice in Video Game Development," 2010.Google Scholar
- C. Lewis, J. Whitehead and N. Wardrip-Fruin, "What went wrong: a taxonomy of video game bugs," in Proceedings of the Fifth International Conference on the Foundations of Digital Games, 2010. Google ScholarDigital Library
- F. Petrillo, M. Pimenta, F. Trindade and C. Dietrich, "What went wrong: A survey of problems in game development," Comput. Entertain., vol. 7, feb 2009. Google ScholarDigital Library
- F. Petrillo, M. Pimenta, F. Trindade and C. Dietrich, "Houston, we have a problem...: a survey of actual problems in computer games development," in Proceedings of the 2008 ACM symposium on Applied computing, 2008. Google ScholarDigital Library
- F. Petrillo and M. Pimenta, "Is Agility out there?: Agile practices in game development," in Proceedings of the International Conference on Design of Communication, 2010. Google ScholarDigital Library
- C. Lewis and J. Whitehead, "The whats and the whys of games and software engineering," in Intl. Workshop on Games and Software Engineering, 2011. Google ScholarDigital Library
- C. Kanode and H. Haddad, "Software Engineering Challenges in Game Development," in Information Technology: New Generations, 2009. Google ScholarDigital Library
- A. Abran, J. W. Moore, P. Bourque, R. Dupuis and L. L. Tripp, Guide to the Software Engineering Body of Knowledge (SWEBOK), IEEE, 2004. Google ScholarDigital Library
- S. E. Humphrey, J. D. Nahrgang and F. P. Morgeson, "Integrating motivational, social, and contextual work design features: a meta-analytic summary and theoretical extension of the work design literature.," Journal of Applied Psychology, vol. 92, p. 1332, 2007.Google ScholarCross Ref
- H. Braverman, Labor and monopoly capital, 1975.Google Scholar
- R. Blauner, Alienation and Freedom, 1964.Google Scholar
- C. L. More, "Digital Games Distribution: The Presence of the Past and the Future of Obsolescence," Media and Culture, vol. 12, no. 3, 2009.Google Scholar
- S. van der Graaf, "Get Organized At Work! A Look Inside the Game Design Process of Valve and Linden Lab," Bulletin of Science, Technology, and Society, vol. 32, no. 6, pp. 480- 488, 2012.Google ScholarCross Ref
- E. Murphy-Hill, T. Zimmermann and N. Nagappan, "Motion Sickness Susceptibility in Software Developers," Microsoft Research (MSR-TR-2014-24), 2014.Google Scholar
- Y. Benjamini and Y. Hochberg, "Controlling the false discovery rate: a practical and powerful approach to multiple testing," Journal of the Royal Statistical Society. Series B (Methodological), pp. 289--300, 1995.Google Scholar
- M. Musuvathi, S. Qadeer, T. Ball, G. Basler, P. A. Nainar and I. Neamtiu, "Finding and reproducing heisenbugs in concurrent programs," in Proceedings of the Conference on Operating Systems Design and Implementation, 2008. Google ScholarDigital Library
Index Terms
- Cowboys, ankle sprains, and keepers of quality: how is video game development different from software development?
Recommendations
"Leagile" software development
In recent years there has been a noticeable shift in attention from those who use agile software development toward lean software development, often labelled as a shift "from agile to lean". However, the reality may not be as simple or linear as this ...
Is Internet-Speed Software Development Different?
In a multiphase study conducted from 2000 to 2002, the authors examined the relationships between Internet-speed software development practices and agile and traditional development principles, and compared the two sets of principles. They found some ...
Software Engineering Practices and Methods in the Game Development Industry
CHI PLAY '19 Extended Abstracts: Extended Abstracts of the Annual Symposium on Computer-Human Interaction in Play Companion Extended AbstractsApplying current software engineering practices in the game development industry is a rapidly growing but under researched area. Whether game development studios align to traditional software engineering practices such as agile methodologies to develop ...
Reviews
John M. Artz
Occasionally, when reviewing a really bad paper, I will point out that its only redeeming value is that it can be used as a bad example in a research methods class. So, to be fair, when a really good paper comes along, I should point out that it can be used as an example of good research in such a class. This paper falls into that second category. It is an ethnographic study of video game developers, which attempts to discover if there are differences in software development approaches between video game developers and more traditional software engineering. As the study reveals, video games differ from traditional software in several important ways. For example, video games live or die on user experience. They must be fun to play. In order to achieve this goal, it is very difficult to nail down requirements at the beginning, as you may not know how well something will work until you try it. The game evolves throughout the development process. Furthermore, you don't know whether the goal of being really fun to play will be achieved until users actually start playing it. So during the development process, you don't know if you are creating a game that will fade out quickly or be built upon for the next decade. Imagine a software engineering effort where you didn't know if you were building a toss out prototype or the foundation for a system that will become legacy over time. These as well as many other observations were very revealing. There are two main reasons why this is a good study. One is method, and the other is content. The methodology uses open-ended interviews followed up by surveys. And the results are mapped into the elements of software engineering, which organizes the results in a sense-making framework. The authors also discuss limitations, which are honest but not gratuitous. The second strength of the paper is content. One gets a good feel for the ground-level elements that make video games different. And although all papers gratuitously nod at possibilities for future research, this paper really does provide a solid foundation. Generally, this paper would be of interest to researchers and practitioners in both software engineering and video game development. More specifically, it provides a good model for ethnographic research in software development. It is a well-written report on a well-constructed study, and a good read regardless of your interests. Online Computing Reviews Service
Access critical reviews of Computing literature here
Become a reviewer for Computing Reviews.
Comments