Jared Cechanowicz
ABSTRACT
Gamification has become an increasingly popular way to improve user engagement and motivation, but there is currently a lack of empirical research to demonstrate that increased gamification provides these benefits. To help address this problem we designed three versions of a gamified market research survey and tested them alongside the established industry standard in a study of over 600 participants. We also highlight examples where game elements compromise respondent data, and provide design solutions that correct the problem without losing the motivational benefits of gamification.
- Adamou, B. Using Gamification in Youth Surveys. http://rwconnect.esomar.org/2012/07/17/using-gamification-in-surveys-for-children/.Google Scholar
- Adamou, B. Giving Research the NOS Effect. Proc. 2012 Net Gain 6.0 MRIA Conference.Google Scholar
- Atico Mobile: Logo Quiz iPhone App. http://aticod.com/portfolio/logosQuiz/.Google Scholar
- Center for Game Science at University of Washington: Foldit. http://www.fold.it.Google Scholar
- Chao, D. Doom as an Interface for Process Management. Proc. CHI 2001, 152--157. Google ScholarDigital Library
- Chrons, O., & Sundell, S. Digitalkoot: Making Old Archives Accessible Using Crowdsourcing. Proc. HCOMP 2011.Google Scholar
- Deterding, S., Dixon, D., Nacke, L., O'Hara, K., & Sicart, M. Gamification: Using Game Design Elements in Non-Gaming Contexts. CHI 2011 Ext. Abstracts. Google ScholarDigital Library
- DigitalFruit: LimeJS HTML 5 Game Framework. http://www.limejs.com.Google Scholar
- Dignan, A. Game Frame: Using Games as a Strategy for Success. Free Press, 2011.Google Scholar
- Eye Tracking Technologies Limited: BrandBang!. http://support.brandbang.org/.Google Scholar
- Flatla, D. R., Gutwin, C., Nacke, L. E., & Bateman, S., Mandryk, R. L. Calibration Games: Making Calibration Tasks Enjoyable by Adding Motivating Game Elements. Proc. UIST 2011, 403--412. Google ScholarDigital Library
- Galesic, M., & Bosnjak, M. Effects of questionnaire length on participation and indicators of response quality in a web survey.Google Scholar
- Guin, T. D., Baker, R., Mechling, & J., Ruylea E. Myths and Realities of Respondent Engagement in Online Surveys. Int. J. of Market Res. 54, 5 (2012), 613--633.Google Scholar
- Hunicke, R., LeBlanc, M., & Zubek, R. MDA: A Formal Approach to Game Design and Game Research. Proc. AAAI04 WS on Challenges in Game AI, 2004, 1--5.Google Scholar
- Jung, J., Schneider, C., and Valacich, J. Enhancing the motivational affordance of information systems: The effects of real-time performance feedback and goal setting in group collaboration environments. Management Science 56, 4, (2010), 724--742. Google ScholarDigital Library
- Keller, K. L. Conceptualizing, Measuring, and Managing Customer-Based Brand Equity. Journal of Marketing 57, 1, (1993), 1--22.Google ScholarCross Ref
- Korn, O. Industrial playgrounds: how gamification helps to enrich work for elderly or impaired persons in production. Proc. EICS 2012, 313--316. Google ScholarDigital Library
- Lewis, C., Wardrip-Fruin, N., & Whitehead, J. Motivational game design patterns of 'ville games. Proc. FDG 2012, 172--179. Google ScholarDigital Library
- Malinoff, B. Sexy questions, dangerous answers. Proc. CASRO 2010 Technology Conference.Google Scholar
- Malinoff, B. Yin and Yang of Gamification. Proc. 2012 Net Gain 6.0 MRIA Conference.Google Scholar
- Mason, A., Michalakidis, G. & Krause, P. Tiger nation: Empowering citizen scientists. Proc. IEEE DEST 2012.Google Scholar
- Mekler, D., Brühlmann, F., Opwis, K., & Tuch, N. Disassembling gamification: the effects of points and meaning on user motivation and performance. CHI 2013. Google ScholarDigital Library
- Murphy, L. The Quant vs. Qual Dynamic. Greenbook Winter 2013, 19--21.Google Scholar
- Nikkila, S., Byrne, D., Sundaram, H., Kelliher, A., & Linn, S. Taskville: visualizing tasks and raising awareness in the workplace. CHI 2013 Ext. Abstracts. Google ScholarDigital Library
- Presser, S. et al. Methods for testing and evaluating survey questions. Public Opin. Q. 68, 1 (2004):109--130.Google ScholarCross Ref
- Puleston, J. & Sleep, D. The game experiments: researching how gaming techniques can be used to improve the quality of feedback from online research. Proc. ESOMAR Congress 2011.Google Scholar
- Rapp, A., Marcengo, A., Simeoni, R., & Console, L. Playing while Testing: How to Gamify a User Field Evaluation. CHI 2013 Ext. Abstracts.Google Scholar
- Reeves, B., & Read, J. Total Engagement. 2009.Google Scholar
- Research Through Gaming: Pimple Crisis. http://www.youtube.com/watch?v=2s63gLuO-W0.Google Scholar
- Research Through Gaming: The PlayspondentHouse. http://www.researchthroughgaming.com/Google Scholar
- Ryan, R. M., Rigby, C. S. and Przybylski, A. The Motivational Pull of Video Games: A Self-Determination Theory Approach. Motivation & Emotion 30, 4 (2006), 347--363.Google Scholar
- Saha, R, Manna R., & Geetha G. CAPTCHINO- A Gamification of Image-based CAPTCHAs to Evaluate Usability Issues. Proc. ICCS 2012, 95--99. Google ScholarDigital Library
- Sherman, B. Planning for success: Maximizing ROI for custom panels and online communities. Quirks Marketing Review 25, 4, (2011), 46--51.Google Scholar
- Shneiderman, B. Designing for Fun: How Can We Design User Interfaces to Be More Fun? Interactions 11, 5, (2004), 48--50. Google ScholarDigital Library
- Sweetser, P. & Wyeth, P., GameFlow: a model for evaluating player enjoyment in games. Computers in Entertainment 3, 3, (2005), 1--24. Google ScholarDigital Library
- Thomas, R., Bremer, J., Terhanian, G. & Couper, M. P. Truth in measurement: comparing web-based interview techniques. Proc. ESOMAR Congress 2007.Google Scholar
- Von Ahn, L., & Dabbish, L. Designing Games With a Purpose. Comm. ACM 51, 8, (2008), 58--67. Google ScholarDigital Library
- Wilson, D. & Birks, D. F. The development of the KubeMatrix as a mobile app for Market Research Online Communities. Proc. ASC 2011.Google Scholar
- Witt, M., Scheiner, C., & Robra-Bissantz, S. Gamification of Online Idea Competitions: Insights from an Explorative Case. Proc. Informatik 2011.Google Scholar
Index Terms
- Effects of gamification on participation and data quality in a real-world market research domain
Recommendations
Got skillz?: player matching, mastery, and engagement in skill-based games
Gamification '13: Proceedings of the First International Conference on Gameful Design, Research, and ApplicationsIn this paper we explore mastery, a powerful intrinsic motivator, and its relationship to player engagement in a mobile skill-based game platform (Skillz.com). More specifically, we present a unique Elo-based rating system for quickly matching players ...
A Qualitative Investigation of Gamification: Motivational Factors in Online Gamified Services and Applications
Gamification is commonly employed in designing interactive systems to enhance user engagement and motivations, or to trigger behavior change processes. Although some quantitative studies have been recently conducted aiming at measuring the effects of ...
Contextual Autonomy Support in Video Game Play: A Grounded Theory
CHI '16: Proceedings of the 2016 CHI Conference on Human Factors in Computing SystemsAutonomy experience constitutes a core part of the intrinsic motivation of playing games. While research has explored how autonomy is afforded by a game's design, little is known about the role of the social context of play. Particularly, engaging with ...
Comments