Skip to main content

Advertisement

Log in

Examination of the Effects of Dimensionality on Cognitive Processing in Science: A Computational Modeling Experiment Comparing Online Laboratory Simulations and Serious Educational Games

  • Published:
Journal of Science Education and Technology Aims and scope Submit manuscript

Abstract

Within the last 10 years, new tools for assisting in the teaching and learning of academic skills and content within the context of science have arisen. These new tools include multiple types of computer software and hardware to include (video) games. The purpose of this study was to examine and compare the effect of computer learning games in the form of three-dimensional serious educational games, two-dimensional online laboratories, and traditional lecture-based instruction in the context of student content learning in science. In particular, this study examines the impact of dimensionality, or the ability to move along the X-, Y-, and Z-axis in the games. Study subjects (N = 551) were randomly selected using a stratified sampling technique. Independent strata subsamples were developed based upon the conditions of serious educational games, online laboratories, and lecture. The study also computationally models a potential mechanism of action and compares two- and three-dimensional learning environments. F test results suggest a significant difference for the main effect of condition across the factor of content gain score with large effect. Overall, comparisons using computational models suggest that three-dimensional serious educational games increase the level of success in learning as measured with content examinations through greater recruitment and attributional retraining of cognitive systems. The study supports assertions in the literature that the use of games in higher dimensions (i.e., three-dimensional versus two-dimensional) helps to increase student understanding of science concepts.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Fig. 1
Fig. 2

Similar content being viewed by others

References

  • Aleven V, Koedinger K (2002) An effective metacognitive strategy: learning by doing and explaining with a computer-based cognitive tutor. Cogn Sci 26:147–179

    Article  Google Scholar 

  • Annetta L (2008) Video games in education: why they should be used and how they are being used. Theory Pract 47(3):229–239

    Article  Google Scholar 

  • Annetta L (2010) The “I’s” have it: a framework for serious educational game design. Rev General Psychol 14(2):105–112

    Article  Google Scholar 

  • Annetta LA, Murray MR, Laird SG, Bohr SC, Park JC (2006) Serious games: incorporating video games in the classroom. Educ Q 29(3):16

    Google Scholar 

  • Annetta LA, Lamb R, Bowling B, Cheng R (2011) Assessing engagement in Serious Educational Games: the development of the student engaged learning in a technology rich interactive classroom (SELTIC). Handbook of research on improving and motivation through educational games. IGI Global, Hershey (invited)

  • Annetta L, Lamb R, Minogue J, Folta E, Holmes S, Vallett D, Cheng R (2014) Safe science classrooms: teacher training through Serious Educational Games. Inf Sci 264:61–74

    Article  Google Scholar 

  • Arsalidou M, Pascual-Leone J, Johnson J, Morris D, Taylor MJ (2013) A balancing act of the brain: activations and deactivations driven by cognitive load. Brain Behav 3(3):273–285

    Article  Google Scholar 

  • Baeten M, Struyven K, Dochy F (2013) Student-centered teaching methods: can they optimize students’ approaches to learning in professional higher education? Studies in Educational Evaluation 39(1):14–22

    Article  Google Scholar 

  • Berteletti I, Man G, Booth JR (2015) How number line estimation skills relate to neural activations in single digit subtraction problems. NeuroImage 107:198–206

    Article  Google Scholar 

  • Best K, Butler S (2014) Virtual space: creating a place for social support in second life. Space Cult 20(1):93–121

    Google Scholar 

  • Chi MT, Siler SA, Jeong H (2004) Can tutors monitor students’ understanding accurately? Cogn Instruct 22(3):363–387

    Article  Google Scholar 

  • Cohen J, Cohen P (1983) Applied multiple regression/correlation analysis for the behavioral sciences, 2nd edn. Lawrence Erlbaum, Hillsdale

    Google Scholar 

  • Coller B, Scott M (2009) Effectiveness of using a video game to teach a course in mechanical engineering. Comput Educ 53(3):900–912

    Article  Google Scholar 

  • Connolly T, Stansfield M (2007) An application of games-based learning within software engineering. British Journal of Educational Technology 38(3):416

    Article  Google Scholar 

  • Cook L, Eignor D (2002) Using item response theory in test score equating. Int J Educ Res 13(2):161–173

    Article  Google Scholar 

  • Cook L, Eignor D (2005) IRT equating methods. Educ Meas Issues Pract 10(3):37–45

    Article  Google Scholar 

  • Cox JW (1928) Mechanical aptitude. Methuen, London

    Google Scholar 

  • Dalgarno B, Lee MJ (2010) What are the learning affordances of 3-D virtual environments? Br J Educ Technol 41(1):10–32

    Article  Google Scholar 

  • Davies D, Howe A, Collier C, Digby R, Earle S, McMahon K (2014) Teaching science and technology in the early years (3–7). Routledge, New York

    Google Scholar 

  • Eliceiri KW, Berthold MR, Goldberg IG, Ibáñez L, Manjunath BS, Martone ME, Carpenter AE (2012) Biological imaging software tools. Nat Methods 9(7):697–710

    Article  Google Scholar 

  • Fan X (1998) Item response theory and classical test theory (CTT): an empirical comparison of their item/person statistics. Educ Psychol Measur 58:357–381

    Article  Google Scholar 

  • Gilbert JK, de Jong O, Justi R, Treagust DF, van Driel JH (2003) Chemical education: towards research-based practice. Springer, New York

    Book  Google Scholar 

  • Gray P (2011) The decline of play and the rise of psychopathology in children and adolescents. Am J Play 3(4):443–463

    Google Scholar 

  • Green ME, McNeese MN (2011) using digital games and virtual environments to enhance learning. Learn Play Explor Future Educ Video Games 53:22–79

    Google Scholar 

  • Gregory RL (2015) Eye and brain: the psychology of seeing. University Press, Princeton

    Google Scholar 

  • Greiff S, Wüstenberg S, Molnár G, Fischer A, Funke J, Csapó B (2013) Complex problem solving in educational contexts—something beyond g: concept, assessment, measurement invariance, and construct validity. J Educ Psychol 105(2):364

    Article  Google Scholar 

  • Hannafin M, West R, Shepard C (2008) The cognitive demands of students-centered, web-based multimedia: current and emerging perspectives. IGI Global, Hershey

    Google Scholar 

  • Harris J, Hirsh-Pasek K, Newcombe NS (2013) Understanding spatial transformations: similarities and differences between mental rotation and mental folding. Cogn Process 14(2):105–115

    Article  Google Scholar 

  • Hegarty M, Montello DR, Richardson AE, Ishikawa T, Lovelace K (2006) Spatial abilities at different scales: individual differences in aptitude-test performance and spatial-layout learning. Intelligence 34(2):151–176

    Article  Google Scholar 

  • Howard J (2014) The importance of play. Found Early Child Princ Pract 1(22):20–45

    Google Scholar 

  • Hulme K, Kasprzak E, English K, Moore-Russo D, Lewis K (2009) Experiential learning in vehicle dynamics education via motion simulation and interactive gaming. Int J Comput Games Technol 2:1–15

    Article  Google Scholar 

  • Hwang GJ, Sung HY, Hung CM, Huang I, Tsai CC (2012) Development of a personalized educational computer game based on students’ learning styles. Education Tech Research Dev 60(4):623–638

    Article  Google Scholar 

  • Jamone L, Natale L, Nori F, Metta G, Sandini G (2012) Autonomous online learning of reaching behavior in a humanoid robot. Int J Humanoid Rob 9(3):1–26

    Google Scholar 

  • Jonassen DH, Grabowski BL (2012) Handbook of individual differences, learning, and instruction. Routledge, New York

    Google Scholar 

  • Kalyuga S (2012) Interactive distance education: a cognitive load perspective. J Comput High Educ 24(3):182–208

    Article  Google Scholar 

  • Kaplan DM (2013) The complex interplay between three-dimensional egocentric and allocentric spatial representation. Behav Brain Sci 36(5):553–554

    Article  Google Scholar 

  • Lamb RL (2013) The application of cognitive diagnostic approaches via neural network analysis of Serious Educational Games. Doctoral dissertation, George Mason University

  • Lamb R (2014) Examination of allostasis and online laboratory simulations in a middle school science classroom. Comput Hum Behav 39:224–234

    Article  Google Scholar 

  • Lamb RL, Annetta L (2013) The use of online modules and the effect on student outcomes in a high school chemistry class. J Sci Educ Technol 22(5):603–613

    Article  Google Scholar 

  • Lamb R, Premo J (2015) Computational modeling of teaching and learning through application of evolutionary algorithms. Computation 3(3):427–443

    Article  Google Scholar 

  • Lamb R, Annetta L, Firestone J (2015a) A meta-analysis with examination of moderators of student cognition, affect, and learning outcomes while using Serious Educational Games, Serious Games, and simulations in the science classroom. J Sci Educ Technol. (submitted)

  • Lamb RL, Annetta L, Meldrum J, Vallett D (2012) Measuring science interest: Rasch validation of the science interest survey. Int J Sci Math Educ 10(3):643–668

    Article  Google Scholar 

  • Lamb RL, Annetta L, Vallett DB, Sadler TD (2014a) Cognitive diagnostic like approaches using neural-network analysis of serious educational videogames. Comput Educ 70:92–104

    Article  Google Scholar 

  • Lamb R, Cavagnetto A, Akmal T (2014b) Examination of the nonlinear dynamic systems associated with science student cognition while engaging in science information processing. Int J Sci Math Educ 12(6):1–19

    Google Scholar 

  • Lamb RL, Vallett DB, Akmal T, Baldwin K (2014c) A computational modeling of student cognitive processes in science education. Comput Educ 79:116–125

    Article  Google Scholar 

  • Lamb RL, Vallett D, Annetta L (2014d) Development of a short-form measure of science and technology self-efficacy using Rasch analysis. J Sci Educ Technol 23(5):641–657

    Article  Google Scholar 

  • Lamb R, Akmal T, Petrie K (2015b) Development of a cognition-priming model describing learning in a STEM classroom. J Res Sci Teach 52(3):410–437

    Article  Google Scholar 

  • Lamb R, Annetta L, Vallett D (2015c) The interface of creativity, fluency, lateral thinking and technology while designing Serious Educational Games in a science classroom. Electron J Res Educ Psychol 13(2):219–242

    Article  Google Scholar 

  • Linacre J (2002) Immediate raw score to logit conversion. Rasch Meas Trans 16(2):825–877

    Google Scholar 

  • Linacre M, Wright B (2003) A user guide to bigsteps. Retrived from http://www.winsteps.com/a/bigsteps.pdf

  • Malec JF, Moessner AM, Kragness M, Lezak MD (2000) Refining a measure of brain injury sequal to predict post acute rehabilitation outcome: rating scale analysis of the Mayo-Portland Adaptability Inventory (MPAI). J Head Trauma Rehabil 15(1):670–682

    Article  Google Scholar 

  • Marmor GS (1975) Development of kinetic images: when does the child first represent movement in mental images? Cogn Psychol 7:548–559

    Article  Google Scholar 

  • Matzen NJ, Becnel K, Purpur G (2013) Pedagogical evolution in the teaching of reference services enabled by the use of 3D immersive virtual world technology. Adv Libr EducTechnol Innov Instruct Des 40(3):414–426

    Google Scholar 

  • Monahan T, McArdle G, Bertolotto M (2006) Virtual reality for collaborative e-learning. Comput Educ 50(4):1339–1353

    Article  Google Scholar 

  • Moran S, Luger E, Rodden T (2014) Exploring patterns as a framework for embedding consent mechanisms in human-agent collectives. In active media technology. Springer, New York, pp 475–486

    Google Scholar 

  • Muller DA (2008) Saying the wrong thing: improving learning with multimedia by including misconceptions. J Comput Assist Learn 24(2):144–155

    Article  Google Scholar 

  • Nadolny L, Woolfrey J, Pierlott M, Kahn S (2013) SciEthics Interactive: science and ethics learning in a virtual environment. Educ Tech Res Dev 61(6):979–999

    Article  Google Scholar 

  • Najafi H, Ellis S, Cox K, Calvert D (2007) Exploring the effect of computer mediated communication tools on online learners’ participation and learning: a review of research. In: Proceedings of world conference on e-learning in corporate, government, healthcare, and higher education, Chesapeake, VA

  • Nikolaidis A, Voss MW, Lee H, Vo LT, Kramer AF (2014) Parietal plasticity after training with a complex video game is associated with individual differences in improvements in an untrained working memory task. Front Hum Neurosci 8:1–11

    Article  Google Scholar 

  • Piaget J (1970) Science of education and the psychology of the child. Trans. D. Coltman

  • Pike MF, Maior HA, Porcheron M, Sharples SC, Wilson ML (2014) Measuring the effect of think aloud protocols on workload using fNIRS. In: Proceedings of the SIGCHI conference on human factors in computing systems. ACM, pp 3807–3816

  • Plank M, Snider J, Kaestner E, Halgren E, Poizner H (2014) Neurocognitive stages of spatial cognitive mapping measured during free exploration of a large-scale virtual environment. J Neurophysiol 113(3):740–753

    Article  Google Scholar 

  • Pruden SM, Levine SC, Huttenlocher J (2011) Children’s spatial thinking: does talk about the spatial world matter? Developmental Science 14(6):1417–1430

    Article  Google Scholar 

  • Resnick B, Inguito P, Orwig D, Yahiro JY, Hawkes W, Werner M, Magaziner J (2005) Treatment fidelity in behavior change research: a case example. Nurs Res 54(2):139–143

    Article  Google Scholar 

  • Rosser J, Paul L, Cuddihy L, Gentile D, Klonsky J, Merrell R (2007) The impact of video games on training surgeons in the 21st century. Arch Surg 142(2):181–186

    Article  Google Scholar 

  • Rutten N, van Joolingen WR, van der Veen JT (2012) The learning effects of computer simulations in science education. Comput Educ 58(1):136–153

    Article  Google Scholar 

  • Schroeder CM, Scott TP, Tolson H, Huang TY, Lee YH (2007) A meta-analysis of national research: effects of teaching strategies on student achievement in science in the United States. J Res Sci Teach 44(10):1436–1460

    Article  Google Scholar 

  • Shen J, Jiang S, Liu OL (2015) Reconceptualizing a college science learning experience in the new digital era: a review of literature. In: Emerging technologies for STEAM education. Springer, Gewerbestrasse, pp 61–79

  • Shute VJ (2011) Stealth assessment in computer-based games to support learning. Comput Games Instruct 55(2):503–524

    Google Scholar 

  • Spence I, Feng J (2010) Video games and spatial cognition. Rev General Psychol 14(2):92

    Article  Google Scholar 

  • Sprouse J (2011) A validation of Amazon Mechanical Turk for the collection of acceptability judgments in linguistic theory. Behav Res Methods 43(1):155–167

    Article  Google Scholar 

  • Tomasello M (2014) A natural history of human thinking. Harvard University Press, Boston

    Book  Google Scholar 

  • Tulving E, Kapur S, Craik FI, Moscovitch M, Houle S (1994) Hemispheric encoding/retrieval asymmetry in episodic memory: positron emission tomography findings. Proc Natl Acad Sci USA 91(6):2016–2020

    Article  Google Scholar 

  • Turner AJ (2014) Play to pay? Adolescent video game play & STEM choice. Communication and information technologies annual. Stud Media Commun 8:55–71

    Article  Google Scholar 

  • Vallett DB (2013) Factors influencing learner conceptions of force: exploring the interaction among visuospatial ability, motivation, and conceptions of newtonian mechanics in university undergraduates from an evolutionary perspective. Doctoral dissertation, George Mason University

  • Waight N, Liu X, Gregorius RM, Smith E, Park M (2014) Teacher conceptions and approaches associated with an immersive instructional implementation of computer-based models and assessment in a secondary chemistry classroom. Int J Sci Educ 36(3):467–505

    Article  Google Scholar 

  • Wu H, Shah P (2004) Exploring visuospatial thinking in chemistry learning. Sci Educ 88:465–492

    Article  Google Scholar 

  • Wu WH, Chiou WB, Kao HY, Hu CHA, Huang SH (2012) Re-exploring game-assisted learning research: the perspective of learning theoretical bases. Comput Educ 59(4):1153–1161

    Article  Google Scholar 

  • Young JQ, Van Merrienboer J, Durning S, Ten Cate O (2014) Cognitive load theory: implications for medical education: aMEE guide no. 86. Med Teach 36(5):371–384

    Article  Google Scholar 

  • Yudelson MV, Koedinger KR, Gordon GJ (2013) Individualized Bayesian knowledge tracing models. In Artificial intelligence in education. Springer, Berlin, pp 171–180

  • Zimmermann W, Cunningham S (eds) (1991) Visualization in teaching and learning mathematics. Committee on Computers in Mathematics Education of the Mathematical Association of America, Washington, DC

Download references

Acknowledgments

The author of this study wishes to acknowledge the support of the Washington State University Partnership for the study of Learning and Learning Environments specifically the Neurocognition Science Laboratory and the Immersive Science Leaning Environment Laboratory.

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Richard L. Lamb.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Lamb, R.L. Examination of the Effects of Dimensionality on Cognitive Processing in Science: A Computational Modeling Experiment Comparing Online Laboratory Simulations and Serious Educational Games. J Sci Educ Technol 25, 1–15 (2016). https://doi.org/10.1007/s10956-015-9587-z

Download citation

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s10956-015-9587-z

Keywords

Navigation