ABSTRACT
Prior research has shown that spatial abilities are crucial for STEM achievement and attainment. The connection between the digital and physical worlds provided by embodied interaction has been shown to enhance performance and engagement in educational contexts. Spatial reasoning is a domain that lends itself naturally to embodied, physical interaction; however, there is little understanding of how embodied interaction could be incorporated into educational technology designed to train spatial reasoning skills. We propose several guidelines for gestural interaction design in spatial reasoning education games based on an empirical study with students at a local afterschool program using a custom-built computer game for training spatial skills. We present a series of gesture sets derived from an iterative design approach that are easy for children to acquire, show sufficient congruency to specific spatial operations, and enable robust recognition from the system. We also compared children's behaviors when playing the game with our gestural interface and a traditional mouse-based interface and found that children take more time but fewer steps to complete game levels when using gestures.
- Dor Abrahamson and Robb Lindgren. 2014. The Cambridge handbook of the learning sciences (2nd ed.). Cambridge University Press, Cambridge, UK, Chapter Embodiment and embodied design.Google Scholar
- Lawrence W. Barsalou. 2010. Grounded Cognition: Past, Present, and Future. Topics in Cognitive Science 2, 4 (2010), 716--724.Google ScholarCross Ref
- E. L. Bjork and R. A. Bjork. 2011. Psychology and the real world: Essays illustrating fundamental contributions to society. Worth Publishers, New York, NY, USA, Chapter Making things hard on yourself, but in a good way: Creating desirable difficulties to enhance learning, 56--64.Google Scholar
- Jack Shen-Kuen Chang. 2017. The Design and Evaluation of Embodied Interfaces for Supporting Spatial Ability. In Proceedings of the Eleventh International Conference on Tangible, Embedded, and Embodied Interaction (TEI '17). ACM, New York, NY, USA, 681--684. Google ScholarDigital Library
- P. G. Clifton, J. S.-K. Chang, G. Yeboah, A. Doucette, S. Chandrasekharan, M. Nitsche, T. Welsh, and A Mazalek. 2016. Design of embodied interfaces for engaging spatial cognition. Cognitive Research 1, 24 (2016).Google Scholar
- Hubert L. Dreyfus and Stuart E. Dreyfus. 1999. The Challenge of Merleau-Ponty's Phenomenology of Embodiment for Cognitive Science. In Perspectives on Embodiment: The Intersections of Nature and Culture, Gail Weiss and Honi Fern Haber (Eds.). Routledge, 103--120.Google Scholar
- Efraim Fischbein. 1987. Intuition in Science and Mathematics: An Educational Approach. Springer, Dordrecht, Holland.Google Scholar
- Corinne Holmes, Steven A. Marchette, and Nora Newcombe. 2017. Multiple Views of Space: Continuous Visual Flow Enhances Small-Scale Spatial Learning. (02 2017).Google Scholar
- Daniel Kahneman. Maps of bounded rationality: A perspective on intuitive judgment and choice. (????).Google Scholar
- Robb Lindgren and Mina Johnson-Glenberg. 2013. Emboldened by Embodiment. Educational Researcher 42, 8 (2013), 445--452.Google ScholarCross Ref
- Robb Lindgren and J. Michael Moshell. 2011. Supporting Children's Learning with Body-based Metaphors in a Mixed Reality Environment. In Proceedings of the 10th International Conference on Interaction Design and Children (IDC '11). ACM, New York, NY, USA, 177--180. Google ScholarDigital Library
- Marcia C. Linn and Anne C. Petersen. 1985. Emergence and Characterization of Sex Differences in Spatial Ability: A Meta-Analysis. Child Development 56, 6 (1985), 1479--1498.0.1145/3030024.3038265Google ScholarCross Ref
- Ting Zhang, Yu-Ting Li, and Juan P. Wachs. 2016. The Effect of Embodied Interaction in Visual-Spatial Navigation. ACM Trans. Interact. Intell. Syst. 7, 1, Article 3 (Dec. 2016), 36 pages. 2160--6455 Google ScholarDigital Library
Index Terms
- Supporting Spatial Skill Learning with Gesture-Based Embodied Design
Recommendations
A Player-Centric Approach to Designing Spatial Skill Training Games
CHI '19: Proceedings of the 2019 CHI Conference on Human Factors in Computing SystemsCertain video games show promise as tools for training spatial skills, one of the strongest predictors of future success in STEM. However, little is known about the gaming preferences of those who would benefit the most from such interventions: low ...
Learning Spatial Reasoning in Virtual vs. Physical Games with Robots
HAI '23: Proceedings of the 11th International Conference on Human-Agent InteractionSpatial reasoning is one of the malleable skills well-suited to be developed using robotics that not only benefits children in their pursuit of STEM-related topics but also fosters their perspective-taking skills on dimensions beyond spatial skills. In ...
Determining if Spatial Reasoning is Required to Learn CS
ICER '17: Proceedings of the 2017 ACM Conference on International Computing Education ResearchSpatial reasoning may be a strong predictor for a career in Computer Science (CS) [9]. However, it is unclear why and how spatial abilities lead to success in CS. Investigating the role of spatial reasoning in learning CS may be important for broadening ...
Comments