Argenis Ramirez Gomez
ABSTRACT
Gaze interaction paradigms rely on the user needing to look at objects in the interface to select them or trigger actions. ”Not looking” is an atypical and unexpected interaction to perform, but the eye-tracker can sense it. We illustrate the use of ”not looking” as an interaction dynamic with examples of gaze-enabled games. We created a framework containing a spectrum of five discrete categories for this unexpected use of gaze sensing. For each category, we analyse games that use gaze interaction and make the user look away from the game action up to the extent they close their eyes. The framework is described based on whether specific game events mean the player might not; cannot; should not; must not; or does not look. Finally, we discuss the outcomes of using unexpected gaze interactions and the potential of the proposed framework as a new approach to guide the design of sensing-based interfaces.
- Richard Bates, Stephen Vickers, and Howell O Istance. 2010. Gaze interaction with virtual on-line communities: levelling the playing field for disabled users. Universal Access in the Information Society 9, 3 (2010), 261–272.Google Scholar
Digital Library
- Steve Benford, Holger Schnädelbach, Boriana Koleva, Rob Anastasi, Chris Greenhalgh, Tom Rodden, Tom Rodden, Jonathan Green, Ahmed Ghali, Tony Pridmore, 2005. Expected, sensed, and desired: A framework for designing sensing-based interaction. ACM Transactions on Computer-Human Interaction (TOCHI) 12, 1(2005), 3–30.Google ScholarDigital Library
- Marcus Carter, Joshua Newn, Eduardo Velloso, and Frank Vetere. 2015. Remote gaze and gesture tracking on the microsoft kinect: Investigating the role of feedback. In Proceedings of the Annual Meeting of the Australian Special Interest Group for Computer Human Interaction. ACM, 167–176.Google ScholarDigital Library
- Emiliano Castellina and Fulvio Corno. 2008. Multimodal gaze interaction in 3D virtual environments. COGAIN 8(2008), 33–37.Google Scholar
- Matthieu Perreira Da Silva, Vincent Courboulay, and Armelle Prigent. 2007. Gameplay experience based on a gaze tracking system. In ”Gaze-based Creativity, Interacting with Games and On-line Communities” INPROCEEDINGS in proceedings of COGAIN 2007 (Communication by Gaze Interaction IST FP6 European Project). 25–28.Google Scholar
- Inger M Ekman, Antti W Poikola, and Meeri K Mäkäräinen. 2008. Invisible eni: using gaze and pupil size to control a game. In CHI’08 extended abstracts on Human factors in computing systems. ACM, 3135–3140.Google Scholar
- Massive Entertainment. 2019. Tom Clancy’s The Division 2. Game.Google Scholar
- William W Gaver, Jacob Beaver, and Steve Benford. 2003. Ambiguity as a resource for design. In Proceedings of the SIGCHI conference on Human factors in computing systems. ACM, 233–240.Google ScholarDigital Library
- Sébastien Hillaire, Anatole Lécuyer, Rémi Cozot, and Géry Casiez. 2008. Using an eye-tracking system to improve camera motions and depth-of-field blur effects in virtual environments. In Virtual Reality Conference, 2008. VR’08. IEEE. IEEE, 47–50.Google ScholarCross Ref
- Chien-Ming Huang, Sean Andrist, Allison Sauppé, and Bilge Mutlu. 2015. Using gaze patterns to predict task intent in collaboration. Frontiers in psychology 6 (2015), 1049.Google Scholar
- Poika Isokoski, Markus Joos, Oleg Spakov, and Benoît Martin. 2009. Gaze controlled games. Universal Access in the Information Society 8, 4 (2009), 323–337.Google ScholarDigital Library
- Robert J. K. Jacob. 1990. What you look at is what you get: eye movement-based interaction techniques. In Proceedings of the SIGCHI conference on Human factors in computing systems: Empowering people(CHI ’90). ACM, New York, NY, USA, 11–18. https://doi.org/10.1145/97243.97246Google ScholarDigital Library
- Aleksandra Królak and Paweł Strumiłło. 2012. Eye-blink detection system for human–computer interaction. Universal Access in the Information Society 11, 4 (2012), 409–419.Google ScholarDigital Library
- Michael Lankes, Bernhard Maurer, and Barbara Stiglbauer. 2016. An eye for an eye: Gaze input in competitive online games and its effects on social presence. In Proceedings of the 13th International Conference on Advances in Computer Entertainment Technology. ACM, 17.Google ScholarDigital Library
- Michael Lankes, Thomas Mirlacher, Stefan Wagner, and Wolfgang Hochleitner. 2014. Whom are you looking for?: the effects of different player representation relations on the presence in gaze-based games. In Proceedings of the first ACM SIGCHI annual symposium on Computer-human interaction in play. ACM, 171–179.Google ScholarDigital Library
- Michael Lankes and Barbara Stiglbauer. 2016. GazeAR: Mobile gaze-based interaction in the context of augmented reality games. In International Conference on Augmented Reality, Virtual Reality and Computer Graphics. Springer, 397–406.Google ScholarCross Ref
- Lennart Erik Nacke, Michael Kalyn, Calvin Lough, and Regan Lee Mandryk. 2011. Biofeedback game design: using direct and indirect physiological control to enhance game interaction. In Proceedings of the SIGCHI conference on human factors in computing systems. ACM, 103–112.Google ScholarDigital Library
- Lennart E Nacke, Sophie Stellmach, Dennis Sasse, and Craig A Lindley. 2010. Gameplay experience in a gaze interaction game. arXiv preprint arXiv:1004.0259(2010).Google Scholar
- Joshua Newn, Fraser Allison, Eduardo Velloso, and Frank Vetere. 2018. Looks can be deceiving: Using gaze visualisation to predict and mislead opponents in strategic gameplay. In Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems. ACM, 261.Google ScholarDigital Library
- Kher Hui Ng, Steve Benford, and Boriana Koleva. 2005. PINS push in and POUTS pop out: creating a tangible pin-board that ejects physical documents. In CHI’05 Extended Abstracts on Human Factors in Computing Systems. ACM, 1981–1984.Google Scholar
- Kher Hui Ng, Boriana Koleva, and Steve Benford. 2007. The iterative development of a tangible pin-board to symmetrically link physical and digital documents. Personal and Ubiquitous Computing 11, 3 (2007), 145–155.Google ScholarDigital Library
- J O’Donovan, J Ward, S Hodgins, and V Sundstedt. 2009. Rabbit run: Gaze and voice based game interaction. In Eurographics Ireland Workshop, December.Google Scholar
- Ken Pfeuffer, Jason Alexander, and Hans Gellersen. 2016. GazeArchers: Playing with Individual and Shared Attention in a Two-player Look&Shoot Tabletop Game. In Proceedings of the 15th International Conference on Mobile and Ubiquitous Multimedia(MUM ’16). ACM, New York, NY, USA, 213–216. https://doi.org/10.1145/3012709.3012717Google ScholarDigital Library
- Argenis Ramirez Gomez and Hans Gellersen. 2019. SuperVision: Playing with Gaze Aversion and Peripheral Vision. In Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems. ACM, 473.Google ScholarDigital Library
- Pedro Sanches, Kristina Hook, Corina Sas, and Anna Stahl. 2019. Ambiguity as a resource to inform proto-practices: The case of skin conductance. ACM Transactions on Computer-Human Interaction (TOCHI) (2019).Google ScholarDigital Library
- C Schaefer, R Menges, K Schmidt, M Kuich, and T Walber. 2014. Schau genau! an eye tracking game with a purpose. Applications for Gaze in Games(2014).Google Scholar
- J David Smith and TC Graham. 2006. Use of eye movements for video game control. In Proceedings of the 2006 ACM SIGCHI international conference on Advances in computer entertainment technology. ACM, 20.Google ScholarDigital Library
- India Starker and Richard A. Bolt. 1990. A Gaze-responsive Self-disclosing Display. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems(CHI ’90). ACM, New York, NY, USA, 3–10. https://doi.org/10.1145/97243.97245Google ScholarDigital Library
- Starbreeze Studios. 2013. Brothers: A Tale of Two Sons. Game.Google Scholar
- Techland. 2018. Dying Light: Bad Blood. Game.Google Scholar
- Ubisoft Montreal and Ubisoft Toronto. 2018. Far Cry 5. Game [Xbox][Windows][PlayStation].Google Scholar
- MUHTAR ÇAĞKAN ULUDAĞLIand CENGİZ ACARTÜRK. 2018. User interaction in hands-free gaming: a comparative study of gaze-voice and touchscreen interface control. Turkish Journal of Electrical Engineering & Computer Sciences 26, 4(2018), 1967–1976.Google ScholarCross Ref
- Boris Velichkovsky, Andreas Sprenger, and Pieter Unema. 1997. Towards gaze-mediated interaction: Collecting solutions of the ”Midas touch problem”. In Human-Computer Interaction INTERACT’97. Springer, 509–516.Google Scholar
- Eduardo Velloso, Carl Oechsner, Katharina Sachmann, Markus Wirth, and Hans Gellersen. 2015. Arcade+: A Platform for Public Deployment and Evaluation of Multi-Modal Games. In Proceedings of the 2015 Annual Symposium on Computer-Human Interaction in Play(CHI PLAY ’15). ACM, New York, NY, USA, 271–275. https://doi.org/10.1145/2793107.2793145Google ScholarDigital Library
- Melodie Vidal. 2014. Shynosaurs: A Game of Attention Dilemma. In Proceedings of the First ACM SIGCHI Annual Symposium on Computer-human Interaction in Play(CHI PLAY ’14). ACM, New York, NY, USA, 391–394. https://doi.org/10.1145/2658537.2662979Google ScholarDigital Library
- Melodie Vidal, Remi Bismuth, Andreas Bulling, and Hans Gellersen. 2015. The Royal Corgi: Exploring Social Gaze Interaction for Immersive Gameplay. In Proceedings of the 33rd Annual ACM Conference on Human Factors in Computing Systems(CHI ’15). ACM, New York, NY, USA, 115–124. https://doi.org/10.1145/2702123.2702163Google ScholarDigital Library
- Tom Wilcox, Mike Evans, Chris Pearce, Nick Pollard, and Veronica Sundstedt. 2008. Gaze and voice based game interaction: the revenge of the killer penguins.SIGGRAPH Posters 81(2008).Google Scholar
- Shumin Zhai, Carlos Morimoto, and Steven Ihde. 1999. Manual and gaze input cascaded (MAGIC) pointing. In Proceedings of the SIGCHI conference on Human Factors in Computing Systems. ACM, 246–253.Google ScholarDigital Library
Index Terms
- Exploring the Sensed and Unexpected: Not Looking in Gaze Interaction
Index terms have been assigned to the content through auto-classification.
Recommendations
Looking Outside the Box: Reflecting on Gaze Interaction in Gameplay
CHI PLAY '19: Proceedings of the Annual Symposium on Computer-Human Interaction in PlayGaze interaction in games moved from being a tool for accessibility to be at the core of mass-market game franchises, offering enhanced controller performance and greater immersion. We propose to explore three different popular gaze-based interaction ...
KryptonEyed: Playing with Gaze Without Looking
FDG '20: Proceedings of the 15th International Conference on the Foundations of Digital GamesAs eye-tracking technologies become more affordable, the number of mainstream gaze-enabled games increases. These allow triggering in-game actions when the eyes focus on objects and locations of interest. Such gaze interactions follow the interaction ...
More than Looking: Using Eye Movements Behind the Eyelids as a New Game Mechanic
CHI PLAY '20: Proceedings of the Annual Symposium on Computer-Human Interaction in PlayThe number of mainstream gaze-enabled games is rapidly increasing. They introduce gaze interactions based on the alignment of the eyes' focus on locations of interest. We challenge this traditional use of gaze and propose to play without looking. We ...
Comments