Jonas Blattgerste
Patrick Renner
Thies Pfeiffer
ABSTRACT
The current best practice for hands-free selection using Virtual and Augmented Reality (VR/AR) head-mounted displays is to use head-gaze for aiming and dwell-time or clicking for triggering the selection. There is an observable trend for new VR and AR devices to come with integrated eye-tracking units to improve rendering, to provide means for attention analysis or for social interactions. Eye-gaze has been successfully used for human-computer interaction in other domains, primarily on desktop computers. In VR/AR systems, aiming via eye-gaze could be significantly faster and less exhausting than via head-gaze.
To evaluate benefits of eye-gaze-based interaction methods in VR and AR, we compared aiming via head-gaze and aiming via eye-gaze. We show that eye-gaze outperforms head-gaze in terms of speed, task load, required head movement and user preference. We furthermore show that the advantages of eye-gaze further increase with larger FOV sizes.
- Tobii AB. 2015. Tobii Pro VR Integration based on HTC Vive HMD. (Oct. 2015). https://www.tobiipro.com/product-listing/vr-integration/Google Scholar
- Kevin Arthur. 2000. Effects of field of view on performance with head-mounted displays. Ph.D. Dissertation. University of North Carolina at Chapel Hill. http://wwwx.cs.unc.edu/Research/eve/dissertations/2000-Arthur.pdf Google ScholarDigital Library
- ASTRI. 2018. OmniVision and ASTRI Create Production-Ready Reference Design for AR Glasses. (2018). https://www.astri.org/news-detail/omnivision-and-astri-create-production-ready-reference-design-for-ar-glasses/Google Scholar
- William S Cleveland. 1981. LOWESS: A program for smoothing scatterplots by robust locally weighted regression. The American Statistician 35, 1 (1981), 54--54.Google ScholarCross Ref
- Meta Company. 2017. Meta | Augmented Reality. (2017). http://www.metavision.comGoogle Scholar
- Nathan Cournia, John D. Smith, and Andrew T. Duchowski. 2003. Gaze- vs. Hand-based Pointing in Virtual Environments. In CHI '03 Extended Abstracts on Human Factors in Computing Systems (CHI EA '03). ACM, New York, NY, USA, 772--773. Google ScholarDigital Library
- Paul M. Fitts. 1954. The Information Capacity of the Human Motor System in Controlling the Amplitude of Movement. Journal of Experimental Psychology 47, 6 (1954), 381.Google ScholarCross Ref
- Brian Guenter, Mark Finch, Steven Drucker, Desney Tan, and John Snyder. 2012. Foveated 3D Graphics. ACM Trans. Graph. 31, 6 (Nov. 2012), 164:1--164:10. Google ScholarDigital Library
- John Paulin Hansen, Kristian Tørning, Anders Sewerin Johansen, Kenji Itoh, and Hirotaka Aoki. 2004. Gaze Typing Compared with Input by Head and Hand. In Proceedings of the 2004 Symposium on Eye Tracking Research & Applications (ETRA '04). ACM, New York, NY, USA, 131--138. Google ScholarDigital Library
- Tobias Höllerer and Steve Feiner. 2004. Mobile augmented reality. Telegeoinformatics: Location-Based Computing and Services. Taylor and Francis Books Ltd., London, UK 21 (2004). 00533. Google ScholarDigital Library
- Felix Hülsmann, Timo Dankert, and Thies Pfeiffer. 2011. Comparing gaze-based and manual interaction in a fast-paced gaming task in Virtual Reality. In Proceedings of the Workshop Virtuelle & Erweiterte Realität 2011. https://pub.uni-bielefeld.de/publication/2308550Google Scholar
- FOVE Inc. 2017. FOVE. (2017). https://www.getfove.com/Google Scholar
- Sensomotoric Instruments. 2016. Imprint SensoMotoric Instruments. (2016). https://www.smivision.com/eye-tracking/imprintGoogle Scholar
- Robert J. K. Jacob. 1990. What You Look at is What You Get: Eye Movement-based Interaction Techniques. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI '90). ACM, New York, NY, USA, 11--18. Google ScholarDigital Library
- C. Lee, S. Bonebrake, D. A. Bowman, and T. Höllerer. 2010. The role of latency in the validity of AR simulation. In 2010 IEEE Virtual Reality Conference (VR). 11--18. Google ScholarDigital Library
- C. Lee, S. Bonebrake, T. Hollerer, and D. A. Bowman. 2009. A Replication Study Testing the Validity of AR Simulation in VR for Controlled Experiments. In 2009 8th IEEE International Symposium on Mixed and Augmented Reality. 203--204. Google ScholarDigital Library
- C. Lee, G. A. Rincon, G. Meyer, T. Höllerer, and D. A. Bowman. 2013. The Effects of Visual Realism on Search Tasks in Mixed Reality Simulation. IEEE Transactions on Visualization and Computer Graphics 19, 4 (April 2013), 547--556. Google ScholarDigital Library
- Jae-Young Lee, Hyung-Min Park, Seok-Han Lee, Soon-Ho Shin, Tae-Eun Kim, and Jong-Soo Choi. 2011. Design and implementation of an augmented reality system using gaze interaction. Multimedia Tools and Applications 68, 2 (Dec. 2011), 265--280. Google ScholarDigital Library
- Marc Levoy and Ross Whitaker. 1990. Gaze-directed Volume Rendering. In Proceedings of the 1990 Symposium on Interactive 3D Graphics (I3D '90). ACM, New York, NY, USA, 217--223. 00137. Google ScholarDigital Library
- LooxidLabs. 2017. LooxidLabs HomePage. (2017). http://looxidlabs.com/Google Scholar
- I. Scott MacKenzie. 1992. Fitts' Law As a Research and Design Tool in Human-computer Interaction. Hum.-Comput. Interact. 7, 1 (March 1992), 91--139. Google ScholarDigital Library
- Päivi Majaranta and Richard Bates. 2009. Special issue: Communication by gaze interaction. Universal Access in the Information Society 8, 4 (March 2009), 239--240. 00000. Google ScholarDigital Library
- Päivi Majaranta and Andreas Bulling. 2014. Eye Tracking and Eye-Based Human-Computer Interaction. In Advances in Physiological Computing. Springer, London, 39--65. https://link.springer.com/chapter/10.1007/978-1-4471-6392-3_3Google Scholar
- Martin Meißner, Jella Pfeiffer, Thies Pfeiffer, and Harmen Oppewal. 2017. Combining virtual reality and mobile eye tracking to provide a naturalistic experimental environment for shopper research. Journal of Business Research (2017).Google Scholar
- Cem Memili, Thies Pfeiffer, and Patrick Renner. 2016. Bestimmung von Nutzerpräferenzen für Augmented-Reality Systeme durch Prototyping in einer Virtual-Reality Simulation. In Virtuelle und Erweiterte Realität - 13. Workshop der GI-Fachgruppe VR/AR. https://pub.uni-bielefeld.de/publication/2905704Google Scholar
- Microsoft. 2016. Microsoft HoloLens. (2016). https://www.microsoft.com/de-de/hololensGoogle Scholar
- Darius Miniotas. 2000. Application of Fitts' Law to Eye Gaze Interaction. In CHI '00 Extended Abstracts on Human Factors in Computing Systems (CHI EA '00). ACM, New York, NY, USA, 339--340. Google ScholarDigital Library
- Susanna Nilsson, Torbjörn Gustafsson, and Per Carleberg. 2009. Hands Free Interaction with Virtual Information in a Real Environment: Eye Gaze as an Interaction Tool in an Augmented Reality System. PsychNology Journal 7, 2 (Aug. 2009), 175--196.Google Scholar
- Hyung Min Park, Seok Han Lee, and Jong Soo Choi. 2008. Wearable Augmented Reality System Using Gaze Interaction. In Proceedings of the 7th IEEE/ACM International Symposium on Mixed and Augmented Reality (ISMAR '08). IEEE Computer Society, Washington, DC, USA, 175--176. Google ScholarDigital Library
- Yuan Yuan Qian and Robert J. Teather. 2017. The Eyes Don'T Have It: An Empirical Comparison of Head-based and Eye-based Selection in Virtual Reality. In Proceedings of the 5th Symposium on Spatial User Interaction (SUI '17). ACM, New York, NY, USA, 91--98. Google ScholarDigital Library
- E. Ragan, C. Wilkes, D. A. Bowman, and T. Hollerer. 2009. Simulation of Augmented Reality Systems in Purely Virtual Environments. In 2009 IEEE Virtual Reality Conference. 287--288. Google ScholarDigital Library
- Linda E. Sibert and Robert J. K. Jacob. 2000. Evaluation of Eye Gaze Interaction. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI '00). ACM, New York, NY, USA, 281--288. Google ScholarDigital Library
- Erik Steindecker, Ralph Stelzer, and Bernhard Saske. 2014. Requirements for Virtualization of AR Displays within VR Environments. In Virtual, Augmented and Mixed Reality. Designing and Developing Virtual and Augmented Environments, Randall Shumaker and Stephanie Lackey (Eds.). Number 8525 in Lecture Notes in Computer Science. Springer International Publishing, 105--116. http://link.springer.com/chapter/10.1007/978-3-319-07458-0_11 Google ScholarDigital Library
- Vildan Tanriverdi and Robert J. K. Jacob. 2000. Interacting with Eye Movements in Virtual Environments. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI '00). ACM, New York, NY, USA, 265--272. Google ScholarDigital Library
- Takumi Toyama, Daniel Sonntag, Jason Orlosky, and Kiyoshi Kiyokawa. 2015. Attention Engagement and Cognitive State Analysis for Augmented Reality Text Display Functions. In Proceedings of the 20th International Conference on Intelligent User Interfaces (IUI '15). ACM, New York, NY, USA, 322--332. Google ScholarDigital Library
- William N Venables and Brian D Ripley. 2013. Modern applied statistics with S-PLUS. Springer Science & Business Media. Google ScholarDigital Library
- A. M. Wafaa, N. D. Bonnefoy, E. Dubois, P. Torguet, and J. P. Jessel. 2008. Virtual Reality Simulation for Prototyping Augmented Reality. In 2008 International Symposium on Ubiquitous Virtual Reality. 55--58. Google ScholarDigital Library
- Colin Ware and Harutune H. Mikaelian. 1987. An Evaluation of an Eye Tracker As a Device for Computer Input. In Proceedings of the SIGCHI/GI Conference on Human Factors in Computing Systems and Graphics Interface (CHI '87). ACM, New York, NY, USA, 183--188. Google ScholarDigital Library
- Jacob O Wobbrock, Leah Findlater, Darren Gergle, and James J Higgins. 2011. The aligned rank transform for nonparametric factorial analyses using only anova procedures. In Proceedings of the SIGCHI conference on human factors in computing systems. ACM, 143--146. Google ScholarDigital Library
Index Terms
- Advantages of eye-gaze over head-gaze-based selection in virtual and augmented reality under varying field of views
Recommendations
The Eye in Extended Reality: A Survey on Gaze Interaction and Eye Tracking in Head-worn Extended Reality
With innovations in the field of gaze and eye tracking, a new concentration of research in the area of gaze-tracked systems and user interfaces has formed in the field of Extended Reality (XR). Eye trackers are being used to explore novel forms of spatial ...
A Design Space for Gaze Interaction on Head-mounted Displays
CHI '19: Proceedings of the 2019 CHI Conference on Human Factors in Computing SystemsAugmented and virtual reality (AR/VR) has entered the mass market and, with it, will soon eye tracking as a core technology for next generation head-mounted displays (HMDs). In contrast to existing gaze interfaces, the 3D nature of AR and VR requires ...
Extending Virtual Reality Display Wall Environments Using Augmented Reality
SUI '19: Symposium on Spatial User InteractionTwo major form factors for virtual reality are head-mounted displays and large display environments such as CAVE®and the LCD-based successor CAVE2®. Each of these has distinct advantages and limitations based on how they’re used. This work explores ...
Comments