Skip to main content

Using Eye Tracking to Measure User Engagement with a Decision Aid

  • Conference paper
  • First Online:
Augmented Cognition (HCII 2023)

Abstract

Eye tracking has become the gold standard in measuring human attention and information-processing behavior. As such, eye tracking in mixed-methods user experience (UX) research serves as an invaluable tool to learn about user needs and to create actionable insights for improving product and service design during the development cycle. Here, we discuss the iterative process that we used to improve the design of a decision aid (DA) developed to facilitate shared decision making. We explain the use of eye tracking during this process to examine how users processed the information provided by the DA. We also explain how we used eye tracking in a retrospective “think-aloud” protocol to gain insight about users’ needs. Our results show that user reactions captured by eye tracking can not only be used to optimize design decisions but also to gather user feedback about their information processing needs.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 69.99
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 89.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

References

  • Albert, B., Tullis, T.: Measuring the user experience: collecting, analyzing, and presenting usability metrics. Newnes (2013)

    Google Scholar 

  • Barry, M.J., Edgman-Levitan, S.: Shared decision making — the pinnacle of patient-centered care. N. Engl. J. Med. 366(9), 780–781 (2012). https://doi.org/10.1056/NEJMp1109283

    Article  Google Scholar 

  • Djamasbi, S.: Eye tracking and web experience AIS. Trans. Hum.-Comput. Interact. 6(2), 37–54 (2014)

    Google Scholar 

  • Djamasbi, S., Chen, P., Shojaeizadeh, M., Rochford, J.: Text simplification and generation Y: an eye tracking study. In: SIGHCI 2016 Proceedings, p. 12 (2016)

    Google Scholar 

  • Djamasbi, S., Siegel, M., Tullis, T.S.: Faces and viewing behavior: an exploratory investigation. AIS Trans. Hum. Comput. Interact. 4(3), 190–211 (2012)

    Article  Google Scholar 

  • Djamasbi, S., Strong, D.: User experience-driven innovation in smart and connected worlds. AIS Trans. Hum. Comput. Interact. 11(4), 215–231 (2019)

    Article  Google Scholar 

  • Eger, N., Ball, L.J., Stevens, R., Dodd, J.: Cueing retrospective verbal reports in usability testing through eye-movement replay. In: Proceedings of HCI 2007 The 21st British HCI Group Annual Conference University of Lancaster, UK 21, pp. 1–9, September 2007

    Google Scholar 

  • Elling, S., Lentz, L., de Jong, M.: Combining concurrent think-aloud protocols and eye-tracking observations: an analysis of verbalizations and silences. IEEE Trans. Prof. Commun. 55(3), 206–220 (2012). https://doi.org/10.1109/TPC.2012.2206190

    Article  Google Scholar 

  • Gaffiero, D., Elander, J., Maratos, F.: Do individuals with chronic pain show attentional bias to pain-related information? An early stage systematic review of the eye-tracking evidence. Cogn. Psychol. Bull 4, 37–45 (2019)

    Article  Google Scholar 

  • Goostrey, K.J., et al.: Adapting a traumatic brain injury goals-of-care decision aid for critically ill patients to intracerebral hemorrhage and hemispheric acute ischemic stroke. Crit. Care Explor. 3(3), e0357 (2021). https://doi.org/10.1097/cce.0000000000000357

    Article  Google Scholar 

  • Muehlschlegel, S., et al.: Goals-of-care decision aid for critically ill patients with TBI. Neurology 95(2), e179 (2020). https://doi.org/10.1212/WNL.0000000000009770

    Article  Google Scholar 

  • Norouzi Nia, J., Varzgani, F., Djamasbi, S., Tulu, B., Lee, C., Muehlschlegel, S.: Visual hierarchy and communication effectiveness in medical decision tools for surrogate-decision-makers of critically Ill traumatic brain injury patients. In: Schmorrow, D.D., Fidopiastis, C.M. (eds.) HCII 2021. LNCS (LNAI), vol. 12776, pp. 210–220. Springer, Cham (2021). https://doi.org/10.1007/978-3-030-78114-9_15

    Chapter  Google Scholar 

  • Poole, A., Ball, L.J.: Eye tracking in human-computer interaction and usability research: current status and future prospects. Encyclopedia Hum.-Comput. Interact. 211–219 (2005)

    Google Scholar 

  • Scalia, P., et al.: Comparing the impact of an icon array versus a bar graph on preference and understanding of risk information: results from an online, randomized study. PLoS ONE 16(July) (2021). https://doi.org/10.1371/journal.pone.0253644

  • Schiessl, M., Duda, S., Thölke, A., Fischer, R.: Eye tracking and its application in usability and media research. MMI-interaktiv J. 6(2003), 41–50 (2003)

    Google Scholar 

  • UserZoom. (2022). State of UX report: Bridging the gap between UX insights and business impact (2022). https://info.userzoom.com/rs/293-RDJ-600/images/UserZoom_State_of_UX_22.pdf

  • Wu, X., Xue, C., Zhou, F.: An experimental study on visual search factors of information features in a task monitoring interface. In: Kurosu, M. (ed.) HCI 2015. LNCS, vol. 9171, pp. 525–536. Springer, Cham (2015). https://doi.org/10.1007/978-3-319-21006-3_50

    Chapter  Google Scholar 

Download references

Acknowledgement

. Research reported in this publication was supported by the National Institute of Nursing Research of the National Institutes of Health under Award Number R21NR020231. The content is solely the responsibility of the authors and does not necessarily represent the official views of the National Institutes of Health.

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Doaa Alrefaei .

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2023 The Author(s), under exclusive license to Springer Nature Switzerland AG

About this paper

Check for updates. Verify currency and authenticity via CrossMark

Cite this paper

Alrefaei, D. et al. (2023). Using Eye Tracking to Measure User Engagement with a Decision Aid. In: Schmorrow, D.D., Fidopiastis, C.M. (eds) Augmented Cognition. HCII 2023. Lecture Notes in Computer Science(), vol 14019. Springer, Cham. https://doi.org/10.1007/978-3-031-35017-7_5

Download citation

  • DOI: https://doi.org/10.1007/978-3-031-35017-7_5

  • Published:

  • Publisher Name: Springer, Cham

  • Print ISBN: 978-3-031-35016-0

  • Online ISBN: 978-3-031-35017-7

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics