Abstract
This paper explores Pointer Assisted Reading (PAR), a reading behavior consisting of moving the mouse cursor (also known as the pointer) along sentences to mark the reading position, similarly to finger-pointing when reading a book. The study shows that PAR is an uncommon reading technique and examines methods to extract and visualize the PAR activity of web users. An analysis shows that PAR data of real users reveal reading properties, such as speed, and reading patterns, such as skipping and rereading. Eye-tracking is usually used to analyze user reading behaviors. This paper advocates for considering PAR-tracking as a feasible alternative to eye-tracking on websites, as tracking the eye gaze of ordinary web users is usually impractical. PAR data might help in spotting quality issues in the textual content of a website, such as unclear text or content that might not interest the website users, based on analyzing reading properties and patterns (e.g. reading speed, skipping, and rereading). Accordingly, PAR-tracking may have various practical applications in a wide range of fields, and particularly in educational technology, e-learning, and web analytics.
Keywords
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
References
Asvestopoulou, T., Manousaki, V., Psistakis, A., Andreadakis, V., Aslanides, I., Papadopouli, M.: DysLexML: screening tool for dyslexia using machine learning, pp. 1–6. ArXiv abs/1903.06274, March 2019
Biedert, R., Hees, J., Dengel, A., Buscher, G.: A robust realtime reading-skimming classifier. In: Proceedings of the Symposium on Eye Tracking Research and Applications, ETRA 2012, pp 123–130. Association for Computing Machinery, New York (2012). https://doi.org/10.1145/2168556.2168575
Cepeda, C., et al.: Mouse tracking measures and movement patterns with application for online surveys. In: Holzinger, A., Kieseberg, P., Tjoa, A.M., Weippl, E. (eds.) CD-MAKE 2018. LNCS, vol. 11015, pp. 28–42. Springer, Cham (2018). https://doi.org/10.1007/978-3-319-99740-7_3
Chen, M.C., Anderson, J.R., Sohn, M.H.: What can a mouse cursor tell us more? correlation of eye/mouse movements on web browsing. In: CHI 2001 Extended Abstracts on Human Factors in Computing Systems, CHI EA 2001, pp. 281–282. Association for Computing Machinery, New York (2001)
Claypool, M., Le, P., Wased, M., Brown, D.: Implicit interest indicators. In: Proceedings of the 6th International Conference on Intelligent User Interfaces, IUI 2001, pp. 33–40. Association for Computing Machinery, New York (2001). https://doi.org/10.1145/359784.359836
Conlen, M., Kale, A., Heer, J.: Capture & analysis of active reading behaviors for interactive articles on the web. Comput. Graph. Forum 38(3), 687–698 (2019). https://onlinelibrary.wiley.com/doi/abs/10.1111/cgf.13720https://doi.org/10.1111/cgf.13720
Dirix, N., Vander Beken, H., De Bruyne, E., Brysbaert, M., Duyck, W.: Reading text when studying in a second language: an eye-tracking study. Read. Res. Q. (2019). https://doi.org/10.1002/rrq.277
Eraslan, S., Yesilada, Y., Harper, S.: “The best of both worlds!”: integration of web page and eye tracking data driven approaches for automatic AOI detection. ACM Trans. Web 14(1), 1–31 (2020)
Gilliam Haije, E.: Are session recording tools a risk to internet privacy (2018). https://mopinion.com/are-session-recording-tools-a-risk-to-internet-privacy/
Guo, Q., Agichtein, E.: Exploring mouse movements for inferring query intent. In: Proceedings of the 31st Annual International ACM SIGIR Conference on Research and Development in Information Retrieval, SIGIR 2008, pp. 707–708. Association for Computing Machinery, New York (2008). https://doi.org/10.1145/1390334.1390462
Hernandez, M., Wang, Y., Sheng, H., Kalliny, M., Minor, M.: Escaping the corner of death? an eye-tracking study of reading direction influence on attention and memory. J. Consum. Mark. 34, 1–10 (2017). https://doi.org/10.1108/JCM-02-2016-1710
Huang, J., White, R., Buscher, G.: User see, user point: gaze and cursor alignment in web search. In: Proceedings of the SIGCHI Conference on Human Factors in Computing Systems, CHI 2012, pp. 1341–1350. Association for Computing Machinery, New York (2012)
Iqbal, S., Bailey, B.: Using eye gaze patterns to identify user tasks. In: The Grace Hopper Celebration of Women in Computing, vol. 04, January 2004
Jarodzka, H., Brand-Gruwel, S.: Tracking the reading eye: towards a model of real-world reading. J. Comput. Assist. Learn. 33(3), 193–201 (2017). https://onlinelibrary.wiley.com/doi/abs/10.1111/jcal.12189. https://doi.org/10.1111/jcal.12189
Javed, Y., Shehab, M.: Look before you authorize: Using eye-tracking to enforce user attention towards application permissions. Proc. Priv. Enhancing Technol. 2017(2), 23–37 (2017). https://content.sciendo.com/view/journals/popets/2017/2/article-p23.xml
Kirsh, I.: Directions and speeds of mouse movements on a website and reading patterns: a web usage mining case study. In: Proceedings of the 10th International Conference on Web Intelligence, Mining and Semantics (WIMS 2020), Biarritz, France, pp. 129–138. Association for Computing Machinery, New York, June 2020. https://doi.org/10.1145/3405962.3405982
Kirsh, I., Joy, M.: A different web analytics perspective through copy to clipboard heatmaps. In: Bielikova, M., Mikkonen, T., Pautasso, C. (eds.) ICWE 2020. LNCS, vol. 12128, pp. 543–546. Springer, Cham (2020). https://doi.org/10.1007/978-3-030-50578-3_41
Kirsh, I., Joy, M.: Splitting the web analytics atom: from page metrics and KPIs to sub-page metrics and KPIs. In: Proceedings of the 10th International Conference on Web Intelligence, Mining and Semantics (WIMS 2020), Biarritz, France, pp. 33–43. Association for Computing Machinery, New York, June 2020. https://doi.org/10.1145/3405962.3405984
Kirsh, I., Joy, M., Kirsh, Y.: Horizontal mouse movements (HMMs) on web pages as indicators of user interest. In: Proceedings of the 22nd HCI International Conference (HCII 2020), Communications in Computer and Information Science. Springer, Cham, July 2020
Lamberti, F., Paravati, G., Gatteschi, V., Cannavò, A.: Supporting web analytics by aggregating user interaction data from heterogeneous devices using viewport-DOM-based heat maps. IEEE Trans. Industr. Inf. 13, 1989–1999 (2017)
Lamberti, F., Paravati, G.: VDHM: viewport-DOM based heat maps as a tool for visually aggregating web users’ interaction data from mobile and heterogeneous devices. In: Proceedings of the 2015 IEEE International Conference on Mobile Services, MS 2015, USA, pp. 33–40. IEEE Computer Society (2015)
Lee, J., Ahn, J.H.: Attention to banner ads and their effectiveness: an eye-tracking approach. Int. J. Electron. Commer. 17(1), 119–137 (2012). https://doi.org/10.2753/JEC1086-4415170105
Li, Y., Xu, P., Lagun, D., Navalpakkam, V.: Towards measuring and inferring user interest from gaze. In: Proceedings of the 26th International Conference on World Wide Web Companion, WWW 2017 Companion, International World Wide Web Conferences Steering Committee, Republic and Canton of Geneva, CHE, pp. 525–533 (2017). https://doi.org/10.1145/3041021.3054182
Milisavljevic, A., Hamard, K., Petermann, C., Gosselin, B., Doré-Mazars, K., Mancas, M.: Eye and mouse coordination during task: from behaviour to prediction. In: International Conference on Human Computer Interaction Theory and Applications, Setúbal, Portugal, pp. 86–93. SciTePress, January 2018. https://doi.org/10.5220/0006618800860093
Müller, A.M., Baumgartner, S.E., Kühne, R., Peter, J.: The effects of social information on the enjoyment of online videos: an eye tracking study on the role of attention. Media Psychol., 1–22 (2019). https://doi.org/10.1080/15213269.2019.1679647
Navalpakkam, V., Jentzsch, L., Sayres, R., Ravi, S., Ahmed, A., Smola, A.: Measurement and modeling of eye-mouse behavior in the presence of nonlinear page layouts. In: Proceedings of the 22nd International Conference on World Wide Web, WWW 2013, New York, NY, US, pp. 953–964. Association for Computing Machinery (2013). https://doi.org/10.1145/2488388.2488471
Pellicer-Sánchez, A.: Incidental vocabulary acquisition from and while reading: an eye-tracking study. Stud. Second Lang. Acquisition 36(1), 97–130 (2015)
Rodden, K., Fu, X.: Exploring how mouse movements relate to eye movements on web search results pages. In: Proceedings of ACM SIGIR 2007 Workshop on Web Information Seeking and Interaction, pp. 29–32. Association for Computing Machinery, New York (2007). http://research.microsoft.com/~ryenw/proceedings/WISI2007.pdf
Schneider, J., Weinmann, M., vom Brocke, J., Schneider, C.: Identifying preferences through mouse cursor movements - preliminary evidence. In: Proceedings of the 25th European Conference on Information Systems (ECIS), Guimarães, Portugal, pp. 2546–2556. Research-in-Progress Papers (2017)
Smadja, U., Grusky, M., Artzi, Y., Naaman, M.: Understanding reader backtracking behavior in online news articles. In: The World Wide Web Conference, pp. 3237–3243. WWW 2019. Association for Computing Machinery, New York (2019). https://doi.org/10.1145/3308558.3313571
Strindberg, A.: Eye movements during reading and reading assessment in Swedish school children: a new window on reading difficulties. In: Proceedings of the 11th ACM Symposium on Eye Tracking Research & Applications, ETRA 2019. Association for Computing Machinery, New York (2019). https://doi.org/10.1145/3314111.3322878
Tzafilkou, K., Protogeros, N., Yakinthos, C.: Mouse tracking for web marketing: enhancing user experience in web application software by measuring self-efficacy and hesitation levels. Int. J. Strateg. Innov. Mark. 01 (2014). https://doi.org/10.15556/IJSIM.01.04.005
Zahoor, S., Bedekar, M., Kosamkar, P.K.: User implicit interest indicators learned from the browser on the client side. In: Proceedings of the 2014 International Conference on Information and Communication Technology for Competitive Strategies, ICTCS 2014. Association for Computing Machinery, New York (2014)
Zhang, H., Miller, K., Cleveland, R., Cortina, K.: How listening to music affects reading: evidence from eye tracking. J. Exp. Psychol. Learn. Mem. Cogn. 44 (2018). https://doi.org/10.1037/xlm0000544
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2020 Springer Nature Switzerland AG
About this paper
Cite this paper
Kirsh, I., Joy, M. (2020). Exploring Pointer Assisted Reading (PAR): Using Mouse Movements to Analyze Web Users’ Reading Behaviors and Patterns. In: Stephanidis, C., Kurosu, M., Degen, H., Reinerman-Jones, L. (eds) HCI International 2020 - Late Breaking Papers: Multimodality and Intelligence. HCII 2020. Lecture Notes in Computer Science(), vol 12424. Springer, Cham. https://doi.org/10.1007/978-3-030-60117-1_12
Download citation
DOI: https://doi.org/10.1007/978-3-030-60117-1_12
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-030-60116-4
Online ISBN: 978-3-030-60117-1
eBook Packages: Computer ScienceComputer Science (R0)