Skip to main content
SpringerLink
Log in

Classification of Pilot Attentional Behavior Using Ocular Measures

  • Chapter
  • First Online:
Advances in Data Science: Methodologies and Applications

Part of the book series: Intelligent Systems Reference Library ((ISRL,volume 189))

  • 1022 Accesses

Abstract

Revolutionary growth in technology has changed the way humans interact with machines. This can be seen in every area, including air transport. For example, countries such as United States are planning to deploy NextGen technology in all fields of air transport. The main goals of NextGen are to enhance safety, performance and to reduce impacts on environment by combining new and existing technologies. Loss of Situation Awareness (SA) in pilots is one of the human factors that affects aviation safety. There has been a significant research on SA indicating that pilot’s perception error leading to loss of SA is a one of the major causes of accidents in aviation. However, there is no system in place to detect these errors. Monitoring visual attention is one of the best mechanisms to determine a pilot’s attention and hence perception of a situation. Therefore, this research implements computational models to detect pilot’s attentional behavior using ocular data during instrument flight scenario and to classify overall attention behavior during instrument flight scenarios.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Log in via an institution
Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 149.00
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 199.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info
Hardcover Book
USD 199.99
Price excludes VAT (USA)
  • Durable hardcover edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

References

  1. Ancel, E., Shih, A.T., Jones, S.M., Reveley, M.S., Luxhøj, J.T., Evans, J.K.: Predictive safety analytics: inferring aviation accident shaping factors and causation. J. Risk Res. 18(4), 428–451 (2015)

    Article  Google Scholar 

  2. Shappell, S.A., Wiegmann, D.A.: Human factors analysis of aviation accident data: developing a needs-based, data-driven, safety program. In: 3rd Workshop on Human Error, Safety, and System Development (HESSD’99) (1999)

    Google Scholar 

  3. Thatcher, S., Kilingaru, K.: Intelligent monitoring of flight crew situation awareness. Adv. Mater. Res. 433(1), 6693–6701 (2012). Trans Tech Publications

    Google Scholar 

  4. Kilingaru, K., Tweedale, J.W., Thatcher, S., Jain, L.C.: Monitoring pilot “situation awareness”. J. Intell. Fuzzy Syst. 24(3), 457–466 (2013)

    Article  Google Scholar 

  5. Regal, D.M., Rogers, W.H., Boucek. G.P.: Situational awareness in the commercial flight deck: definition, measurement, and enhancement. SAE Technical Paper (1988)

    Google Scholar 

  6. Sarter, N.B., Woods, D.D.: Situation awareness: a critical but ill-defined phenomenon. Int. J. Aviat. Psychol. 1(1), 45–57 (1991)

    Article  Google Scholar 

  7. Oakley, T.: Attention and cognition. J. Appl. Attention 17(1), 65–78 (2004)

    MathSciNet  Google Scholar 

  8. Mack, A., Rock, I.: In Attentional Blindness. MIT press (1998)

    Google Scholar 

  9. Lamme, V.A.: Why visual attention and awareness are different. Trends Cognitive Sci. 7(1), 12–18 (2003)

    Google Scholar 

  10. Underwood, G., Chapman, P., Brocklehurst, N., Underwood, J., Crundall, D.: Visual attention while driving: sequences of eye fixations made by experienced and novice drivers. Ergonomics 46(6), 629–646 (2003)

    Article  Google Scholar 

  11. Smith, P., Shah, M., da Vitoria, Lobo N.: Determining driver visual attention with one camera. IEEE Trans. Intell. Transp. Syst. 4(4), 205–218 (2003)

    Article  Google Scholar 

  12. Ji, Q., Yang, X.: Real-time eye, gaze, and face pose tracking for monitoring driver vigilance. Real-time imaging. 8(5), 357–377 (2002)

    Article  Google Scholar 

  13. Yu, C.S., Wang, E.M., Li, W.C., Braithwaite, G.: Pilots’ visual scan patterns and situation awareness in flight operations. Aviat. Space Environ. Med. 85(7), 708–714 (2014)

    Article  Google Scholar 

  14. Haslbeck, A., Bengler, K.: Pilots’ gaze strategies and manual control performance using occlusion as a measurement technique during a simulated manual flight task. Cogn. Technol. Work 18(3), 529–540 (2016)

    Article  Google Scholar 

  15. Ho, H.F., Su, H.S., Li, W.C., Yu, C.S., Braithwaite, G.: Pilots’ latency of first fixation and dwell among regions of interest on the flight deck. In: International Conference on Engineering Psychology and Cognitive Ergonomics. Springer, Cham (2016)

    Google Scholar 

  16. Roscoe, A.H.: Heart rate as an in-flight measure of pilot workload. Royal Aircraft Establishment Farnborough (United Kingdom) (1982)

    Google Scholar 

  17. Hankins, T.C., Wilson, G.F.: A comparison of heart rate, eye activity, EEG and subjective measures of pilot mental workload during flight. Aviat. Space Environ. Med. 69(4), 360–367 (1998)

    Google Scholar 

  18. Craig, A., Tran, Y., Wijesuriya, N., Nguyen, H.: Regional brain wave activity changes associated with fatigue. Psychophysiology 49(44), 574–582 (2012)

    Article  Google Scholar 

  19. Diez, M., Boehm-Davis, D.A., Holt, R.W., Pinney, M.E., Hansberger, J.T., Schoppek, W.: Tracking pilot interactions with flight management systems through eye movements. In: Proceedings of the 11th International Symposium on Aviation Psychology, vol. 6, issue 1. The Ohio State University, Columbus (2001)

    Google Scholar 

  20. Van De Merwe, K., Van Dijk, H., Zon, R.: Eye movements as an indicator of situation awareness in a flight simulator experiment. Int. J. Aviat. Psychol. 22(1), 78–95 (2012)

    Article  Google Scholar 

  21. Fitts, P.M., Jones, R.E., Milton, J.L.: Eye movements of aircraft pilots during instrument-landing approaches. Ergon. Psychol. Mech. Models Ergon. 3(1), 56 (2005)

    Google Scholar 

  22. de Greef, T., Lafeber, H., van Oostendorp, H., Lindenberg, J.: Eye movement as indicators of mental workload to trigger adaptive automation. In: International Conference on Foundations of Augmented Cognition, pp. 219–228. Springer, Berlin, Heidelberg (2009)

    Google Scholar 

  23. Gibb, R., Gray, R., Scharff, L.: Aviation Visual Perception: Research, Misperception and Mishaps. Routledge (2016)

    Google Scholar 

  24. Rayner, K., Pollatsek, A.: Eye movements and scene perception. Can. J. Psychol. 46(3), 342 (1992)

    Article  Google Scholar 

  25. Instrument flying handbook: faa-h-8083-15a, United States Department of Transport Federal Aviation Administration (2012)

    Google Scholar 

  26. Fayyad, U., Piatetsky-Shapiro, G., Smyth, P.: From data mining to knowledge discovery in databases. AI Mag. 17(3), 37 (1996)

    Google Scholar 

  27. Ackoff, R.L.: From data to wisdom. J. Appl. Syst. Anal. 16(1), 3–9 (1989)

    Google Scholar 

  28. Bellinger, G., Castro, D., Mills, A.: Data, information, knowledge, and wisdom (2004)

    Google Scholar 

  29. Cleveland, H.: Information as a resource. Futurist 16(6), 34–39 (1982)

    Google Scholar 

  30. Zeleny, M.: Management support systems: towards integrated knowledge management. Hum. Syst. Manage. 7(1), 59–70 (1987)

    Article  Google Scholar 

  31. Eyetribe: Eyetribe tracker, Available Online: https://s3.eu-central-1.amazonaws.com/theeyetribe.com/theeyetribe.com/dev/csharp/index.html. Last accessed on 27 July 2019

  32. Lockheed-Martin: Prepar3d, Available Online: http://www.prepar3d.com. Last accessed on 27 July 2019

  33. Mill, E.: Json to CSV tool. Online: https://konklone.io/json/. Last accessed on 02 April 2018

  34. Burch, M., Kull, A., Weiskopf, D.: AOI rivers for visualizing dynamic eye gaze frequencies. Comput. Graph. Forum 32(3), 281–290 (2013)

    Google Scholar 

  35. Kurzhals, K., Weiskopf, D.: Aoi transition trees. In: Proceedings of the 41st Graphics Interface Conference, pp. 41–48. Canadian Information Processing Society (2015)

    Google Scholar 

  36. Abbott, A., Hrycak, A.: Measuring resemblance in sequence data: An optimal matching analysis of musicians’ careers. Am. J. Sociol. 96(1), 144–185 (1990)

    Article  Google Scholar 

  37. Kinnebrew, J.S., Biswas, G.: Comparative action sequence analysis with hidden markov models and sequence mining. In: Proceedings of the Knowledge Discovery in Educational Data Workshop at the 17th ACM SIGKDD Conference on Knowledge Discovery and Data Mining (KDD 2011). San Diego, CA (2011)

    Google Scholar 

  38. Power BI: [Available online], https://powerbi.microsoft.com/en-us/. Last accessed 26 August 2019

  39. Kübler, T., Eivazi, S., Kasneci, E.: Automated visual scanpath analysis reveals the expertise level of micro-neurosurgeons. In: MICCAI Workshop on Interventional Microscopy, pp. 1–8 (2015)

    Google Scholar 

  40. Dewhurst, R., Nyström, M., Jarodzka, H., Foulsham, T., Johansson, R., Holmqvist, K.: It depends on how you look at it: Scanpath comparison in multiple dimensions with MultiMatch, a vector-based approach. Behav. Res. Methods 44(4), 1079–1100 (2012)

    Article  Google Scholar 

  41. Li, H.: A short introduction to learning to rank. IEICE Trans. Inform. Syst. 94(10), 1854–1862 (2011)

    Article  Google Scholar 

Download references

Author information

Authors and Affiliations

  1. University of South Australia, Adelaide, Australia

    Kavyaganga Kilingaru & Zorica Nedic

  2. University of Technology Sydney, Ultimo, Australia

    Lakhmi C. Jain

  3. Liverpool Hope University, Liverpool, UK

    Lakhmi C. Jain

  4. KES International, Shoreham-by-Sea, UK

    Lakhmi C. Jain

  5. Defence Science and Technology Group, Adelaide, Australia

    Jeffrey Tweedale

  6. Central Queensland University, Rockhampton, Australia

    Steve Thatcher

Authors
  1. Kavyaganga Kilingaru
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Zorica Nedic
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Lakhmi C. Jain
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Jeffrey Tweedale
    View author publications

    You can also search for this author in PubMed Google Scholar

  5. Steve Thatcher
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Lakhmi C. Jain .

Editor information

Editors and Affiliations

  1. Loyola University Maryland, Baltimore, MD, USA

    Gloria Phillips-Wren

  2. Dipartimento di Psicologia, Università della Campania “Luigi Vanvitelli”, Caserta, Italy

    Anna Esposito

  3. Centre for Artificial Intelligence, University of Technology Sydney Broadway,, Sydney, NSW, Australia

    Lakhmi C. Jain

Rights and permissions

Reprints and permissions

Copyright information

© 2021 Springer Nature Switzerland AG

About this chapter

Check for updates. Verify currency and authenticity via CrossMark

Cite this chapter

Kilingaru, K., Nedic, Z., Jain, L.C., Tweedale, J., Thatcher, S. (2021). Classification of Pilot Attentional Behavior Using Ocular Measures. In: Phillips-Wren, G., Esposito, A., Jain, L.C. (eds) Advances in Data Science: Methodologies and Applications. Intelligent Systems Reference Library, vol 189. Springer, Cham. https://doi.org/10.1007/978-3-030-51870-7_12

Download citation

Publish with us

Policies and ethics

Search

Navigation