Sajay Sadasivan
Andrew T. Duchowski
ABSTRACT
Aircraft inspection is a vital element in assuring safety and reliability of the air transportation system. The human inspector performing visual inspection of an aircraft is the backbone of this process and training is an effective strategy for improving their inspection performance. Previous studies have shown offline feedback training to be effective in improving subsequent visual inspection performance. Because experienced inspectors are known to adopt a better inspection strategy than novices, providing visualization of experts' cognitive processes a priori can accelerate novices' adoption of the experts' strategy. Using eye tracking equipment, we record the point of regard of an expert inspector performing an inspection task in a virtual reality simulator. Analysis of their eye movements leads to a visualization of their scanpaths and allows us to display the inspector's visual search (hence cognitive) strategy. We show how providing this type of scanpath-based feedforward training of novices leads to improved accuracy performance in the simulator coupled with an observed speed-accuracy tradeoff. We contend that the tradeoff results from trained novices adopting a slower paced strategy through increased fixation durations, suggesting trained novices learn a more deliberate target search/discrimination strategy that requires more time to execute.
- J. H. Bertera and K. Rayner. Eye Movements and the Span of the Effective Stimulus in Visual Search. Perception & Psychophysics 62,3 (2000), 576--585.Google Scholar
Cross Ref
- D. T. Campbell and J. C. Stanley. Experimental and Quasi-Experimental Designs for Research. Houghton Mifflin Co. (1966).Google Scholar
- S. J. Czaja and C. G. Drury. Training Programs for Inspection. Human Factors 23,4 (1981), 473--484.Google Scholar
- T. J. Doll. Preattentive Processing in Visual Search. In Proc. HFES (1993), 1291--1249.Google ScholarCross Ref
- C. G. Drury. The Maintenance Technician in Inspection. In Human Factors in Aviation Maintenance Phase 1: Progress Report (1991), Washington, D.C., 45--91.Google Scholar
- C. G. Drury, A. K. Gramopadhye, and J. Sharit. Feedback Strategies for Visual Inspection in Airframe Structural Inspection. International Journal of Industrial Ergonomics 19 (1997), 333--344.Google ScholarCross Ref
- A. Duchowski, E. Medlin, N. Cournia, A. Gramopadhye, B. Melloy, and S. Nair. 3D Eye Movement Analysis for Visual Inspection Training. In Proc. ETRA 2002, ACM Press (2002), 103--110. Google ScholarDigital Library
- A. Duchowski, E. Medlin, A. Gramopadhye, B. Melloy, and S. Nair. Binocular Eye Tracking in VR for Visual Inspection Training. In Proc. VRST, ACM Press (2001), 1--8,193. Google ScholarDigital Library
- A. T. Duchowski, N. Cournia, B. Cumming, D. McCallum, A. K. Gramopadhye, J. S. Greenstein, S. Sadasivan, and R. A. Tyrrell. Visual Deictic Reference in a Collaborative Virtual Environment. In Proc. ETRA 2004, ACM Press (2004), 35--40. Google ScholarDigital Library
- T. J. Gallwey and C. G. Drury. Task Complexity in Visual Inspection. Human Factors 28 (1986), 595--606. Google ScholarDigital Library
- A. K. Gramopadhye, C. G. Drury, and P. V. Prabhu. Training Strategies for Visual Inspection. Human Factors and Ergonomics in Manufacturing 7,3 (1997), 171--196.Google ScholarCross Ref
- H. H. Greene and K. Rayner. Eye Movements and Familiarity Effects in Visual Search. Vision Research 41,27 (2001), 3763--3773.Google Scholar
- J. M. Henderson. Visual Attention and Eye Movement Control During Reading and Picture Viewing. In K. Rayner, ed., Eye Movements and Visual Cognition: Scene Perception and Reading, Springer-Verlag (1992), 260--283.Google Scholar
- L. Itti, C. Koch, and E. Niebur. A Model of Saliency-Based Visual Attention for Rapid Scene Analysis. IEEE Transactions on Pattern Analysis and Machine Intelligence (PAMI) 20,11 (1998), 1254--1259. Google ScholarDigital Library
- S. Kaewkuekool, M. Khasawneh, S. Bowling, A. Gramopadhye, A. Duchowski, and B. Melloy. Using Virtual Reality to Support Feedback/Feedforward Training to Improve Human Performance. In Proc. IERC 2002, IIE (2002).Google Scholar
- H. L. Kundel and P. S. LaFollette. Visual Search Patterns and Experience with Radiological Images. Radiology 103 (1972), 523--528.Google ScholarCross Ref
- H. L. Kundel, C. F. Nodine, and E. A. Krupinski. Computer-Displayed Eye Position as a Visual Aid to Pulmonary Nodule Interpretation. Investigative Radiology 25 (1990), 890--896.Google ScholarCross Ref
- B. Law, M. S. Atkins, A. E. Kirkpatrick, A. J. Lomax, and C. L. MacKenzie. Eye Gaze Patterns Differentiate Novice and Experts in a Laparoscopic Surgery Training Environment. In Proc. ETRA 2004, ACM Press (2004), 41--48. Google ScholarDigital Library
- E. D. Megaw and J. Richardson. Eye movements and industrial inspection. Applied Ergonomics 10,3 (1979), 145--154.Google ScholarCross Ref
- C. Mello-Thoms, C. F. Nodine, and H. L. Kundel. What Attracts the Eye to the Location of Missed and Reported Breast Cancers? In Proc. ETRA 2002, ACM Press (2002), 111--117. Google ScholarDigital Library
- S. Nair, E. Medlin, J. Vora, A. Gramopadhye, A. T. Duchowski, B. Melloy, and B. Kanki. Cognitive Feedback Training Using 3D Binocular Eye Tracker. In Proc. HFES (2001), 1838--1842.Google Scholar
- W. Osberger and A. J. Maeder. Automatic Identification of Perceptually Important Regions in an Image. In Proc. ICPR (1998). Google ScholarDigital Library
- A. Pollatsek and K. Rayner. What Is Integrated Across Fixations? In K. Rayner, ed., Eye Movements and Visual Cognition: Scene Perception and Reading, Springer-Verlag (1992), 166--191.Google Scholar
- K. Rayner. Eye Movements in Reading and Information Processing: 20 Years of Research. Psychological Bulletin 124,3 (1998), 372--422.Google ScholarCross Ref
- E. M. Reingold, N. Charness, M. Pomplun, and D. M. Stampe. Visual Span in Expert Chess Players: Evidence from Eye Movements. Psychological Science (2002).Google Scholar
- S. Sadasivan, D. Nalanagula, J. S. Greenstein, A. T. Duchowski, and A. K. Gramopadhye. Evaluating Advanced Displays to Provide Search Strategy Information in a Virtual Reality Training Environment. In Proc. International Conference on Industrial Engineering Theory, Applications, and Practice (2003).Google Scholar
- J. W. Schoonard, J. D. Gould, and L. A. Miller. Studies of Visual Inspection. Ergonomics 16,4 (1973), 365--379.Google Scholar
- E. R. Tufte. Visual Explanations: Images and Quantities, Evidence and Narrative. Graphics Press (1997). Google ScholarDigital Library
- B. M. Velichkovsky. Communicating Attention-Gaze Position Transfer in Cooperative Problem Solving. Pragmatics and Cognition 3,2 (1995), 199--222.Google ScholarCross Ref
- R. Vertegaal. The GAZE Groupware System: Mediating Joint Attention in Mutiparty Communication and Collaboration. In Proc. CHI 1999, ACM Press (1999), 294--301. Google ScholarDigital Library
- J. Vora, S. Nair, E. Medlin, A. Gramopadhye, A. T. Duchowski, B. Melloy, and B. Kanki. Using Virtual Technology to Improve Aircraft Inspection Performance: Presence and Performance Measurement Studies. In Proc. HFES (2001), 1867--1871.Google Scholar
- M.-J. J. Wang, S.-C. Lin, and C. G. Drury. Training for strategy in visual search. Industrial Ergonomics 20 (1997), 101--108.Google ScholarCross Ref
- J. M. Wolfe. Guided Search 2.0: The Upgrade. In Proc. HFES (1993), 1295--1299.Google ScholarCross Ref
- A. L. Yarbus. Eye Movements and Vision. Plenum Press (1967).Google Scholar
Index Terms
- Use of eye movements as feedforward training for a synthetic aircraft inspection task
Recommendations
The Eye in Extended Reality: A Survey on Gaze Interaction and Eye Tracking in Head-worn Extended Reality
With innovations in the field of gaze and eye tracking, a new concentration of research in the area of gaze-tracked systems and user interfaces has formed in the field of Extended Reality (XR). Eye trackers are being used to explore novel forms of spatial ...
Binocular eye tracking in virtual reality for inspection training
ETRA '00: Proceedings of the 2000 symposium on Eye tracking research & applicationsThis paper describes the development of a binocular eye tracking Virtual Reality system for aircraft inspection training. The aesthetic appearance of the environment is driven by standard graphical techniques augmented by realistic texture maps of the ...
Eye&Head: Synergetic Eye and Head Movement for Gaze Pointing and Selection
UIST '19: Proceedings of the 32nd Annual ACM Symposium on User Interface Software and TechnologyEye gaze involves the coordination of eye and head movement to acquire gaze targets, but existing approaches to gaze pointing are based on eye-tracking in abstraction from head motion. We propose to leverage the synergetic movement of eye and head, and ...
Comments