Hirotake Yamazoe
ABSTRACT
We propose a real-time gaze estimation method based on facial-feature tracking using a single video camera that does not require any special user action for calibration. Many gaze estimation methods have been already proposed; however, most conventional gaze tracking algorithms can only be applied to experimental environments due to their complex calibration procedures and lacking of usability. In this paper, we propose a gaze estimation method that can apply to daily-life situations. Gaze directions are determined as 3D vectors connecting both the eyeball and the iris centers. Since the eyeball center and radius cannot be directly observed from images, the geometrical relationship between the eyeball centers and the facial features and eyeball radius (face/eye model) are calculated in advance. Then, the 2D positions of the eyeball centers can be determined by tracking the facial features. While conventional methods require instructing users to perform such special actions as looking at several reference points in the calibration process, the proposed method does not require such special calibration action of users and can be realized by combining 3D eye-model-based gaze estimation and circle-based algorithms for eye-model calibration. Experimental results show that the gaze estimation accuracy of the proposed method is 5° horizontally and 7° vertically. With our proposed method, various application such as gaze-communication robots, gaze-based interactive signboards, etc. that require gaze information in daily-life situations are possible.
- Baluja, S., and Pomerleau, D. 1994. Non-intrusive gaze tracking using artificial neural networks. Tech. Rep. CMU-CS-94-102, CMU. Google Scholar
Digital Library
- Ishikawa, T., Baker, S., Matthews, I., and Kanade, T. 2004. Passive driver gaze tracking with active appearance models. In Proc. 11th World Congress on Intelligent Transportation Systems.Google Scholar
- Kawato, S., Tetsutani, N., and Hosaka, K. 2005. Scale-adaptive face detection and tracking in real time with ssr filters and support vector machine. IEICE Trans. on Info. and Sys. E88-D, 12, 2857--2863. Google ScholarDigital Library
- Lucas, B., and Kanade, T. 1981. An iterative image registration technique with an application to stereo vision. In Proc. Int'l Joint Conf. Aretificial Intelligence, 674--679.Google Scholar
- Matsumoto, Y., and Zelinsky, A. 2000. An algorithm for real-time stereoo vision implementation of head pose and gaze direction measurement. In Proc. Int. Conf. Automatic Face and Gesture Recognition, 499--504. Google ScholarDigital Library
- Miyake, T., Haruta, S., and Horihata, S. 2002. Image based eye-gaze estimation irrespective of head direction. In Proc. IEEE Int. Symp. Industrial Electronics, vol. 1, 332--336.Google ScholarCross Ref
- Morency, L. P., Chrristoudias, C., and Darrell, T. 2006. Recognizing gaze aversion gestures in embodied conversational discourse. In Proc. ICMI'06, 287--294. Google ScholarDigital Library
- Morimoto, C. H., and Mimica, M. R. M. 2005. Eye gaze tracking techniques for interactive applications. Computer Vision and Image Understanding 98, 1, 4--24. Google ScholarDigital Library
- Ohno, T., Mukawa, N., and Kawato, S. 2003. Just blink your eyes: A head-free gaze tracking system. In Proc. CHI2003, 950--951. Google ScholarDigital Library
- Ono, Y., Okabe, T., and Sato, Y. 2006. Gaze estimation from low resolution images. In Proc. IEEE Pacigic-Rim Symp. on Image and Video Technology(PSIVT'06), 178--188. Google ScholarDigital Library
- Poelman, C., and Kanade, T. 1992. A paraperspective factorization method for shape and motion recovery. Tech. Rep. 92--208, CMU-CS. Google ScholarDigital Library
- Quan, L. 1996. Self-calibration of an affine camera from multiple views. Int'l Journal of Computer Vision 19, 93--105. Google ScholarDigital Library
- Shiele, B., and Waibel, A. 1995. Gaze tracking based on face-color. In Proc. Int'l Workshop on Automatic Face and Gesture Recognition, 344--349.Google Scholar
- Takegami, T., Gotoh, T., and Ohyama, G. 2002. An algorithm for an eye tracking system with self-calibration. Systems and Computers in Japan 33, 10, 10--20.Google ScholarCross Ref
- Utsumi, A., Kawato, S., Susami, K., Kuwahara, N., and Kuwabara, K. 2004. Face-orientation detection and monitoring for networked interaction therapy. In Proc. of SCIS & ISIS 2004.Google Scholar
- Wang, J., and Sung, E. 2001. Gaze determination via images of irises. Image and Vision Computing 19, 12, 891--911.Google ScholarCross Ref
- Wu, H., Chen, Q., and Wada, T. 2004. Conic-based algorithm for visual line estimation from image. In Proc. Automatic Face and Gesture Recognition, 260--265. Google ScholarDigital Library
- Yonezawa, T., Yamazoe, H., Utsumi, A., and Abe, S. 2007. Gaze-communicative behavior of stuffed-toy robot with joint attention and eye contact based on ambient gaze-tracking. 140--145. Google ScholarDigital Library
- Yonezawa, T., Yamazoe, H., Utsumi, A., and Abe, S. 2007. Gazecoppet: Hierarchical gaze-communication in ambient space. Google ScholarDigital Library
Index Terms
- Remote gaze estimation with a single camera based on facial-feature tracking without special calibration actions
Recommendations
Eye gaze tracking with free head movements using a single camera
SoICT '10: Proceedings of the 1st Symposium on Information and Communication TechnologyThe problem of eye gaze tracking has been researched and developed for a long time. The most difficult problem in the non-intrusive system of eye gaze tracking is the problem of head movements. Some of existing methods have to use two cameras and an ...
Single camera remote eye gaze tracking under natural head movements
ICAT'06: Proceedings of the 16th international conference on Advances in Artificial Reality and Tele-ExistenceMost available gaze tracking systems based on corneal reflection have low tolerance for head movements. In this paper, an eye-gaze tracking method, which can make this system be adaptive to external lighting changes and to the user’s head movements, is ...
Mobile 3D Gaze Tracking Calibration
CRV '15: Proceedings of the 2015 12th Conference on Computer and Robot VisionWe present a new calibration method to combine a mobile eye tracker with an external tracking system to obtain a 3D gaze vector. Our method captures calibration points of varying distances, pupil positions and head positions/orientations. With these ...
Comments