Alireza Sahami Shirazi
Yomna Abdelrahman
Niels Henze
Stefan Schneegass
Mohammadreza Khalilbeigi
Albrecht Schmidt
ABSTRACT
Thermal cameras have recently drawn the attention of HCI researchers as a new sensory system enabling novel interactive systems. They are robust to illumination changes and make it easy to separate human bodies from the image background. Far-infrared radiation, however, has another characteristic that distinguishes thermal cameras from their RGB or depth counterparts, namely thermal reflection. Common surfaces reflect thermal radiation differently than visual light and can be perfect thermal mirrors. In this paper, we show that through thermal reflection, thermal cameras can sense the space beyond their direct field-of-view. A thermal camera can sense areas besides and even behind its field-of-view through thermal reflection. We investigate how thermal reflection can increase the interaction space of projected surfaces using camera-projection systems. We moreover discuss the reflection characteristics of common surfaces in our vicinity in both the visual and thermal radiation bands. Using a proof-of-concept prototype, we demonstrate the increased interaction space for hand-held camera-projection system. Furthermore, we depict a number of promising application examples that can benefit from the thermal reflection characteristics of surfaces.
- Beckmann, P., and Spizzichino, A. The scattering of electromagnetic waves from rough surfaces. Artech House Radar Library, 1987.Google Scholar
- Bennett, H., and Porteus, J. Relation between surface roughness and specular reflectance at normal incidence. Journal of the Optical Society of America 51 (1961).Google Scholar
- Blasko, G., Feiner, S., and Coriand, F. Exploring interaction with a simulated wrist-worn projection display. In Proceedings of the International Symposium on Wearable Computers (2005), 2--9. Google ScholarDigital Library
- Cao, X., and Balakrishnan, R. Interacting with dynamically defined information spaces using a handheld projector and a pen. In Proceedings of the Symposium on User interface software and technology (2006), 225--234. Google ScholarDigital Library
- Cao, X., Forlines, C., and Balakrishnan, R. Multi-user interaction using handheld projectors. In Proceedings of the Symposium on User interface software and technology (2007), 43--52. Google ScholarDigital Library
- Ciaramello, F. M., and Hemami, S. S. Real-time face and hand detection for videoconferencing on a mobile device. In Proceedings of the Workshop on Video Processing and Quality Metrics for Consumer Electronics (2009).Google Scholar
- Cohen, C. J., Beach, G., and Foulk, G. A basic hand gesture control system for pc applications. In Proceedings of the Workshop on Applied Imagery Pattern Recognition (2001), 74--79. Google ScholarDigital Library
- Cowan, L. G., and Li, K. A. Shadowpuppets: supporting collocated interaction with mobile projector phones using hand shadows. In Proceedings of the Conference on Human Factors in Computing Systems (2011). Google ScholarDigital Library
- Duda, R. O., and Hart, P. E. Use of the hough transformation to detect lines and curves in pictures. Communications of the ACM 15, 1 (1972), 11--15. Google ScholarDigital Library
- Greaves, A., and Rukzio, E. Evaluation of picture browsing using a projector phone. In Proceedings of the Conference on Human computer interaction with mobile devices and services (2008), 351--354. Google ScholarDigital Library
- Harrison, C., Benko, H., and Wilson, A. D. Omnitouch: wearable multitouch interaction everywhere. In Proceedings of the Symposium on User interface software and technology (2011), 441--450. Google ScholarDigital Library
- Henze, N., Löcken, A., Boll, S., Hesselmann, T., and Pielot, M. Free-hand gestures for music playback: deriving gestures with a user-centred process. In Proceedings of the Conference on Mobile and Ubiquitous Multimedia (2010), 16:1--16:10. Google ScholarDigital Library
- Hilliges, O., Izadi, S., Wilson, A. D., Hodges, S., Garcia-Mendoza, A., and Butz, A. Interactions in the air: adding further depth to interactive tabletops. In Proceedings of the Symposium on User interface software and technology (2009), 139--148. Google ScholarDigital Library
- Iwai, D., and Sato, K. Heat sensation in image creation with thermal vision. In Proceedings of the Conference on Advances in computer entertainment technology (2005), 213--216. Google ScholarDigital Library
- Iwai, D., and Sato, K. Limpid desk: see-through access to disorderly desktop in projection-based mixed reality. In Proceedings of the Symposium on Virtual reality software and technology (2006), 112--115. Google ScholarDigital Library
- Iwai, Y., Watanabe, K., Yagi, Y., and Yachida, M. Gesture recognition by using colored gloves. In Proceedings of the Conference on Systems, Man, and Cybernetics (1996), 76--81.Google Scholar
- Izadi, S., Hodges, S., Taylor, S., Rosenfeld, D., Villar, N., Butler, A., and Westhues, J. Going beyond the display: a surface technology with an electronically switchable diffuser. In Proceedings of the Symposium on User interface software and technology (2008), 269--278. Google ScholarDigital Library
- Kane, S. K., Avrahami, D., Wobbrock, J. O., Harrison, B., Rea, A. D., Philipose, M., and LaMarca, A. Bonfire: a nomadic system for hybrid laptop-tabletop interaction. In Proceedings of the 22nd annual ACM symposium on User interface software and technology (2009), 129--138. Google ScholarDigital Library
- Khan, M. M., Ingleby, M., and Ward, R. D. Automated facial expression classification and affect interpretation using infrared measurement of facial skin temperature variations. ACM Transactions on Autonomous Adaptive Systems 1, 1 (2006), 91--113. Google ScholarDigital Library
- Kim, D., Hilliges, O., Izadi, S., Butler, A. D., Chen, J., Oikonomidis, I., and Olivier, P. Digits: freehand 3d interactions anywhere using a wrist-worn gloveless sensor. In Proceedings of the Symposium on User interface software and technology (2012), 167--176. Google ScholarDigital Library
- Koike, H., Sato, Y., and Kobayashi, Y. Integrating paper and digital information on enhanceddesk: a method for realtime finger tracking on an augmented desk system. ACM Transactions on Computer-Human Interaction 8, 4 (2001), 307--322. Google ScholarDigital Library
- Kong, S. G., Heo, J., Boughorbel, F., Zheng, Y., Abidi, B. R., Koschan, A., Yi, M., and Abidi, M. A. Multiscale fusion of visible and thermal ir images for illumination-invariant face recognition. International Journal of Computer Vision 71, 2 (2007), 215--233. Google ScholarDigital Library
- Larson, E., Cohn, G., Gupta, S., Ren, X., Harrison, B., Fox, D., and Patel, S. Heatwave: thermal imaging for surface user interaction. In Proceedings of the Conference on Human Factors in Computing Systems (2011), 2565--2574. Google ScholarDigital Library
- Lyda, W., Zimmermann, J., Burla, A., Regin, J., Osten, W., Sawodny, O., and Westkämper, E. Sensor and actuator conditioning for multiscale measurement systems on example of confocal microscopy. In SPIE Europe Optical Metrology, vol. 7389 (2009).Google ScholarCross Ref
- Manresa, C., Varona, J., Mas, R., and Perales, F. Hand tracking and gesture recognition for human-computer interaction. Electronic letters on computer vision and image analysis 5, 3 (2005), 96--104.Google Scholar
- Mistry, P., Maes, P., and Chang, L. Wuw - wear ur world: a wearable gestural interface. In Proceedings of the Conference on Human Factors in Computing Systems (extended abstracts) (2009), 4111--4116. Google ScholarDigital Library
- Murugappan, S., Vinayak, Elmqvist, N., and Ramani, K. Extended multitouch: recovering touch posture and differentiating users using a depth camera. In Proceedings of the Symposium on User interface software and technology (2012), 487--496. Google ScholarDigital Library
- Otsu, N. A threshold selection method from gray-level histograms. Automatica 11, 285--296 (1975), 23-27.Google ScholarDigital Library
- Pham, Q.-C., Gond, L., Begard, J., Allezard, N., and Sayd, P. Real-time posture analysis in a crowd using thermal imaging. In Proceedings of the Conference on Computer Vision and Pattern Recognition (2007), 1--8.Google ScholarCross Ref
- Puri, C., Olson, L., Pavlidis, I., Levine, J., and Starren, J. Stresscam: non-contact measurement of users' emotional states through thermal imaging. In Proceedings of the Conference on Human Factors in Computing Systems (extended abstracts) (2005), 1725--1728. Google ScholarDigital Library
- Raheja, J. L., Das, K., and Chaudhary, A. Fingertip detection: A fast method with natural hand. arXiv preprint arXiv:1212.0134 (2012).Google Scholar
- Rukzio, E., Holleis, P., and Gellersen, H. Personal projectors for pervasive computing. IEEE Pervasive Computing 11, 2 (2012), 30--37. Google ScholarDigital Library
- Schmidt, D., Molyneaux, D., and Cao, X. Picontrol: using a handheld projector for direct control of physical devices through visible light. In Proceedings of the Symposium on User interface software and technology (2012), 379--388. Google ScholarDigital Library
- Stenger, B., Thayananthan, A., Torr, P. H., and Cipolla, R. Model-based hand tracking using a hierarchical bayesian filter. Transactions on Pattern Analysis and Machine Intelligence 28, 9 (2006), 1372--1384. Google ScholarDigital Library
- Tiziani, H., Haist, T., and Reuter, S. Optical inspection and characterization of microoptics using confocal microscopy. Optics and lasers in engineering 36, 5 (2001), 403--415.Google Scholar
- Velten, A., Willwacher, T., Gupta, O., Veeraraghavan, A., Bawendi, M. G., and Raskar, R. Recovering three-dimensional shape around a corner using ultrafast time-of--ight imaging. Nature Communications 3 (2012).Google Scholar
- Vollmer, M., Henke, S., Karstädt, D., Möllmann, K., and Pinno, F. Identification and suppression of thermal reflections in infrared thermal imaging. In Proceedings of Inframation, vol. 5 (2004), 287--298.Google Scholar
- Wang, R. Y., and Popović, J. Real-time hand-tracking with a color glove. In ACM Transactions on Graphics, vol. 28 (2009), 63:1--63:8. Google ScholarDigital Library
- Willis, K. D., Poupyrev, I., and Shiratori, T. Motionbeam: a metaphor for character interaction with handheld projectors. In Proceedings of the Conference on Human Factors in Computing Systems (2011), 1031--1040. Google ScholarDigital Library
- Wilson, A. D. Touchlight: an imaging touch screen and display for gesture-based interaction. In Proceedings of the Conference on Multimodal interfaces (2004), 69--76. Google ScholarDigital Library
- Wilson, A. D. Playanywhere: a compact interactive tabletop projection-vision system. In Proceedings of the Symposium on User interface software and technology (2005), 83--92. Google ScholarDigital Library
- Wilson, A. D. Depth sensing video cameras for 3d tangible tabletop interaction. In Proceedings of Workshop on Horizontal Interactive Human-Computer Systems (2007).Google ScholarCross Ref
- Wilson, A. D. Using a depth camera as a touch sensor. In Proceedings of the Conference on Interactive Tabletops and Surfaces (2010), 69--72. Google ScholarDigital Library
- Wilson, A. D., and Benko, H. Combining multiple depth cameras and projectors for interactions on, above and between surfaces. In Proceedings of the Symposium on User interface software and technology (2010), 273--282. Google ScholarDigital Library
- Winkler, C., Pfeuffer, K., and Rukzio, E. Investigating mid-air pointing interaction for projector phones. In Proceedings of the Conference on Interactive tabletops and surfaces (2012), 85--94. Google ScholarDigital Library
- Winkler, C., Reinartz, C., Nowacka, D., and Rukzio, E. Interactive phone call: synchronous remote collaboration and projected interactive surfaces. In Proceedings of the Conference on Interactive Tabletops and Surfaces (2011), 61--70. Google ScholarDigital Library
- Wong, W. K., Lim, H. L., Loo, C. K., and Lim, W. S. Home alone faint detection surveillance system using thermal camera. In Proceedings of the Conference on Computer Research and Development (2010), 747--751. Google ScholarDigital Library
- Wong, W. K., Tan, P. N., Loo, C. K., and Lim, W. S. An effective surveillance system using thermal camera. In Proceedings of the Conference on Signal Acquisition and Processing (2009), 13--17. Google ScholarDigital Library
Index Terms
- Exploiting thermal reflection for interactive systems
Recommendations
Investigation of Material Properties for Thermal Imaging-Based Interaction
CHI '15: Proceedings of the 33rd Annual ACM Conference on Human Factors in Computing SystemsRecent work demonstrated the exciting opportunities that thermal imaging offers for the development of interactive systems. It was shown that a thermal camera can sense when a user touches a surface, performs gestures in the camera's direct field of ...
Modelling the vertical heat exchanger in thermal basin
ICCSA'11: Proceedings of the 2011 international conference on Computational science and its applications - Volume Part IVIn geographical area characterize by specific geological conformations such as the Viterbo area which comprehend active volcanic basins, it is difficult to use conventional geothermal plants.
In fact the area presents at shallow depths thermal falde ...
Thermal cameras and applications: a survey
Thermal cameras are passive sensors that capture the infrared radiation emitted by all objects with a temperature above absolute zero. This type of camera was originally developed as a surveillance and night vision tool for the military, but recently ...
Comments