Marcos Serrano
Barrett M. Ens
Pourang P. Irani
ABSTRACT
We propose the use of Hand-to-Face input, a method to interact with head-worn displays (HWDs) that involves contact with the face. We explore Hand-to-Face interaction to find suitable techniques for common mobile tasks. We evaluate this form of interaction with document navigation tasks and examine its social acceptability. In a first study, users identify the cheek and forehead as predominant areas for interaction and agree on gestures for tasks involving continuous input, such as document navigation. These results guide the design of several Hand-to-Face navigation techniques and reveal that gestures performed on the cheek are more efficient and less tiring than interactions directly on the HWD. Initial results on the social acceptability of Hand-to-Face input allow us to further refine our design choices, and reveal unforeseen results: some gestures are considered culturally inappropriate and gender plays a role in selection of specific Hand-to-Face interactions. From our overall results, we provide a set of guidelines for developing effective Hand-to-Face interaction techniques.
Supplemental Material
- Alexander, J., Han, T., Judd, W., Irani, P. Subramanian, S. 2012. Putting your best foot forward: investigating real-world mappings for foot-based gestures. In Proc. of CHI '12. ACM, 1229--1238. Google Scholar
Digital Library
- Bailly, G., Müller, J., Rohs, M., Wigdor, D., Kratz, S. 2012. ShoeSense: a new perspective on gestural interaction and wearable applications. In Proc. of CHI '12. ACM, 1239--1248. Google ScholarDigital Library
- Borg, G. Borg's Perceived Exertion and Pain Scales. Human Kinetics (1998), viii 104pp.Google Scholar
- Epson Moverio, http://www.epson.com/moverioGoogle Scholar
- GlobalWebIndex, https://www.globalwebindex.net/Topglobal-smartphone-appsGoogle Scholar
- Google Glass, Project Glass One Day video, http://www.google.com/glassGoogle Scholar
- Gustafson, S.,Rabe, B., and Baudisch, P.. 2013. Understanding palm-based imaginary interfaces. In Proc. of CHI '13. ACM, 889--898. Google ScholarDigital Library
- Harrison, C., Tan, D., and Morris, D. 2010. Skinput: appropriating the body as an input surface. In Proc. of CHI '10. ACM, 453--462. Google ScholarDigital Library
- Harrison, C., Benko, H. and Wilson, A. 2011. OmniTouch: wearable multitouch interaction everywhere. In Proc of UIST'11. ACM, 441--450. Google ScholarDigital Library
- Hidayat, A. Flick list with its momentum scrolling and deceleration. http://ariya.ofilabs.com/Google Scholar
- Hincapie-Ramos, J-D,. Guo, X., Moghadasian, P. and Irani, P. 2014. Consumed Endurance: a metric to quantify arm fatigue of mid-air interactions. In Proc. of CHI'14. ACM, to appear. Google ScholarDigital Library
- Hinckley, K., Wigdor, D., Input Technologies and Techniques. Chap. 9 in The HCI Handbook, 3rd Edition, Taylor & Francis. Google ScholarDigital Library
- Holz, C. Grossman, T., Frizmaurice, G and Agur, A. 2012. Implanted user interfaces. In Proc. of CHI '12. ACM, 503--512. Google ScholarDigital Library
- Kim, D. Hilliges, O., Izadi, S., Butler, A., Chen, J., Oikonomidis, I. and Olivier, P.. 2012. Digits: freehand 3D interactions anywhere using a wrist-worn gloveless sensor. In Proc. of UIST '12. ACM, 167--176. Google ScholarDigital Library
- Kimura, S., Fukuomoto, M., and Horikoshi, T. 2013. Eyeglass-based hands-free videophone. In Proc. of ISWC '13. ACM, 117--124. Google ScholarDigital Library
- Lissermann, R.Huber, J., Hadjakos, A. and Mühlhäuser, M. 2013. EarPut: augmenting behind-the-ear devices for ear-based interaction. In CHI '13EA. ACM, 1323--28. Google ScholarDigital Library
- Lucero, A. Lyons, K., Vetek, A., Järvenpää, T., White, S. and Salmimaa, M. 2013. Exploring the interaction design space for interactive glasses. In CHI '13 EA. ACM, 1341--1346. Google ScholarDigital Library
- Mahmoud, M. and Robinson, P. 2011. Interpreting Hand-Over-Face Gestures. In Proc. of Affective Computing, Springer, 248--255. Google ScholarDigital Library
- Malacria, S., Lecolinet, E. and Guiard, Y. 2010. Clutchfree panning and integrated pan-zoom control on touchsensitive surfaces: the cyclostar approach. In Proc. of CHI '10. ACM, 2615--2624. Google ScholarDigital Library
- Nicas, M. and Best, D. 2008. A Study Quantifying the Hand-to-Face Contact Rate and Its Potential Application to Predicting Respiratory Tract Infection. In J. Occup. Env. Hyg., 347--352.Google Scholar
- Perrault, S., Lecolinet, E., Eagan, J., Guiard, Y. 2013. Watchit: simple gestures and eyes-free interaction for wristwatches and bracelets. In Proc. of CHI'13. ACM, 1451--1460. Google ScholarDigital Library
- Profita, H., Clawson, J., Gilliland, S., Zeagler, C., Starner, T., Budd, J. and Do, E. 2013. Don't mind me touching my wrist: a case study of interacting with onbody technology in public. In Proc. of ISWC '13. ACM, 89--96. Google ScholarDigital Library
- Rico, J. and Brewster, S. 2010. Usable gestures for mobile interfaces: evaluating social acceptability. In Proc. of CHI '10. ACM, 887--896. Google ScholarDigital Library
- Ruiz, J, Li, Y., Lank, E. 2011. User-defined motion gestures for mobile interaction. In Proc. of CHI '11. ACM, 197--206. Google ScholarDigital Library
- Saponas, T., Kelly, D., Parviz, B. and Tan, D. 2009. Optically sensing tongue gestures for computer input. In Proc.of UIST '09. ACM, 177--180. Google ScholarDigital Library
- Serrano, M., Lecolinet, E., and Guiard, Y. 2013. BezelTap gestures: quick activation of commands from sleep mode on tablets. In Proc. of CHI'13. ACM, 3027--3036. Google ScholarDigital Library
- Seyed, T., Burns, C., Costa, M, Maurer, F. and Tang, A. 2012. Eliciting usable gestures for multi-display environments. In Proc. of ITS '12. ACM, 41--50. Google ScholarDigital Library
- Spakov, O. and Majaranta, P. 2012. Enhanced gaze interaction using simple head gestures. In Proc. of UbiComp '12. ACM, 705--710. Google ScholarDigital Library
- Tamaki, E. Miyak, T. and Rekimoto, J. 2010. BrainyHand: a wearable computing device without HMD and its interaction techniques. In Proc. of AVI '10. ACM, 387--388. Google ScholarDigital Library
- Telepathy, http://tele-pathy.orgGoogle Scholar
- Vuzix M100, http://www.vuzix.comGoogle Scholar
- Wagner, J. Nancel, M., Gustafson, S., Huot, S. and Mackay, W. 2013. Body-centric design space for multisurface interaction. In Proc. of CHI '13. ACM, 12991308. Google ScholarDigital Library
- Wobbrock, J., Ringel Morris, M. and Wilson, A. 2009. User-defined gestures for surface computing. In Proc. of CHI '09. ACM, 1083--1092. Google ScholarDigital Library
- Yang, X-D. Grossman, T., Wigdor, D. and Fitzmaurice, G. 2012. Magic finger: always-available input through finger instrumentation. In Proc. of UIST '12. ACM, 147156. Google ScholarDigital Library
Index Terms
- Exploring the use of hand-to-face input for interacting with head-worn displays
Recommendations
Combining Ring Input with Hand Tracking for Precise, Natural Interaction with Spatial Analytic Interfaces
SUI '16: Proceedings of the 2016 Symposium on Spatial User InteractionCurrent wearable interfaces are designed to support short-duration tasks known as micro-interactions. To support productive interfaces for everyday analytic tasks, designers can leverage natural input methods such as direct manipulation and pointing. ...
Moving Ahead with Peephole Pointing: Modelling Object Selection with Head-Worn Display Field of View Limitations
SUI '16: Proceedings of the 2016 Symposium on Spatial User InteractionHead-worn displays (HWDs) are now becoming widely available, which will allow researchers to explore sophisticated interface designs that support rich user productivity features. In a large virtual workspace, the limited available field of view (FoV) ...
Investigating current techniques for opposite-hand smartwatch interaction
MobileHCI '17: Proceedings of the 19th International Conference on Human-Computer Interaction with Mobile Devices and ServicesThe small display size of smartwatches creates a challenge for touch input, which is still the interaction technique of choice. Researchers and producers have started to investigate alternative interaction techniques. Apple and Samsung, for example, ...
Comments