Raimund Dachselt
Robert Buchholz
ABSTRACT
To provide intuitive ways of interacting with media data, this research work addresses the seamless combination of sensor-enabled phones with large displays. An intuitive basic set of tilt gestures is introduced for a stepwise or continuous interaction with both mobile applications and distant user interfaces by utilizing the handheld as a remote control. In addition, we introduce throwing gestures to transfer media documents and even running interfaces to a large display. To improve usability, data and interfaces can be thrown from a mobile phone to a distant screen and also fetched back to achieve mobility. We demonstrate the feasibility of the interaction methods with several advanced application prototypes facilitating a natural flow of interaction.
Supplemental Material
- Ballagas, R., Rohs, M., Sheridan, J. G. Sweep and point and shoot: phonecam-based interactions for large public displays. In Ext. Abstracts CHI 2005, ACM Press (2005), 1200--1203. Google Scholar
Digital Library
- Dachselt, R., Buchholz, R. Throw and Tilt -- Seamless Interaction across Devices Using Mobile Phone Gestures. In Proc. MEIS 2008, Lecture Notes in Informatics, Vol. P-133 (2008), 272--278.Google Scholar
- Dachselt, R., Frisch, M. Mambo: A Facet-based Zoomable Music Browser. In Proc. MUM 2007, ACM Press (2007), 110--117. Google ScholarDigital Library
- Cheverst, K., Dix, A., Fitton, D. Kray, C., Rouncefield, M., Sheridan, J., Saslis-Lagoudakis, G. Exploring Mobile Phone Interaction with Situated Displays. In Proc. Workshop PERMID at Pervasive 2005.Google Scholar
- Cho, S., Choi, C., Sung, Y., Lee, K., Kim, Y., Murray-Smith, R. Dynamics of tilt-based browsing on mobile devices. In Ext. Abstracts CHI 2007, ACM Press (2007), 1947--1952. Google ScholarDigital Library
- Kela, J., Korpipää, P., Mäntyjärvi, J., Kallio, S., Savino, G., Jozzo, L., Marca, D. Accelerometer-based gesture control for a design environment. Personal Ubiquitous Computing, 10, 5 (Jul. 2006), 285--299. Google ScholarDigital Library
- Pering, T., Anokwa, Y., and Want, R. Gesture connect: facilitating tangible interaction with a flick of the wrist. In Proc. TEI 2007. ACM Press (2007), 259--262. Google ScholarDigital Library
- Rekimoto, J. Tilting operations for small screen interfaces. In Proc. UIST 1996. ACM Press, 167--168. Google ScholarDigital Library
- Wang, J., Zhai, S., and Canny, J. Camera phone based motion sensing: interaction techniques, applications and performance study. In Proc. UIST 2006, ACM Press (2006), 101--110. Google ScholarDigital Library
- Yatani, K., Tamura, K., Hiroki, K., Sugimoto, M., and Hashizume, H. Toss-it: intuitive information transfer techniques for mobile devices. In Ext. Abstracts CHI 2005, ACM Press (2005), 1881--1884. Google ScholarDigital Library
Index Terms
- Natural throw and tilt interaction between mobile phones and distant displays
Recommendations
Exploring gesture-based interaction techniques in multi-display environments with mobile phones and a multi-touch table
AVI '10: Proceedings of the International Conference on Advanced Visual InterfacesIn this paper, we explore the potential of combining shared and interactive displays (e.g. a multi-touch table) with personal devices (e.g. mobile phones) as an important class of heterogeneous multi-display environments. Within six case studies ...
Interaction with large ubiquitous displays using camera-equipped mobile phones
In the ubiquitous computing environment, people will interact with everyday objects (or computers embedded in them) in ways different from the usual and familiar desktop user interface. One such typical situation is interacting with applications through ...
Assessing feedback for indirect shared interaction with public displays
OTM'11: Proceedings of the 2011th Confederated international conference on On the move to meaningful internet systemsInteraction is a key element in turning public displays into a platform for social interaction, making them more engaging and valuable. However, interactive features are still rare in public displays, due to the lack of generalised abstractions for ...
Comments