ABSTRACT
PhoneTouch is a novel technique for integration of mobile phones and interactive surfaces. The technique enables use of phones to select targets on the surface by direct touch, facilitating for instance pick&drop-style transfer of objects between phone and surface. The technique is based on separate detection of phone touch events by the surface, which determines location of the touch, and by the phone, which contributes device identity. The device-level observations are merged based on correlation in time. We describe a proof-of-concept implementation of the technique, using vision for touch detection on the surface (including discrimination of finger versus phone touch) and acceleration features for detection by the phone.
Supplemental Material
- }}T. Cuypers, Y. Francken, C. Vanaken, F. Van Reeth, and P. Bekaert. Smartphone localization on interactive surfaces using the built-in camera. In Proc. Procams, 2009.Google Scholar
- }}J. Y. Han. Low-cost multi-touch sensing through frustrated total internal reflection. In Proc. UIST, pages 115--118, 2005. Google ScholarDigital Library
- }}R. Hardy and E. Rukzio. Touch & Interact: Touch-based interaction of mobile phones with displays. In Proc. MobileHCI, pages 245--254, 2008. Google ScholarDigital Library
- }}K. Hinckley. Synchronous gestures for multiple users and computers. In Proc. UIST, pages 149--158, 2003. Google ScholarDigital Library
- }}L. Holmquist, F. Mattern, B. Schiele, P. Alahuhta, M. Beigl, and H. Gellersen. Smart-Its friends: A technique for users to easily establish connections between smart artefacts. In Proc. UbiComp, pages 116--122, 2001. Google ScholarDigital Library
- }}R. Mayrhofer and H. Gellersen. Shake well before use: Intuitive and secure pairing of mobile devices. IEEE Trans. Mob. Comp., 8:792--806, 2009. Google ScholarDigital Library
- }}D. L. Mills. Internet time synchronization: The network time protocol. IEEE Trans. Comm., 39:1482--1493, 1991.Google ScholarCross Ref
- }}J. Rekimoto. Pick-and-Drop: A direct manipulation technique for multiple computer environments. In Proc. UIST, pages 31--39, 1997. Google ScholarDigital Library
- }}J. Rekimoto. SyncTap: Synchronous user operation for spontaneous network connection. Personal and Ubiquitous Computing, 8:126--134, 2004. Google ScholarDigital Library
- }}S. Ronkainen, J. Häkkilä, S. Kaleva, A. Colley, and J. Linjama. Tap input as an embedded interaction method for mobile devices. In Proc. TEI, pages 263--270, 2007. Google ScholarDigital Library
- }}M. Strohbach, G. Kortuem, H. Gellersen, and C. Kray. Using cooperative artefacts as basis for activity recognition. In Proc. EUSAI, pages 49--60, 2004.Google ScholarCross Ref
- }}A. D. Wilson and R. Sarin. BlueTable: Connecting wireless mobile devices on interactive surfaces using vision-based handshaking. In Proc. GI, pages 119--125, 2007. Google ScholarDigital Library
Index Terms
- PhoneTouch: a technique for direct phone interaction on surfaces
Recommendations
A cross-device interaction style for mobiles and surfaces
DIS '12: Proceedings of the Designing Interactive Systems ConferenceNatural forms of interaction have evolved for personal devices that we carry with us (mobiles) as well as for shared interactive displays around us (surfaces) but interaction across the two remains cumbersome in practice. We propose a novel cross-device ...
Augmenting interactive tables with mice & keyboards
UIST '09: Proceedings of the 22nd annual ACM symposium on User interface software and technologyThis note examines the role traditional input devices can play in surface computing. Mice and keyboards can enhance tabletop technologies since they support high fidelity input, facilitate interaction with distant objects, and serve as a proxy for user ...
IdLenses: dynamic personal areas on shared surfaces
ITS '10: ACM International Conference on Interactive Tabletops and SurfacesIdLenses is a novel interaction concept to realize user-aware interfaces on shared surfaces. Users summon virtual lenses which allow for personalized input and output. The ability to create a lens instantaneously anywhere on the surface, and to move it ...
Comments