Mathias Frisch
Raimund Dachselt
ABSTRACT
Creating and editing large graphs and node-link diagrams are crucial activities in many application areas. For them, we consider multi-touch and pen input on interactive surfaces as very promising. This fundamental work presents a user study investigating how people edit node-link diagrams on an interactive tabletop. The study covers a set of basic operations, such as creating, moving, and deleting diagram elements. Participants were asked to perform spontaneous gestures for 14 given tasks. They could interact in three different ways: using one hand, both hands, as well as pen and hand together. The subjects' activities were observed and recorded in various ways, analyzed and enriched with think-aloud data. As a result, we contribute a user-elicited collection of touch and pen gestures for editing node-link diagrams. The study provides valuable insight how people would interact on interactive surfaces for this as well as other tabletop domains.
Supplemental Material
- Brandl, P.; Haller, M.; Hurnaus, M.; Lugmayr, V.; Oberngruber, J.; Oster, C.; Schafleitner, C. & Billinghurst, M. An Adaptable Rear-Projection Screen Using Digital Pens And Hand Gestures, In Proc ICAT 2007, IEEE Computer Society (2007), 49--54. Google Scholar
Digital Library
- Brandl, P., Forlines, C., Wigdor, D., Haller, M., and Shen, C. Combining and measuring the benefits of bimanual pen and direct-touch interaction on horizontal interfaces. In Proc. AVI 2008, ACM Press (2008), 154--161. Google ScholarDigital Library
- Cao, X., Wilson, A. D., Balakrishnan, R., Hinckley, K., Hudson S. E. ShapeTouch: Leveraging Contact Shape on Interactive Surfaces. In Proc. of TABLETOP 2008, 139--146.Google Scholar
- Chen, Q., Grundy, J., and Hosking, J. An e-whiteboard application to support early design-stage sketching of UML diagrams. In Proc. HCC 2003, IEEE Computer Society (2003), 219--226. Google ScholarDigital Library
- Cherubini, M., Venolia, G., DeLine, R., and Ko, A. J. Let's go to the whiteboard: how and why software developers use drawings. In Proc. CHI 2007, ACM Press (2007), 557--566. Google ScholarDigital Library
- Damm, C. H., Hansen, K. M., and Thomsen, M. Tool support for cooperative object-oriented design: gesture based modeling on an electronic whiteboard. In Proc. CHI 2000, ACM Press (2000), 518--525. Google ScholarDigital Library
- Dekel, U. Supporting distributed software design meetings: what can we learn from co-located meetings? In Proc. HSSE 2005, ACM Press (2005), 1--7. Google ScholarDigital Library
- Dietz, P. and Leigh, D. DiamondTouch: a multi-user touch technology. In Proc UIST 2001, ACM Press (2001), 219--226. Google ScholarDigital Library
- Epps, J.; Lichman, S. & Wu, M. A study of hand shape use in tabletop gesture interaction, Ext. Abstracts CHI 2006, ACM Press (2006), 748--753. Google ScholarDigital Library
- Grundy, J. and Hosking, J. Supporting Generic Sketching-Based Input of Diagrams in a Domain-Specific Visual Language Meta-Tool. In Pro. ICSE 2007, IEEE Computer Society (2007), 282--291. Google ScholarDigital Library
- Guiard, Y. Asymmetric Division of Labor in Human Skilled Bimanual Action: The Kinematic Chain as a Model, The Journal of Motor Behavior 19, 4 (1987), 486--517.Google ScholarCross Ref
- Han, J. Y. Low-cost multi-touch sensing through frustrated total internal reflection. In Proc. UIST 2005, ACM Press, (2005), 115--118. Google ScholarDigital Library
- Leitner, J.; Powell, J.; Brandl, P.; Seifried, T.; Haller, M.; Dorray, B. & To, P. Flux: a tilting multi-touch and pen based surface, Ext. Abstracts CHI 2009, (2009), 3211--3216. Google ScholarDigital Library
- Malik, S., Ranjan, A., and Balakrishnan, R. Interacting with large displays from a distance with vision-tracked multi-finger gestural input. In Proc. UIST 2005, ACM Press (2005), 43--52. Google ScholarDigital Library
- Moran, T. P., Chiu, P., and van Melle, W. Pen-based interaction techniques for organizing material on an electronic whiteboard. In Proc. UIST 1997, ACM Press (1997), 45--54. Google ScholarDigital Library
- Nielsen, M., Störring, M., Moeslund, T. B. and Granum, E. A procedure for developing intuitive and ergonomic gesture interfaces for HCI. In Proc. Int'l Gesture Workshop 2003, Springer Verlag (2004), 409--420.Google ScholarCross Ref
- Rekimoto, J. SmartSkin: an infrastructure for freehand manipulation on interactive surfaces. In Proc. CHI 2002, ACM Press (2002), 113--120. Google ScholarDigital Library
- Ringel, M.; Ryall, K.; Shen, C.; Forlines, C. & Vernier, F. Release, relocate, reorient, resize: fluid techniques for document sharing on multi-user interactive tables, Ext. Abstracts CHI 2004, ACM Press (2004), 1441--1444. Google ScholarDigital Library
- Shen, C.; Vernier, F. D.; Forlines, C. & Ringel, M. DiamondSpin: an extensible toolkit for around-the-table interaction, In Proc. CHI 2004, ACM Press (2004), 167--174. Google ScholarDigital Library
- Wobbrock, J. O., Morris, M. R., and Wilson, A. D. User-defined gestures for surface computing. In Proc. CHI 2009. ACM Press (2009), 1083--1092. Google ScholarDigital Library
- Wu, M. & Balakrishnan, R. Multi-finger and whole hand gestural interaction techniques for multi-user tabletop displays. In Proc. UIST 2003, ACM Press, (2003), 193--202. Google ScholarDigital Library
- Wu, M.; Shen, C.; Ryall, K.; Forlines, C. & Balakrishnan, R. Gesture Registration, Relaxation, and Reuse for Multi-Point Direct-Touch Surfaces, In Proc. TABLETOP '06, IEEE Computer Society, 185--192. Google ScholarDigital Library
- Yee, K. Two-handed interaction on a tablet display. Ext. Abstracts CHI 20004, ACM Press (2004), 1493--149 Google ScholarDigital Library
Index Terms
- Investigating multi-touch and pen gestures for diagram editing on interactive surfaces
Recommendations
Pen + touch = new tools
UIST '10: Proceedings of the 23nd annual ACM symposium on User interface software and technologyWe describe techniques for direct pen+touch input. We observe people's manual behaviors with physical paper and notebooks. These serve as the foundation for a prototype Microsoft Surface application, centered on note-taking and scrapbooking of ...
Introducing Transient Gestures to Improve Pan and Zoom on Touch Surfaces
CHI '18: Proceedings of the 2018 CHI Conference on Human Factors in Computing SystemsDespite the ubiquity of touch-based input and the availability of increasingly computationally powerful touchscreen devices, there has been comparatively little work on enhancing basic canonical gestures such as swipe-to-pan and pinch-to-zoom. In this ...
Comparing Tangible and Multi-touch Interaction for Interactive Data Visualization Tasks
TEI '16: Proceedings of the TEI '16: Tenth International Conference on Tangible, Embedded, and Embodied InteractionInteractive visualization plays a key role in the analysis of large datasets. It can help users to explore data, investigate hypotheses and find patterns. The easier and more tangible the interaction, the more likely it is to enhance understanding. This ...
Comments