Jan Rod
Daniel Wessolek
Suranga Nanayakkara
ABSTRACT
Construction and sensing within malleable interfaces is usually limited by a number of constraints. Building the interface from diverse combinations of conductive and nonconductive soft materials, such as fabrics or foams combined with various sensors, complicates the manufacturing process and offers limited options in shaping. In this paper we propose "Unique Topologies for Acoustic Propagation" (UTAP), a novel approach for algorithmic design of malleable tangible interfaces. A fundamental feature of our approach is the implementation of algorithmically generated topologically distinct lattices that, attached to piezoelectric (PZT) transducers, allow us to sense and recognize changes in a modulated acoustic signal on deformation and classify it into different interaction states. Our systematic approach to manufacturing malleable interfaces opens possibilities to design shapes that allow implementation in a wide range of potential use cases. We demonstrate the UTAP approach on multiple interfaces assembled using laser cut and 3D printed lattices in conjunction with silicon compound moulding. Finally, we present a technical evaluation of our method based on studies of four distinct interface designs, assessing performance in sensing and localising simple deformations such as pressing on single and multiple spots, as well as different force levels and actions, including bending and twisting.
- Leap Motion Device. https://www.leapmotion.com. Accessed: 11-03--2016.Google Scholar
- Project Soli, Google ATAP. https://www.google.com/atap/project-soli/. Accessed: 11-03--2016.Google Scholar
- Alankus, G., Lazar, A., May, M., and Kelleher, C. Towards customizable games for stroke rehabilitation. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems, CHI '10, ACM (NY, NY, USA, 2010), 2113--2122. Google ScholarDigital Library
- Amunts, K., Schlaug, G., Jancke, L., Steinmetz, H., Schleicher, A., Dabringhaus, A., and Zilles, K. Motor cortex and hand motor skills: structural compliance in the human brain. Hum Brain Mapp 5, 3 (1997), 206--215.Google ScholarCross Ref
- Augsten, T., Kaefer, K., Meusel, R., Fetzer, C., Kanitz, D., Stoff, T., Becker, T., Holz, C., and Baudisch, P. Multitoe: High-precision interaction with back-projected floors based on high-resolution multi-touch input. In Proceedings of the 23Nd Annual ACM Symposium on User Interface Software and Technology, UIST '10, ACM (NY, NY, USA, 2010), 209--218. Google ScholarDigital Library
- Balaam, M., Rennick Egglestone, S., Fitzpatrick, G., Rodden, T., Hughes, A.-M., Wilkinson, A., Nind, T., Axelrod, L., Harris, E., Ricketts, I., Mawson, S., and Burridge, J. Motivating mobility: Designing for lived motivation in stroke rehabilitation. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems, CHI '11, ACM (NY, NY, USA, 2011), 3073--3082. Google ScholarDigital Library
- Boulanger, C., Boulanger, A., de Greef, L., Kearney, A., Sobel, K., Transue, R., Sweedyk, Z., Dietz, P. H., and Bathiche, S. Stroke rehabilitation with a sensing surface. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems, CHI '13, ACM (NY, NY, USA, 2013), 1243--1246. Google ScholarDigital Library
- Braun, A., Krepp, S., and Kuijper, A. Acoustic tracking of hand activities on surfaces. In Proceedings of the 2Nd International Workshop on Sensor-based Activity Recognition and Interaction, WOAR '15, ACM (NY, NY, USA, 2015), 9:1--9:5. Google ScholarDigital Library
- Brockmeyer, E., Poupyrev, I., and Hudson, S. Papillon: Designing curved display surfaces with printed optics. In Proceedings of the 26th Annual ACM Symposium on User Interface Software and Technology, UIST '13, ACM (NY, NY, USA, 2013), 457--462. Google ScholarDigital Library
- Cassinelli, A., Perrin, S., and Ishikawa, M. Smart laser-scanner for 3d human-machine interface. In CHI '05 Extended Abstracts on Human Factors in Computing Systems, CHI EA '05, ACM (NY, NY, USA, 2005), 1138--1139. Google ScholarDigital Library
- Collins, D. J., Morahan, B., Garcia-Bustos, J., Doerig, C., Plebanski, M., and Neild, A. Two-dimensional single-cell patterning with one cell per well driven by surface acoustic waves. Nature communications 6 (2015).Google Scholar
- Danworaphong, S., Tomoda, M., Matsumoto, Y., Matsuda, O., Ohashi, T., Watanabe, H., Nagayama, M., Gohara, K., Otsuka, P. H., and Wright, O. B. Three-dimensional imaging of biological cells with picosecond ultrasonics. Applied physics letters 106, 16 (2015), 163701.Google Scholar
- Fenster, A., Downey, D. B., and Cardinal, H. N. Three-dimensional ultrasound imaging. Physics in medicine and biology 46, 5 (2001), R67.Google Scholar
- Follmer, S., Johnson, M., Adelson, E., and Ishii, H. deform: An interactive malleable surface for capturing 2.5d arbitrary objects, tools and touch. In Proceedings of the 24th Annual ACM Symposium on User Interface Software and Technology, UIST '11, ACM (NY, NY, USA, 2011), 527--536. Google ScholarDigital Library
- Follmer, S., Leithinger, D., Olwal, A., Cheng, N., and Ishii, H. Jamming user interfaces: Programmable particle stiffness and sensing for malleable and shape-changing devices. In Proceedings of the 25th Annual ACM Symposium on User Interface Software and Technology, UIST '12, ACM (NY, NY, USA, 2012), 519--528. Google ScholarDigital Library
- Geurts, L., Deville, J., Abeele, V. V., Saldien, J., and Vanderloock, K. Skweezee studio: Turn your own plush toys into interactive squeezable objects. In Proceedings of the 8th International Conference on Tangible, Embedded and Embodied Interaction, TEI '14, ACM (NY, NY, USA, 2013), 377--380. Google ScholarDigital Library
- Hall, M., Frank, E., Holmes, G., Pfahringer, B., Reutemann, P., and Witten, I. H. The weka data mining software: An update. SIGKDD Explor. Newsl. 11, 1 (Nov. 2009), 10--18. Google ScholarDigital Library
- Harrison, C., and Hudson, S. E. Scratch input: Creating large, inexpensive, unpowered and mobile finger input surfaces. In Proceedings of the 21st Annual ACM Symposium on User Interface Software and Technology, UIST '08, ACM (NY, NY, USA, 2008), 205--208. Google ScholarDigital Library
- Harrison, C., Schwarz, J., and Hudson, S. E. Tapsense: Enhancing finger interaction on touch surfaces. In Proceedings of the 24th Annual ACM Symposium on User Interface Software and Technology, UIST '11, ACM (NY, NY, USA, 2011), 627--636. Google ScholarDigital Library
- Harrison, C., Tan, D., and Morris, D. Skinput: Appropriating the body as an input surface. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems, CHI '10, ACM (NY, NY, USA, 2010), 453--462. Google ScholarDigital Library
- Harrison, C., Xiao, R., and Hudson, S. Acoustic barcodes: Passive, durable and inexpensive notched identification tags. In Proceedings of the 25th Annual ACM Symposium on User Interface Software and Technology, UIST '12, ACM (NY, NY, USA, 2012), 563--568. Google ScholarDigital Library
- Hofer, R., Naeff, D., and Kunz, A. Flatir: Ftir multi-touch detection on a discrete distributed sensor array. In Proceedings of the 3rd International Conference on Tangible and Embedded Interaction, TEI '09, ACM (NY, NY, USA, 2009), 317--322. Google ScholarDigital Library
- Hook, J., Taylor, S., Butler, A., Villar, N., and Izadi, S. A reconfigurable ferromagnetic input device. In Proceedings of the 22Nd Annual ACM Symposium on User Interface Software and Technology, UIST '09, ACM (NY, NY, USA, 2009), 51--54. Google ScholarDigital Library
- Kato, H., and Kato, T. A camera-based tangible controller for cellular phones. In Proceedings of the 11th International Conference on Human-Computer Interaction with Mobile Devices and Services, MobileHCI '09, ACM (NY, NY, USA, 2009), 63:1--63:2. Google ScholarDigital Library
- Koh, J. T. K. V., Karunanayaka, K., Sepulveda, J., Tharakan, M. J., Krishnan, M., and Cheok, A. D. Liquid interface: A malleable, transient, direct-touch interface. Comput. Entertain. 9, 2 (July 2011), 7:1--7:8. Google ScholarDigital Library
- Kohl, C., Krause, M., Maierhofer, C., and W¨ostmann, J. 2d-and 3d-visualisation of ndt-data using data fusion technique. Materials and Structures 38, 9 (2005), 817--826.Google ScholarCross Ref
- Laput, G., Brockmeyer, E., Hudson, S. E., and Harrison, C. Acoustruments: Passive, acoustically-driven, interactive controls for handheld devices. In Proceedings of the 33rd Annual ACM Conference on Human Factors in Computing Systems, CHI '15, ACM (NY, NY, USA, 2015), 2161--2170. Google ScholarDigital Library
- Laput, G., Chen, X. A., and Harrison, C. Sweepsense: Ad hoc configuration sensing using reflected swept-frequency ultrasonics. In Proceedings of the 21st International Conference on Intelligent User Interfaces, IUI '16, ACM (NY, NY, USA, 2016), 332--335. Google ScholarDigital Library
- Lopes, P., Jota, R., and Jorge, J. A. Augmenting touch interaction through acoustic sensing. In Proceedings of the ACM International Conference on Interactive Tabletops and Surfaces, ITS '11, ACM (NY, NY, USA, 2011), 53--56. Google ScholarDigital Library
- Lowe, M., Yosha, O., Krause, A., Wettach, R., and Krüger, N. Valeo: Alienation gesture-enhanced tactile pain logging. In Proceedings of the Fourth International Conference on Tangible, Embedded, and Embodied Interaction, TEI '10, ACM (NY, NY, USA, 2010), 213--216. Google ScholarDigital Library
- Marzo, A., Seah, S. A., Drinkwater, B. W., Sahoo, D. R., Long, B., and Subramanian, S. Holographic acoustic elements for manipulation of levitated objects. Nature communications 6 (2015).Google Scholar
- Murakami, T., and Nakajima, N. Direct and intuitive input device for 3-d shape deformation. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems, CHI '94, ACM (NY, NY, USA, 1994), 465--470. Google ScholarDigital Library
- Ono, M., Shizuki, B., and Tanaka, J. Touch and activate: Adding interactivity to existing objects using active acoustic sensing. In Proceedings of the 26th Annual ACM Symposium on User Interface Software and Technology, UIST '13, ACM (NY, NY, USA, 2013), 31--40. Google ScholarDigital Library
- Ono, M., Shizuki, B., and Tanaka, J. Sensing touch force using active acoustic sensing. In Proceedings of the Ninth International Conference on Tangible, Embedded, and Embodied Interaction, TEI '15, ACM (NY, NY, USA, 2015), 355--358. Google ScholarDigital Library
- Poupyrev, I., Harrison, C., and Sato, M. Touch E: Touch and gesture sensing for the real world. In Proceedings of the 2012 ACM Conference on Ubiquitous Computing, UbiComp '12, ACM (NY, NY, USA, 2012), 536--536. Google ScholarDigital Library
- Rekimoto, J. Smartskin: An infrastructure for freehand manipulation on interactive surfaces. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems, CHI '02, ACM (NY, NY, USA, 2002), 113--120. Google ScholarDigital Library
- Rekimoto, J., and Schwesig, C. Presenseii: Bi-directional touch and pressure sensing interactions with tactile feedback. In CHI '06 Extended Abstracts on Human Factors in Computing Systems, CHI EA '06, ACM (NY, NY, USA, 2006), 1253--1258. Google ScholarDigital Library
- Rendl, C., Greindl, P., Haller, M., Zirkl, M., Stadlober, B., and Hartmann, P. Pyzoflex: Printed piezoelectric pressure sensing foil. In Proceedings of the 25th Annual ACM Symposium on User Interface Software and Technology, UIST '12, ACM (NY, NY, USA, 2012), 509--518. Google ScholarDigital Library
- Rendl, C., Kim, D., Fanello, S., Parzer, P., Rhemann, C., Taylor, J., Zirkl, M., Scheipl, G., Rothländer, T., Haller, M., and Izadi, S. Flexsense: A transparent self-sensing deformable surface. In Proceedings of the 27th Annual ACM Symposium on User Interface Software and Technology, UIST '14, ACM (NY, NY, USA, 2014), 129--138. Google ScholarDigital Library
- Slyper, R., Poupyrev, I., and Hodgins, J. Sensing through structure: Designing soft silicone sensors. In Proceedings of the Fifth International Conference on Tangible, Embedded, and Embodied Interaction, TEI '11, ACM (NY, NY, USA, 2011), 213--220. Google ScholarDigital Library
- Smith, R. T., Thomas, B. H., and Piekarski, W. Digital foam interaction techniques for 3d modeling. In Proceedings of the 2008 ACM Symposium on Virtual Reality Software and Technology, VRST '08, ACM (NY, NY, USA, 2008), 61--68. Google ScholarDigital Library
- Tanaka, Y., Fukuda, T., Fujiwara, M., and Sano, A. Tactile sensor using acoustic reflection for lump detection in laparoscopic surgery. International Journal of Computer Assisted Radiology and Surgery 10, 2 (2015), 183--193.Google ScholarCross Ref
- Vanderloock, K., Vanden Abeele, V., Suykens, J. A., and Geurts, L. The skweezee system: Enabling the design and the programming of squeeze interactions. In Proceedings of the 26th Annual ACM Symposium on User Interface Software and Technology, UIST '13, ACM (NY, NY, USA, 2013), 521--530. Google ScholarDigital Library
- Wang, H.-S., Hsu, C., Chiu, D., and Tsai, S. N. Using augmented reality gaming system to enhance hand rehabilitation. In 2010 2nd International Conference on Education Technology and Computer, vol. 3 (June 2010), V3--243--V3--246.Google Scholar
- Weigel, M., Lu, T., Bailly, G., Oulasvirta, A., Majidi, C., and Steimle, J. iskin: Flexible, stretchable and visually customizable on-body touch sensors for mobile computing. In Proceedings of the 33rd Annual ACM Conference on Human Factors in Computing Systems, CHI '15, ACM (NY, NY, USA, 2015), 2991--3000. Google ScholarDigital Library
- Willis, K., Brockmeyer, E., Hudson, S., and Poupyrev, I. Printed optics: 3d printing of embedded optical elements for interactive devices. In Proceedings of the 25th Annual ACM Symposium on User Interface Software and Technology, UIST '12, ACM (NY, NY, USA, 2012), 589--598. Google ScholarDigital Library
- Wimmer, R., and Baudisch, P. Modular and deformable touch-sensitive surfaces based on time domain reffectometry. In Proceedings of the 24th Annual ACM Symposium on User Interface Software and Technology, UIST '11, ACM (NY, NY, USA, 2011), 517--526. Google ScholarDigital Library
- Withana, A., Peiris, R., Samarasekara, N., and Nanayakkara, S. zsense: Enabling shallow depth gesture recognition for greater input expressivity on smart wearables. In Proceedings of the 33rd Annual ACM Conference on Human Factors in Computing Systems, CHI '15, ACM (NY, NY, USA, 2015), 3661--3670. Google ScholarDigital Library
- Yao, L., Niiyama, R., Ou, J., Follmer, S., Della Silva, C., and Ishii, H. Pneui: Pneumatically actuated soft composite materials for shape changing interfaces. In Proceedings of the 26th Annual ACM Symposium on User Interface Software and Technology, UIST '13, ACM (NY, NY, USA, 2013), 13--22. Google ScholarDigital Library
Index Terms
- UTAP - Unique Topographies for Acoustic Propagation: Designing Algorithmic Waveguides for Sensing in Interactive Malleable Interfaces
Recommendations
Semitransparent mask technique for relief type surface topographies
Semitransparent mask photolithography can be used for the generation of relief type surfaces with only a single photolithographic exposure. An electron beam lithography process for the fabrication of the photomasks employed in this technique is ...
Semitransparent mask technique for relief type surface topographies
MNE '94: Proceedings of the international conference on Micro- and nano- engineering '94Semitransparent mask photolithography can be used for the generation of relief type surfaces with only a single photolithographic exposure. An electron beam lithography process for the fabrication of the photomasks employed in this technique is ...
Cilllia: 3D Printed Micro-Pillar Structures for Surface Texture, Actuation and Sensing
CHI '16: Proceedings of the 2016 CHI Conference on Human Factors in Computing SystemsThis work presents a method for 3D printing hair-like structures on both flat and curved surfaces. It allows a user to design and fabricate hair geometries that are smaller than 100 micron. We built a software platform to let users quickly define the ...
Comments