Daniel Leithinger
Sean Follmer
Alex Olwal
Hiroshi Ishii
ABSTRACT
We propose a new approach to Physical Telepresence, based on shared workspaces with the ability to capture and remotely render the shapes of people and objects. In this paper, we describe the concept of shape transmission, and propose interaction techniques to manipulate remote physical objects and physical renderings of shared digital content. We investigate how the representation of user's body parts can be altered to amplify their capabilities for teleoperation. We also describe the details of building and testing prototype Physical Telepresence workspaces based on shape displays. A preliminary evaluation shows how users are able to manipulate remote objects, and we report on our observations of several different manipulation techniques that highlight the expressive nature of our system.
Supplemental Material
- Benko, H., Jota, R., and Wilson, A. MirageTable: freehand interaction on a projected augmented reality tabletop. In ACM CHI '12 (2012), 199--208. Google Scholar
Digital Library
- Brave, S., Ishii, H., and Dahley, A. Tangible interfaces for remote collaboration and communication. In ACM CSCW '98 (Nov. 1998), 169--178. Google ScholarDigital Library
- Cutkosky, M., and Howe, R. Human grasp choice and robotic grasp analysis. In Dextrous Robot Hands, S. Venkataraman and T. Iberall, Eds. Springer New York, 1990, 5--31. Google ScholarDigital Library
- Everitt, K. M., Klemmer, S. R., Lee, R., and Landay, J. A. Two worlds apart: bridging the gap between physical and virtual media for distributed design collaboration. In ACM CHI '03 (Apr. 2003), 553--560. Google ScholarDigital Library
- Festo. WaveHandling: Transporting and sorting in one. In http://www.festo.com/cms/en corp/13136.htm (2013).Google Scholar
- Follmer, S., Leithinger, D., Olwal, A., Cheng, N., and Ishii, H. Jamming user interfaces: programmable particle stiffness and sensing for malleable and shape-changing devices. In ACM UIST '12 (Oct. 2012), 519--528. Google ScholarDigital Library
- Follmer, S., Leithinger, D., Olwal, A., Hogge, A., and Ishii, H. inFORM: dynamic physical affordances and constraints through shape and object actuation. In ACM UIST '13 (Oct. 2013), 417--426. Google ScholarDigital Library
- Genecov, A. M., Stanley, A. A., and Okamura, A. M. Perception of a Haptic Jamming display: Just noticeable differences in stiffness and geometry. In 2014 IEEE Haptics Symposium (HAPTICS), IEEE (Feb. 2014), 333--338.Google ScholarCross Ref
- Gross, M., Lang, S., Strehlke, K., Moere, A. V., Staadt, O., Wüurmlin, S., Naef, M., Lamboray, E., Spagno, C., Kunz, A., Koller-Meier, E., Svoboda, T., and Van Gool, L. blue-c: a spatially immersive display and 3D video portal for telepresence. ACM Transactions on Graphics 22, 3 (July 2003), 819--827. Google ScholarDigital Library
- Hilliges, O., Kim, D., Izadi, S., Weiss, M., and Wilson, A. HoloDesk: direct 3d interactions with a situated see-through display. In ACM CHI '12 (May 2012), 2421--2430. Google ScholarDigital Library
- Ishii, H., and Kobayashi, M. ClearBoard: a seamless medium for shared drawing and conversation with eye contact. In ACM CHI '92 (June 1992), 525--532. Google ScholarDigital Library
- Iwata, H., Yano, H., Nakaizumi, F., and Kawamura, R. Project FEELEX: adding haptic surface to graphics. In ACM SIGGRAPH '01 (Aug. 2001), 469--476. Google ScholarDigital Library
- Lee, M. K., and Takayama, L. "Now, i have a body": uses and social norms for mobile remote presence in the workplace. In ACM CHI '11 (May 2011), 33--42. Google ScholarDigital Library
- Leithinger, D., Follmer, S., Olwal, A., Luescher, S., Hogge, A., Lee, J., and Ishii, H. Sublimate: state-changing virtual and physical rendering to augment interaction with shape displays. In ACM CHI '13 (Apr. 2013), 1441--1450. Google ScholarDigital Library
- Leithinger, D., Lakatos, D., DeVincenzi, A., Blackshaw, M., and Ishii, H. Direct and gestural interaction with relief: a 2.5D shape display. In ACM UIST '11 (Oct. 2011), 541--548. Google ScholarDigital Library
- Lum, M. J., Rosen, J., Lendvay, T. S., Sinanan, M. N., and Hannaford, B. Effect of time delay on telesurgical performance. In IEEE ICRA'09 (2009), 4246--4252. Google ScholarDigital Library
- Mann, S. Telepointer: Hands-Free Completely Self Contained Wearable Visual Augmented Reality without Headwear and without any Infrastructural Reliance. In 2012 16th International Symposium on Wearable Computers (Oct. 2000), 177--178. Google ScholarDigital Library
- Mueller, F. F., Cole, L., O'Brien, S., and Walmink, W. Airhockey over a distance. In CHI '06 extended abstracts (Apr. 2006), 1133--1138. Google ScholarDigital Library
- Pangaro, G., Maynes-Aminzade, D., and Ishii, H. The actuated workbench: computer-controlled actuation in tabletop tangible interfaces. In ACM UIST '02 (Oct. 2002), 181--190. Google ScholarDigital Library
- Paul, R. P. Robot manipulators: mathematics, programming, and control: the computer control of robot manipulators. Richard Paul, 1981. Google ScholarDigital Library
- Paulos, E., and Canny, J. PRoP: personal roving presence. In ACM CHI '98 (Jan. 1998), 296--303. Google ScholarDigital Library
- Piper, B., and Ishii, H. PegBlocks: a learning aid for the elementary classroom. In ACM CHI '02 extended abstracts (Apr. 2002), 686--687. Google ScholarDigital Library
- Poupyrev, I., Nashida, T., and Okabe, M. Actuation and Tangible User Interfaces: the Vaucanson Duck, Robots, and Shape Displays. In ACM TEI '07 (Feb. 2007), 205--212. Google ScholarDigital Library
- Raskar, R., Welch, G., Cutts, M., Lake, A., Stesin, L., and Fuchs, H. The office of the future: a unified approach to image-based modeling and spatially immersive displays. In ACM SIGGRAPH '98 (July 1998), 179--188. Google ScholarDigital Library
- Rasmussen, M. K., Pedersen, E. W., Petersen, M. G., and Hornbæ k, K. Shape-changing interfaces: a review of the design space and open research questions. In ACM CHI '12 (May 2012), 735--744. Google ScholarDigital Library
- Richter, J., Thomas, B. H., Sugimoto, M., and Inami, M. Remote active tangible interactions. In ACM TEI '07 (Feb. 2007), 39--42. Google ScholarDigital Library
- Riedenklau, E., Hermann, T., and Ritter, H. An integrated multi-modal actuated tangible user interface for distributed collaborative planning. In ACM TEI '12 (Feb. 2012), 169--174. Google ScholarDigital Library
- Sodhi, R. S., Jones, B. R., Forsyth, D., Bailey, B. P., and Maciocci, G. BeThere: 3D mobile collaboration with spatial input. In ACM CHI '13 (Apr. 2013), 179--188. Google ScholarDigital Library
- Staub, C., Ono, K., Mayer, H., Knoll, A., Ulbrich, H., and Bauernschmitt, R. Remote minimally invasive surgery --haptic feedback and selective automation in medical robotics. Applied Bionics and Biomechanics 8, 2 (Apr. 2011), 221--236. Google ScholarDigital Library
- Tang, J. C., and Minneman, S. VideoWhiteboard: video shadows to support remote collaboration. In ACM CHI '91 (Mar. 1991), 315--322. Google ScholarDigital Library
- Tang, J. C., and Minneman, S. L. Videodraw: a video interface for collaborative drawing. ACM Transactions on Information Systems 9, 2 (Apr. 1991), 170--184. Google ScholarDigital Library
- Tsui, K. M., Desai, M., Yanco, H. A., and Uhlik, C. Exploring use cases for telepresence robots. In ACM/IEEE HRI '11 (Mar. 2011), 11--18. Google ScholarDigital Library
- Wilson, A. D., and Robbins, D. C. Playtogether: Playing games across multiple interactive tabletops. In IUI Workshop on Tangible Play: Research and Design for Tangible and Tabletop Games (2007).Google Scholar
- Yarosh, S., Tang, A., Mokashi, S., and Abowd, G. D. "almost touching": parent-child remote communication using the sharetable system. In ACM CSCW '13 (Feb. 2013), 181--192. Google ScholarDigital Library
Index Terms
- Physical telepresence: shape capture and display for embodied, computer-mediated remote collaboration
Recommendations
inFORM: dynamic physical affordances and constraints through shape and object actuation
UIST '13: Proceedings of the 26th annual ACM symposium on User interface software and technologyPast research on shape displays has primarily focused on rendering content and user interface elements through shape output, with less emphasis on dynamically changing UIs. We propose utilizing shape displays in three different ways to mediate ...
Kinetic Blocks: Actuated Constructive Assembly for Interaction and Display
UIST '15: Proceedings of the 28th Annual ACM Symposium on User Interface Software & TechnologyPin-based shape displays not only give physical form to digital information, they have the inherent ability to accurately move and manipulate objects placed on top of them. In this paper we focus on such object manipulation: we present ideas and ...
shapeShift: 2D Spatial Manipulation and Self-Actuation of Tabletop Shape Displays for Tangible and Haptic Interaction
CHI '18: Proceedings of the 2018 CHI Conference on Human Factors in Computing SystemsWe explore interactions enabled by 2D spatial manipulation and self-actuation of a tabletop shape display. To explore these interactions, we developed shapeShift, a compact, high-resolution (7 mm pitch), mobile tabletop shape display. shapeShift can be ...
Comments