Cathy Fang
Yang Zhang
Matthew Dworman
Chris Harrison
ABSTRACT
Today's virtual reality (VR) systems allow users to explore immersive new worlds and experiences through sight. Unfortunately, most VR systems lack haptic feedback, and even high-end consumer systems use only basic vibration motors. This clearly precludes realistic physical interactions with virtual objects. Larger obstacles, such as walls, railings, and furniture are not simulated at all. In response, we developed Wireality, a self-contained worn system that allows for individual joints on the hands to be accurately arrested in 3D space through the use of retractable wires that can be programmatically locked. This allows for convincing tangible interactions with complex geometries, such as wrapping fingers around a railing. Our approach is lightweight, low-cost, and low-power, criteria important for future, worn consumer uses. In our studies, we further show that our system is fast-acting, spatially-accurate, high-strength, comfortable, and immersive.
Supplemental Material
- Amazon.com. Aideepen 1.5A L298N 2-Way DC Motor Driver Module. Last Retrieved September 19, 2019 from: https://amazon.com/dp/B075S368Y2Google Scholar
- Bruno Araujo, Ricardo Jota, Varun Perumal, Jia Xian Yao, Karan Singh, and Daniel Wigdor. 2016. Snake Charmer: Physically Enabling Virtual Objects. In Proceedings of the TEI '16: Tenth International Conference on Tangible, Embedded, and Embodied Interaction (TEI '16). ACM, NY, NY, USA, 218--226. DOI: https://doi.org/10.1145/2839462.2839484Google ScholarDigital Library
- Paolo Arcara, Luigi Di Stefano, Stefano Mattoccia, Claudio Melchiorri, and Gabriele Vassura. "Perception of depth information by means of a wire-actuated haptic interface." In Proceedings 2000 ICRA. Millennium Conference. IEEE International Conference on Robotics and Automation. Symposia Proceedings (Cat. No. 00CH37065), vol. 4, pp. 3443--3448. IEEE, 2000.Google Scholar
- Paolo Arcara, and Claudio Melchiorri. "3D position measurement based on force sensors for a one-wire haptic interface." In Proceedings of the 16th IEEE Instrumentation and Measurement Technology Conference (IMTC '99), Cat. No. 99CH36309, vol. 2, pp. 1272--1277. IEEE, 1999.Google Scholar
- Hrvoje Benko, Christian Holz, Mike Sinclair, and Eyal Ofek. 2016. NormalTouch and TextureTouch: Highfidelity 3D Haptic Shape Rendering on Handheld Virtual Reality Controllers. In Proceedings of the 29th Annual Symposium on User Interface Software and Technology (UIST '16). ACM, NY, NY, USA, 717--728. DOI: https://doi.org/10.1145/2984511.2984526Google ScholarDigital Library
- C. Bonivento, A. Eusebi, C. Melchiorri, M. Montanari, and G. Vassura. "WireMan: A portable wire manipulator for touch-rendering of bas-relief virtual surfaces." In 1997 In Proceedings of 8th International Conference on Advanced Robotics (ICAR'97), pp. 13--18. IEEE, 1997.Google Scholar
- Daniel K.Y. Chen, Jean-Baptiste Chossat, and Peter B. Shull. 2019. HaptiVec: Presenting Haptic Feedback Vectors in Handheld Controllers using Embedded Tactile Pin Arrays. In Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems (CHI '19). ACM, NY, NY, USA, Paper 171, 11 pages. DOI: https://doi.org/10.1145/3290605.3300401Google ScholarDigital Library
- Inrak Choi, Elliot W. Hawkes, David L. Christensen, Christopher J. Ploch, and Sean Follmer. "Wolverine: A wearable haptic interface for grasping in virtual reality." In 2016 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS), pp. 986--993. IEEE, 2016.Google Scholar
- Inrak Choi, Heather Culbertson, Mark R. Miller, Alex Olwal, and Sean Follmer. 2017. Grabity: A Wearable Haptic Interface for Simulating Weight and Grasping in Virtual Reality. In Proceedings of the 30th Annual ACM Symposium on User Interface Software and Technology (UIST '17). ACM, NY, NY, USA, 119--130. DOI: https://doi.org/10.1145/3126594.3126599Google ScholarDigital Library
- Inrak Choi, Eyal Ofek, Hrvoje Benko, Mike Sinclair, and Christian Holz. 2018. CLAW: A Multifunctional Handheld Haptic Controller for Grasping, Touching, and Triggering in Virtual Reality. In Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems (CHI '18). ACM, NY, NY, USA, Paper 654, 13 pages. DOI: https://doi.org/10.1145/3173574.3174228Google ScholarDigital Library
- CyberTouch2. Retrieved September 14, 2019 from: http://www.cyberglovesystems.com/cybertouch2/Google Scholar
- Alexandra Delazio, Ken Nakagaki, Roberta L. Klatzky, Scott E. Hudson, Jill Fain Lehman, and Alanson P. Sample. 2018. Force Jacket: Pneumatically-Actuated Jacket for Embodied Haptic Experiences. In Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems (CHI '18). ACM, NY, NY, USA, Paper 320, 12 pages. DOI: https://doi.org/10.1145/3173574.3173894Google ScholarDigital Library
- 12V DC suction micro electromagnet. Last Retrieved September 19, 2019 from: https://ebay.com/itm/12VDC-suction-micro-electromagnet-spring-push-pulltype-rod-solenoid-magnet-VvV/123830128835Google Scholar
- Facebook Inc. Oculus Rift. Last Retrieved September 16, 2019. from: https://www.oculus.com/riftGoogle Scholar
- Facebook Inc. Oculus Quest. Last Retrieved September 19, 2019. from: https://www.oculus.com/questGoogle Scholar
- Hossein S. Farahani, and Jeha Ryu. "Design and control of a wire-driven haptic device: Hapticpen." 2005.Google Scholar
- Flexguard. RSCC Sub-Mini Retractor. Last Retrieved September 19, 2019 from: https://flexguard.com/collections/retractors/products/rs cc-retractorGoogle Scholar
- Gemperle, C. Kasabach, J. Stivoric, M. Bauer, and R. Martin. 1998. Design for Wearability. In Proceedings of the 2nd IEEE International Symposium on Wearable Computers (ISWC '98). IEEE Computer Society, Washington, DC, USA, 116-.Google Scholar
- Clément Gosselin. "Cable-driven parallel mechanisms: state of the art and perspectives." Mechanical Engineering Reviews, 1, no. 1 (2014): DSM0004DSM0004.Google ScholarCross Ref
- João Guerreiro, Hernisa Kacorri, Jeffrey P. Bigham, Edward Cutrell, Daisuke Sato, Dragan Ahmetovic, and Chieko Asakawa. 2019. Hacking Blind Navigation: "In-Sight: Tension-Based Feedback for Navigation" In Extended Abstracts of the 2019 CHI Conference on Human Factors in Computing Systems (CHI EA '19). ACM, NY, NY, USA, Paper W10, 8 pages. DOI: https://doi.org/10.1145/3290607.3299015Google ScholarDigital Library
- Jan Gugenheimer, Dennis Wolf, Eythor R. Eiriksson, Pattie Maes, and Enrico Rukzio. 2016. GyroVR: Simulating Inertia in Virtual Reality using Head Worn Flywheels. In Proceedings of the 29th Annual Symposium on User Interface Software and Technology (UIST '16). ACM, NY, NY, USA, 227--232. DOI: https://doi.org/10.1145/2984511.2984535Google ScholarDigital Library
- Abhishek Gupta, and Marcia K. O'Malley. "Design of a haptic arm exoskeleton for training and rehabilitation." IEEE/ASME Transactions on mechatronics, 11, no. 3 (2006): 280--289.Google Scholar
- HaptX Inc. VR haptic glove. Retrieved September 14, 2019 from: https://haptx.comGoogle Scholar
- Seongkook Heo, Christina Chung, Geehyuk Lee, and Daniel Wigdor. 2018. Thor's Hammer: An Ungrounded Force Feedback Device Utilizing Propeller-Induced Propulsive Force. In Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems (CHI '18). ACM, NY, NY, USA, Paper 525, 11 pages. DOI: https://doi.org/10.1145/3173574.3174099Google ScholarDigital Library
- Ronan Hinchet, Velko Vechev, Herbert Shea, and Otmar Hilliges. 2018. DextrES: Wearable Haptic Feedback for Grasping in VR via a Thin Form-Factor Electrostatic Brake. In Proceedings of the 31st Annual ACM Symposium on User Interface Software and Technology (UIST '18). ACM, NY, NY, USA, 901--912. DOI: https://doi.org/10.1145/3242587.3242657Google ScholarDigital Library
- Matthias Hoppe, Pascal Knierim, Thomas Kosch, Markus Funk, Lauren Futami, Stefan Schneegass, Niels Henze, Albrecht Schmidt, and Tonja Machulla. 2018. VRHapticDrones: Providing Haptics in Virtual Reality through Quadcopters. In Proceedings of the 17th International Conference on Mobile and Ubiquitous Multimedia (MUM 2018). ACM, NY, NY, USA, 718. DOI: https://doi.org/10.1145/3282894.3282898Google ScholarDigital Library
- Zhu Hou, Yuru Zhang, and Yi Yang. "Enhancing touch screen games through a cable-driven force feedback device." In 2012 International Conference on Virtual Reality and Visualization, pp. 56--61. IEEE, 2012.Google Scholar
- HTC Corporation. Vive. Last Retrieved September 20 2019 from https://www.vive.com/Google Scholar
- Masahiro Ishii and Makoto Sato. 1994. A 3d spatial interface device using tensed strings. Presence: Teleoper. Virtual Environ. 3, 1 (January 1994), 81--86. DOI=http://dx.doi.org/10.1162/pres.1994.3.1.81Google ScholarDigital Library
- Ali Israr and Ivan Poupyrev. 2011. Tactile brush: drawing on skin with a tactile grid display. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI '11). ACM, NY, NY, USA, 2019--2028. DOI: https://doi.org/10.1145/1978942.1979235Google ScholarDigital Library
- Saurabh Jadhav, Vikas Kannanda, Bocheng Kang, Michael T. Tolley, and Jurgen P. Schulze. "Soft robotic glove for kinesthetic haptic feedback in virtual reality environments." Electronic Imaging 2017, no. 3 (2017): 19--24.Google ScholarCross Ref
- Leap Motion Inc. Leap Motion. Last Retrieved September 16, 2019 from: https://www.leapmotion.comGoogle Scholar
- Jaeyeon Lee, Mike Sinclair, Mar Gonzalez-Franco, Eyal Ofek, and Christian Holz. 2019. TORC: A Virtual Reality Controller for In-Hand High-Dexterity Finger Interaction. In Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems (CHI '19). ACM, NY, NY, USA, Paper 71, 13 pages. DOI: https://doi.org/10.1145/3290605.3300301Google ScholarDigital Library
- Robert W. Lindeman, Yasuyuki Yanagida, Haruo Noma, and Kenichi Hosaka. "Wearable vibrotactile systems for virtual contact and information display." Virtual Reality, 9, no. 2--3 (2006): 203--213.Google Scholar
- Pedro Lopes, Sijing You, Lung-Pan Cheng, Sebastian Marwecki, and Patrick Baudisch. 2017. Providing Haptics to Walls & Heavy Objects in Virtual Reality by Means of Electrical Muscle Stimulation. In Proceedings of the 2017 CHI Conference on Human Factors in Computing Systems (CHI '17). ACM, NY, NY, USA, 1471--1482. DOI: https://doi.org/10.1145/3025453.3025600Google ScholarDigital Library
- Nuratiqa Natrah Mansor, Muammad Herman Jamaluddin, and Ahamad Zaki Shukor. 'Concept and Application of Virtual Reality Haptic Technology: A Review." Journal of Theoretical & Applied Information Technology, 95, no. 14 (2017).Google Scholar
- Markforged, Inc. 800cc Onyx Filament Spool. Last Retrieved September 19, 2019 from https://markforged.com/product/onyx-filament/Google Scholar
- Claudio Melchiorri, Gabriele Vassura, and Paolo Arcara. "What kind of haptic perception can we get with a one-wire interface?." In Proceedings 1999 IEEE International Conference on Robotics and Automation (Cat. No. 99CH36288C), vol. 2, pp. 1620--1625. IEEE, 1999.Google Scholar
- Victor Adriel de Jesus Oliveira, Luciana Nedel, Anderson Maciel, and Luca Brayda. "Localized magnification in vibrotactile HMDs for accurate spatial awareness." In International Conference on Human Haptic Sensing and Touch Enabled Computer Applications, pp. 55--64. Springer, Cham, 2016.Google Scholar
- Martin J-D. Otis, Thien-Ly Nguyen-Dang, Thierry Laliberte, Denis Ouellet, Denis Laurendeau, and Clément Gosselin. "Cable tension control and analysis of reel transparency for 6-dof haptic foot platform on a cable-driven locomotion interface." International Journal of Electrical and Electronics Engineering, 3, no. 1 (2009): 16--29.Google Scholar
- Roshan Lalintha Peiris, Wei Peng, Zikun Chen, Liwei Chan, and Kouta Minamizawa. 2017. ThermoVR: Exploring Integrated Thermal Haptic Feedback with Head Mounted Displays. In Proceedings of the 2017 CHI Conference on Human Factors in Computing Systems (CHI '17). ACM, NY, NY, USA, 5452--5456. DOI: https://doi.org/10.1145/3025453.3025824Google ScholarDigital Library
- Usman Sargaana, H. S. Farahani, J. Lee, Jeha Ryu, and W. Woo. "billiARds: Augmented Reality System with Wearable Force-Feedback Device." In International Conference on Human Computer Interaction. 2005.Google Scholar
- Henning Schmidt. "HapticWalker-A novel haptic device for walking simulation." In Proceedings of EuroHaptics, vol. 2, pp. 60--67. 2004.Google Scholar
- Erik H. Skorina, Ming Luo, and Cagdas D. Onal. "A soft robotic wearable wrist device for kinesthetic haptic feedback." Frontiers in Robotics and AI, 5 (2018): 83.Google ScholarCross Ref
- Kahye Song, Sung Hee Kim, Sungho Jin, Sohyun Kim, Sunho Lee, Jun-Sik Kim, Jung-Min Park, and Youngsu Cha. "Pneumatic actuator and flexible piezoelectric sensor for soft virtual reality glove system." Scientific reports, 9, no. 1 (2019): 8988.Google ScholarCross Ref
- Evan Strasnick, Christian Holz, Eyal Ofek, Mike Sinclair, and Hrvoje Benko. 2018. Haptic Links: Bimanual Haptics for Virtual Reality Using Variable Stiffness Actuation. In Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems (CHI '18). ACM, NY, NY, USA, Paper 644, 12 pages. DOI: https://doi.org/10.1145/3173574.3174218Google ScholarDigital Library
- Yuqian Sun, Shigeo Yoshida, Takuji Narumi, and Michitaka Hirose. 2019. PaCaPa: A Handheld VR Device for Rendering Size, Shape, and Stiffness of Virtual Objects in Tool-based Interactions. In Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems (CHI '19). ACM, NY, NY, USA, Paper 452, 12 pages. DOI: https://doi.org/10.1145/3290605.3300682Google ScholarDigital Library
- Taclim Inc. VR haptic boot. Retrieved September 14, 2019 from https://taclim.cerevo.com/en/Google Scholar
- PJRC Inc. Teensy 3.2. Retrieved September 16, 2019 from: https://www.pjrc.com/store/teensy32.htmlGoogle Scholar
- Shan-Yuan Teng, Tzu-Sheng Kuo, Chi Wang, Chihuan Chiang, Da-Yuan Huang, Liwei Chan, and BingYu Chen. 2018. PuPoP: Pop-up Prop on Palm for Virtual Reality. In Proceedings of the 31st Annual ACM Symposium on User Interface Software and Technology (UIST '18). ACM, NY, NY, USA, 5--17. DOI: https://doi.org/10.1145/3242587.3242628Google ScholarDigital Library
- Hsin-Ruey Tsai, Jun Rekimoto, and Bing-Yu Chen. 2019. ElasticVR: Providing Multilevel ContinuouslyChanging Resistive Force and Instant Impact Using Elasticity for VR. In Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems (CHI '19). ACM, NY, NY, USA, 220. DOI: https://doi.org/10.1145/3290605.3300450Google ScholarDigital Library
- VRGluv Inc. VR haptic glove. Retrieved September 14, 2019 from https://www.vrgluv.com/technologyGoogle Scholar
- Eric Whitmire, Hrvoje Benko, Christian Holz, Eyal Ofek, and Mike Sinclair. 2018. Haptic Revolver: Touch, Shear, Texture, and Shape Rendering on a Reconfigurable Virtual Reality Controller. In Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems (CHI '18). ACM, NY, NY, USA, Paper 86, 12 pages. DOI: https://doi.org/10.1145/3173574.3173660Google ScholarDigital Library
- Robert L. Williams II "Cable-suspended haptic interface." International Journal of Virtual Reality, 3, no. 3 (1998): 13--21.Google ScholarCross Ref
- Yi Yang, and Yuru Zhang. "A new cable-driven haptic device for integrating kinesthetic and cutaneous display." In 2009 ASME/IFToMM International Conference on Reconfigurable Mechanisms and Robots, pp. 386--391. IEEE, 2009.Google Scholar
- Yuhang Zhao, Cynthia L. Bennett, Hrvoje Benko, Edward Cutrell, Christian Holz, Meredith Ringel Morris, and Mike Sinclair. 2018. Enabling People with Visual Impairments to Navigate Virtual Reality with a Haptic and Auditory Cane Simulation. In Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems (CHI '18). ACM, NY, NY, USA, Paper 116, 14 pages. DOI: https://doi.org/10.1145/3173574.3173690Google ScholarDigital Library
- Ma Zhou, and Pinhas Ben-Tzvi. "RML glove-An exoskeleton glove mechanism with haptics feedback." IEEE/ASME Transactions on Mechatronics, 20, no. 2 (2014): 641--652.Google Scholar
Index Terms
- Wireality: Enabling Complex Tangible Geometries in Virtual Reality with Worn Multi-String Haptics
Recommendations
Integrating Haptics with Augmented Reality in a Femoral Palpation and Needle Insertion Training Simulation
This paper presents a virtual environment for training femoral palpation and needle insertion, the opening steps of many interventional radiology procedures. A novel augmented reality simulation called PalpSim has been developed that allows the trainees ...
Using haptics to improve immersion in virtual environments
ICCS'06: Proceedings of the 6th international conference on Computational Science - Volume Part IICurrent immersive Virtual Reality (VR) system strategies do not fully support dynamic Human Computer Interaction (HCI) and since there is a growing need for better immersion, due consideration should be given to integrate additional modalities for ...
Enabling Reusable Haptic Props for Virtual Reality by Hand Displacement
MuC '21: Proceedings of Mensch und Computer 2021Virtual Reality (VR) enables compelling visual experiences. However, providing haptic feedback is still challenging. Previous work suggests utilizing haptic props to overcome such limitations and presents evidence that props could function as a single ...
Comments