Pedro Lopes
Sijing You
Lung-Pan Cheng
Sebastian Marwecki
Patrick Baudisch
ABSTRACT
We explore how to add haptics to walls and other heavy objects in virtual reality. When a user tries to push such an object, our system actuates the user's shoulder, arm, and wrist muscles by means of electrical muscle stimulation, creating a counter force that pulls the user's arm backwards. Our device accomplishes this in a wearable form factor.
In our first user study, participants wearing a head-mounted display interacted with objects provided with different types of EMS effects. The repulsion design (visualized as an electrical field) and the soft design (visualized as a magnetic field) received high scores on "prevented me from passing through" as well as "realistic".
In a second study, we demonstrate the effectiveness of our approach by letting participants explore a virtual world in which all objects provide haptic EMS effects, including walls, gates, sliders, boxes, and projectiles.
Supplemental Material
- Anthony D. Kurtz. Tactile feel apparatus for use with robotic operations, U.S. Patent 650, 643, filed January 8, 2007, issued July 10, 2008.Google Scholar
- M. Bergamasco. The GLAD-IN-ART Project. In Virtual Reality SE-19, 251--258.Google Scholar
- Brooks Jr., and P. Frederick. What's real about virtual reality? In IEEE Computer Graphics and Applications 19, 6, 16--27, 1999. rotate arm (infraspinatus) arm up (biceps) arm down triceps) wrist up (carpis ulnaris)Google Scholar
- Daniel K. Y. Chen, Iain A. Anderson, Cameron G. Walker and Thor F. Besier. Lower Extremity Lateral Skin Stretch Perception for Haptic Feedback. In Haptics IEEE Transactions, 9, 62--68, 2016.Google ScholarDigital Library
- Farzam Farbiz, Zhou Hao Yu, Corey Manders, and Waqas Ahmad. An electrical muscle stimulation haptic feedback for mixed reality tennis game. In ACM SIGGRAPH 2007 posters (SIGGRAPH '07), Article 140.Google Scholar
- James D. Foley. Interfaces for advanced computing. Sci. Am. 257, 4, 126--135, 1987. Google ScholarDigital Library
- Sean Follmer, Daniel Leithinger, Alex Olwal, N. Cheng, and Hiroshii Ishii. Jamming user interfaces: programmable particle stiffness and sensing for malleable and shape-changing devices. In Proceedings of the 25th annual ACM symposium on User interface software and technology (UIST '12), 519--528.Google Scholar
- Grigore C. Burdea. Haptic Issues in Virtual Environments. In Proceedings of Computer Graphics International (GCI '00), 2000.Google Scholar
- P. Gruenbaum, W. McNeely, H. Sowizral, T. Overman, and B. Knutson. Implementation of dynamic robotic graphics for a virtual control panel. In Proc. Presence'97, 118--126. Google ScholarDigital Library
- Heather Culbertson, Juan Jose Lopez Delgado, Katherine J. Kuchenbecker. One hundred data-driven haptic texture models and open-source methods for rendering on 3d objects. In Proc. IEEE Haptics Symposium, 2014. Google ScholarCross Ref
- J. Hollerbach and S. Jacobsen. Haptic Interfaces for Teleoperation and Virtual Environments. In Proc. Workshop on Simulation and Interaction in Virtual Environments'95, 13--15.Google Scholar
- B.E. Insko. Passive haptics significantly enhances virtual environments. Dissertation at University of North Carolina at Chapel Hill, 2001.Google ScholarDigital Library
- S. Jeong, N. Hashimoto, and S. Makoto A novel interaction system with force feedback between real - and virtual human: an entertainment system: "virtual catch ball". In Proc. ACE'04, 61--66.Google Scholar
- Jun Rekimoto. Traxion: a tactile interaction device with virtual force sensation. In Proceedings of the 26th annual ACM symposium on User interface software and technology (UIST '13), 427--432.Google Scholar
- K.E. Overvlieta, J.B.J. Smeetsa, and E. Brennera. The use of proprioception and tactile information in haptic search. In Acta Psychologica 129, 1, 83--90, 2008. Google ScholarCross Ref
- Kazuki Nagai, Soma Tanoue, Katsuhito Akahane, and Makoto Sato. Wearable 6-DoF wrist haptic device "SPIDAR-W". In SIGGRAPH Asia 2015 Haptic Media And Contents Design (SA '15), Article 19.Google Scholar
- J. Kramer. Force feedback and Texture Simulating Interface device, U.S. Patent 5, 184, 319.Google Scholar
- A. Kron, and G. Schmidt. Multi-fingered Tactile Feedback from Virtual and Remote Environments. In Proc. HAPTICS'03, 16--23. Google ScholarCross Ref
- W. Lindeman, Y. Yanagida, H. Noma, and K. Hosaka. Wearable vibrotactile systems for virtual contact and information display. In Virtual Reality 9, 2, 203--213, 2006. Google ScholarDigital Library
- Pedro Lopes and Patrick Baudisch. Muscle-propelled force feedback: bringing force feedback to mobile devices. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI '13), 25772580.Google Scholar
- Lung-Pan Cheng, Thijs Roumen, Hannes Rantzsch, Sven Köhler, Patrick Schmidt, Robert Kovacs, Johannes Jasper, Jonas Kemper, and Patrick Baudisch. TurkDeck: Physical Virtual Reality Based on People. In Proceedings of the 28th Annual ACM Symposium on User Interface Software & Technology (UIST '15), 417426. Google ScholarDigital Library
- Luv Kohli, Eric Burns, Dorian Miller, and Henry Fuchs. Combining passive haptics with redirected walking. In Proceedings of the 2005 International Conference on Augmented Teleexistence 57, 4, 253--254. Google ScholarDigital Library
- Mahdi Azmandian, Mark Hancock, Hrvoje Benko, Eyal Ofek, and Andrew D. Wilson. Haptic Retargeting: Dynamic Repurposing of Passive Haptics for Enhanced Virtual Reality Experiences. In Proceedings of the 2016 CHI Conference on Human Factors in Computing Systems (CHI '16), 1968--1979.Google Scholar
- Martin Usoh, Kevin Arthur, Mary C. Whitton, Rui Bastos, Anthony Steed, Mel Slater, and Frederick P. Brooks, Jr. Walking > walking-in-place > flying, in virtual environments. In Proceedings of the 26th annual conference on Computer graphics and interactive techniques (SIGGRAPH '99), 359--364. Google ScholarDigital Library
- Max Pfeiffer, Tim Dünte, Stefan Schneegass, Florian Alt, and Michael Rohs. Cruise Control for Pedestrians: Controlling Walking Direction using Electrical Muscle Stimulation. In Proceedings of the 33rd Annual ACM Conference on Human Factors in Computing Systems (CHI '15), 2505--2514. Google ScholarDigital Library
- Mohamed Benali-Khoudja, Moustapha Hafez, JeanMarc Alexandre, and A. Kheddar. Tactile interfaces: a state-of-the-art survey, In Proceedings of International Symposium on Robotics (ISR'04).Google Scholar
- Murayama, J., Bougrila, L., Luo, Y., Akahane, K., Hasegawa, S., Hirsbrunner, B., Sato, M. SPIDAR G&G: a two-handed haptic interface for bimanual VR interaction. In Proc. EuroHaptics'04, 138-- 146.Google Scholar
- G. Norman. Likert scales, levels of measurement, and the "laws" of statistics. In Advances in Health Sciences Education 15, 5, 625--632, 2010. Google ScholarCross Ref
- Pedro Lopes, Alexandra Ion, and Patrick Baudisch. Impacto: Simulating Physical Impact by Combining Tactile Stimulation with Electrical Muscle Stimulation. In Proceedings of the 28th Annual ACM Symposium on User Interface Software & Technology (UIST '15), 1119. Google ScholarDigital Library
- P. Strojnik, A. Kralj, and I. Ursic. Programmed sixchannel electrical stimulator for complex stimulation of leg muscles during walking. In IEEE Trans. Biomed. Eng. 26, 112.Google Scholar
- Emi Tamaki, Takashi Miyaki, and Jun Rekimoto. PossessedHand: techniques for controlling human hands using electrical muscles stimuli. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI '11), 543--552. Google ScholarDigital Library
- Timothy M. Simon, Ross T. Smith, and Bruce H. Thomas. Wearable jamming mitten for virtual environment haptics. In Proceedings of the 2014 ACM International Symposium on Wearable Computers (ISWC '14), 67--70.Google Scholar
- Dzmitry Tsetserukou, Katsunari Sato, and Susumu Tachi. ExoInterfaces: novel exosceleton haptic interfaces for virtual reality, augmented sport and rehabilitation. In Proceedings of the 1st Augmented Human International Conference (AH '10), article 1. Google ScholarDigital Library
- A. McNeely. Robotic graphics: a new approach to force feedback for virtual reality. In Proceedings of the Annual IEEE International Symposium on Virtual Reality, 336--341, 1999.Google Scholar
- William R. Sherman and Alan B. Craig. Understanding Virtual Reality: Interface, Application, and Design. ed. Morgan Kaufmann, Series in Computer Graphics.Google Scholar
- Xiaochi Gu, Yifei Zhang, Weize Sun, Yuanzhe Bian, Dao Zhou, and Per Ola Kristensson. Dexmo: An Inexpensive and Lightweight Mechanical Exoskeleton for Motion Capture and Force Feedback in VR. In Proceedings of the 2016 CHI Conference on Human Factors in Computing Systems (CHI '16), 1991--1995.Google Scholar
- Y. Yokokohji, Y. Sugawara, J. Kinoshita, and Yoshikawa T. Mechano-Media that Transmit Kinesthetic Knowledge from a Human to Other Humans. In Proc. Robotics Research'01, 499--512. Google ScholarCross Ref
Index Terms
- Providing Haptics to Walls & Heavy Objects in Virtual Reality by Means of Electrical Muscle Stimulation
Recommendations
Adding Force Feedback to Mixed Reality Experiences and Games using Electrical Muscle Stimulation
CHI '18: Proceedings of the 2018 CHI Conference on Human Factors in Computing SystemsWe present a mobile system that enhances mixed reality experiences and games with force feedback by means of electrical muscle stimulation (EMS). The benefit of our approach is that it adds physical forces while keeping the users' hands free to interact ...
Wrist-Mounted Haptic Feedback for Support of Virtual Reality in Combination with Electrical Muscle Stimulation and Hanger Reflex
Human-Computer Interaction. Recognition and Interaction TechnologiesAbstractHanger reflex and electrical muscle stimulation (EMS) have been explored in previous haptic device research as novel methods for providing force sensations. This paper proposes a method that combines EMS and hanger reflex for haptic feedback on ...
Integrating Haptics with Augmented Reality in a Femoral Palpation and Needle Insertion Training Simulation
This paper presents a virtual environment for training femoral palpation and needle insertion, the opening steps of many interventional radiology procedures. A novel augmented reality simulation called PalpSim has been developed that allows the trainees ...
Comments