Parastoo Abtahi
Sean Follmer
ABSTRACT
In this work, we utilize visuo-haptic illusions to improve the perceived performance of encountered-type haptic devices, specifically shape displays, in virtual reality. Shape displays are matrices of actuated pins that travel vertically to render physical shapes; however, they have limitations such as low resolution, small display size, and low pin speed. To address these limitations, we employ illusions such as redirection, scaling, and retargeting that take advantage of the visual dominance effect, the idea that vision often dominates when senses conflict. Our evaluation of these techniques suggests that redirecting sloped lines with angles less than 40 degrees onto a horizontal line is an effective technique for increasing the perceived resolution of the display. Scaling up the virtual object onto the shape display by a factor less than 1.8x can also increase the perceived resolution. Finally, using vertical redirection a perceived 3x speed increase can be achieved.
Supplemental Material
- Bruno Araujo, Ricardo Jota, Varun Perumal, Jia Xian Yao, Karan Singh, and Daniel Wigdor. 2016. Snake Charmer: Physically Enabling Virtual Objects. In Proceedings of the TEI'16: Tenth International Conference on Tangible, Embedded, and Embodied Interaction. ACM, 218--226. Google Scholar
Digital Library
- Naoya Asamura, Tomoyuki Shinohara, Yoshiharu Tojo, and Hiroyuki Shinoda. 2001. Necessary spatial resolution for realistic tactile feeling display. In ICRA. Citeseer, 1851--1856.Google ScholarCross Ref
- Mahdi Azmandian, Mark Hancock, Hrvoje Benko, Eyal Ofek, and Andrew D. Wilson. 2016. Haptic Retargeting: Dynamic Repurposing of Passive Haptics for Enhanced Virtual Reality Experiences. In Proceedings of the 2016 CHI Conference on Human Factors in Computing Systems (CHI '16). ACM, New York, NY, USA, 1968--1979. Google ScholarDigital Library
- Yuki Ban, Takashi Kajinami, Takuji Narumi, Tomohiro Tanikawa, and Michitaka Hirose. 2012a. Modifying an Identified Angle of Edged Shapes Using Pseudo-haptic Effects. Springer Berlin Heidelberg, Berlin, Heidelberg, 25--36. Google ScholarDigital Library
- Y. Ban, T. Kajinami, T. Narumi, T. Tanikawa, and M. Hirose. 2012b. Modifying an identified curved surface shape using pseudo-haptic effect. In 2012 IEEE Haptics Symposium (HAPTICS). 211--216. Google ScholarDigital Library
- Yuki Ban, Takuji Narumi, Tomohiro Tanikawa, and Michitaka Hirose. 2014. Displaying Shapes with Various Types of Surfaces Using Visuo-haptic Interaction. In Proceedings of the 20th ACM Symposium on Virtual Reality Software and Technology (VRST '14). ACM, New York, NY, USA, 191--196. Google ScholarDigital Library
- Hrvoje Benko, Christian Holz, Mike Sinclair, and Eyal Ofek. 2016. NormalTouch and TextureTouch: High-fidelity 3D Haptic Shape Rendering on Handheld Virtual Reality Controllers. In Proceedings of the 29th Annual Symposium on User Interface Software and Technology. ACM, 717--728. Google ScholarDigital Library
- Lung-Pan Cheng, Eyal Ofek, Christian Holz, Hrvoje Benko, and Andrew D. Wilson. 2017. Sparse Haptic Proxy: Touch Feedback in Virtual Environments Using a General Passive Prop. In Proceedings of the 2017 CHI Conference on Human Factors in Computing Systems (CHI '17). ACM, New York, NY, USA, 3718--3728. Google ScholarDigital Library
- Inrak Choi and Sean Follmer. 2016. Wolverine: A Wearable Haptic Interface for Grasping in VR. In Proceedings of the 29th Annual Symposium on User Interface Software and Technology. ACM, 117--119. Google ScholarDigital Library
- William Peine Dimitrios A. Kontarinis, Jae S. Son, Shigeaki Robert D. Howe, Jun Rekimoto, and Yasufumi Yamaji. 1995. A Tactile Shape Sensing and Display System for Teleoperated Manipulation. In IEEE International Conference on Robotics and Automation.Google ScholarCross Ref
- Lionel Dominjon, Anatole Lécuyer, J-M Burkhardt, Paul Richard, and Simon Richir. 2005. Influence of control/display ratio on the perception of mass of manipulated objects in virtual environments. In Virtual Reality, 2005. Proceedings. VR 2005. IEEE. IEEE, 19--25. Google ScholarDigital Library
- Sean Follmer, Daniel Leithinger, Alex Olwal, Akimitsu Hogge, and Hiroshi Ishii. 2013. inFORM: Dynamic Physical Affordances and Constraints Through Shape and Object Actuation. In Proceedings of the 26th Annual ACM Symposium on User Interface Software and Technology (UIST '13). ACM, New York, NY, USA, 417--426. Google ScholarDigital Library
- James J. Gibson. 1933. Adaptation, after-effect and contrast in the perception of curved lines. In Journal of Experimental Psychology (16). 1--31.Google Scholar
- James J. Gibson. 1962. Observations on Active Touch. Psychological Review 6 (1962), 477--491.Google ScholarCross Ref
- Mar Gonzalez-Franco and Jaron Lanier. 2017. Model of Illusions and Virtual Reality. 8 (06 2017).Google Scholar
- Mark Goulthorpe, Mark Burry, and Grant Dunlop. 2001. Aegis Hyposurface©: The Bordering of University and Practice. (2001).Google Scholar
- David Hecht and Miriam Reiner. 2009. Sensory dominance in combinations of audio, visual and haptic stimuli. Experimental Brain Research 193, 2 (2009), 307--314.Google ScholarCross Ref
- Koichi Hirota and Michitaka Hirose. 1995. Simulation and presentation of curved surface in virtual reality environment through surface display. In Virtual Reality Annual International Symposium, 1995. Proceedings. IEEE, 211--216. Google ScholarDigital Library
- Hiroo Iwata, Hiroaki Yano, Fumitaka Nakaizumi, and Ryo Kawamura. 2001. Project FEELEX: Adding Haptic Surface to Graphics. In Proceedings of the 28th Annual Conference on Computer Graphics and Interactive Techniques (SIGGRAPH '01). ACM, New York, NY, USA, 469--476. Google ScholarDigital Library
- I. Jang and D. Lee. 2014. On utilizing pseudo-haptics for cutaneous fingertip haptic device. In 2014 IEEE Haptics Symposium (HAPTICS). 635--639.Google Scholar
- Robert S. Kennedy, Norman E. Lane, Kevin S. Berbaum, and Michael G Lilienthal. 1993. Simulator Sickness Questionnaire: An Enhanced Method for Quantifying Simulator Sickness. The International Journal of Aviation Psychology 3, 3 (1993), 203--220.Google ScholarCross Ref
- Roberta L Klatzky, Susan J Lederman, and Dana E Matula. 1993. Haptic exploration in the presence of vision. Journal of Experimental Psychology: Human Perception and Performance 19, 4 (1993), 726.Google ScholarCross Ref
- Roberta L. Klatzky, Susan J. Lederman, and Catherine Reed. 1987. There's More to Touch Than Meets the Eye: The Salience of Object Attributes for Haptics with and Without Vision. Journal of Experimental Psychology: General 116, 4 (1987), 356--369.Google ScholarCross Ref
- Luv Kohli. 2010. Redirected touching: Warping space to remap passive haptics. In 2010 IEEE Symposium on 3D User Interfaces (3DUI). 129--130. Google ScholarDigital Library
- Luv Kohli, Mary C. Whitton, and Frederick P. Brooks. 2012. Redirected Touching: The Effect of Warping Space on Task Performance. In IEEE Symposium on 3D User Interfaces ((3DUIâ´ Z12). 105--112.Google Scholar
- Anatole Lécuyer. 2009. Simulating Haptic Feedback Using Vision: A Survey of Research and Applications of Pseudo-haptic Feedback. Presence: Teleoper. Virtual Environ. 18, 1 (Jan. 2009), 39--53. Google ScholarDigital Library
- S. J. Lederman and L. A. Jones. 2011. Tactile and Haptic Illusions. IEEE Transactions on Haptics 4, 4 (October 2011), 273--294. Google ScholarDigital Library
- Y. Lee, I. Jang, and D. Lee. 2015. Enlarging just noticeable differences of visual-proprioceptive conflict in VR using haptic feedback. In 2015 IEEE World Haptics Conference (WHC). 19--24.Google Scholar
- Daniel Leithinger. 2015. Grasping information and collaborating through shape displays. Ph.D. Dissertation. Massachusetts Institute of Technology.Google Scholar
- Daniel Leithinger, Sean Follmer, Alex Olwal, and Hiroshi Ishii. 2014. Physical Telepresence: Shape Capture and Display for Embodied, Computer-mediated Remote Collaboration. In Proceedings of the 27th Annual ACM Symposium on User Interface Software and Technology (UIST '14). ACM, New York, NY, USA, 461--470. Google ScholarDigital Library
- Daniel Leithinger, Sean Follmer, Alex Olwal, and Hiroshi Ishii. 2015. Shape Displays: Spatial Interaction with Dynamic Physical Form. IEEE Computer Graphics and Applications 35, 5 (Sept 2015), 5--11.Google ScholarDigital Library
- Daniel Leithinger, Sean Follmer, Alex Olwal, Samuel Luescher, Akimitsu Hogge, Jinha Lee, and Hiroshi Ishii. 2013. Sublimate: State-changing Virtual and Physical Rendering to Augment Interaction with Shape Displays. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI '13). ACM, New York, NY, USA, 1441--1450. Google ScholarDigital Library
- Daniel Leithinger and Hiroshi Ishii. 2010. Relief: A Scalable Actuated Shape Display. In Proceedings of the Fourth International Conference on Tangible, Embedded, and Embodied Interaction (TEI '10). ACM, New York, NY, USA, 221--222. Google ScholarDigital Library
- Thomas H Massie, J Kenneth Salisbury, and others. 1994. The phantom haptic interface: A device for probing virtual objects. In Proceedings of the ASME winter annual meeting, symposium on haptic interfaces for virtual environment and teleoperator systems, Vol. 55. Citeseer, 295--300.Google Scholar
- Yoky Matsuoka, Sonya J. Allin, and Roberta L. Klatzky. 2002. The tolerance for visual feedback distortions in a virtual environment. Physiology Behavior 77, 4 (2002), 651 -- 655.Google ScholarCross Ref
- William A McNeely. 1993. Robotic graphics: A new approach to force feedback for virtual reality. In Virtual Reality Annual International Symposium, 1993., 1993 IEEE. IEEE, 336--341. Google ScholarDigital Library
- Yoichi Ochiai, Kota Kumagai, Takayuki Hoshi, Satoshi Hasegawa, and Yoshio Hayasaki. 2016. Cross-field aerial haptics: Rendering haptic feedback in air with light and acoustic fields. In Proceedings of the 2016 CHI Conference on Human Factors in Computing Systems. ACM, 3238--3247. Google ScholarDigital Library
- GonÃgalo Padrao, Mar Gonzalez-Franco, Maria V. Sanchez-Vives, Mel Slater, and Antoni Rodriguez-Fornells. 2016. Violating body movement semantics: Neural signatures of self-generated and external-generated errors. NeuroImage 124, Part A (2016), 147 -- 156.Google Scholar
- Ivan Poupyrev, Tatsushi Nashida, Shigeaki Maruyama, Jun Rekimoto, and Yasufumi Yamaji. 2004. Lumen: Interactive Visual and Shape Display for Calm Computing. In ACM SIGGRAPH 2004 Emerging Technologies (SIGGRAPH '04). ACM, New York, NY, USA, 17--. Google ScholarDigital Library
- MW Riley, DJ Cochran, and CA Schanbacher. 1985. Force capability differences due to gloves. Ergonomics 28, 2 (1985), 441--447.Google ScholarCross Ref
- Irvin Rock and Jack Victor. 1964. Vision and Touch: An Experimentally Created Conflict between the Two Senses. Science 143, 3606 (1964), 594--596.Google ScholarCross Ref
- M. Shimojo, M. Shinohara, and Y. Fukui. 1999. Human shape recognition performance for 3D tactile display. IEEE Transactions on Systems, Man, and Cybernetics Part A: Systems and Humans 29, 6 (Nov 1999), 637--644. Google ScholarDigital Library
- Alexa F. Siu, Eric J. Gonzalez, Shenli Yuan, Jason Ginsberg, Allen Zhao, and Sean Follmer. 2017. shapeShift: A Mobile Tabletop Shape Display for Tangible and Haptic Interaction. In Adjunct Publication of the 30th Annual ACM Symposium on User Interface Software and Technology (UIST '17). ACM, New York, NY, USA, 77--79. Google ScholarDigital Library
- Rajinder Sodhi, Matthew Glisson, and Ivan Poupyrev. 2013. AIREAL: tactile gaming experiences in free air. In ACM SIGGRAPH 2013 Emerging Technologies. ACM, 2. Google ScholarDigital Library
- Andrew A Stanley, James C Gwilliam, and Allison M Okamura. 2013. Haptic jamming: A deformable geometry, variable stiffness tactile display using pneumatics and particle jamming. In World Haptics Conference (WHC), 2013. IEEE, 25--30.Google ScholarCross Ref
- F. Steinicke, G. Bruder, J. Jerald, H. Frenz, and M. Lappe. 2010. Estimation of Detection Thresholds for Redirected Walking Techniques. IEEE Transactions on Visualization and Computer Graphics 16, 1 (Jan 2010), 17--27. Google ScholarDigital Library
- Ian R Summers and Craig M Chanter. 2002. A broadband tactile array on the fingertip. The Journal of the Acoustical Society of America 112, 5 (2002), 2118--2126.Google ScholarCross Ref
- Susuma Tachi, Taro Maeda, Ryokichi Hirata, and Hiroshi Hoshino. 1994. A construction method of virtual haptic space. In proceedings of the 4th International Conference on Artificial Reality and Tele-Existence (ICAT'94). 131--138.Google Scholar
- Faisal Taher, John Hardy, Abhijit Karnik, Christian Weichel, Yvonne Jansen, Kasper Hornbæk, and Jason Alexander. 2015. Exploring Interactions with Physically Dynamic Bar Charts. In Proceedings of the 33rd Annual ACM Conference on Human Factors in Computing Systems (CHI '15). ACM, New York, NY, USA, 3237--3246. Google ScholarDigital Library
- Dimitar Valkov, Alexander Giesler, and Klaus H. Hinrichs. 2014. Imperceptible Depth Shifts for Touch Interaction with Stereoscopic Objects. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI '14). ACM, New York, NY, USA, 227--236. Google ScholarDigital Library
- Christopher R Wagner, Susan J Lederman, and Robert D Howe. 2002. A tactile shape display using RC servomotors. In Haptic Interfaces for Virtual Environment and Teleoperator Systems, 2002. HAPTICS 2002. Proceedings. 10th Symposium on. IEEE, 354--355. Google ScholarDigital Library
- Parris S Wellman, William J Peine, Gregg Favalora, and Robert D Howe. 1998. Mechanical design and control of a high-bandwidth shape memory alloy tactile display. In Experimental robotics V. Springer, 56--66. Google ScholarDigital Library
- Haihong Zhu and Wayne John Book. 2003. Control concepts for digital clay. Georgia Institute of Technology.Google Scholar
Index Terms
- Visuo-Haptic Illusions for Improving the Perceived Performance of Shape Displays
Recommendations
Visuo-haptic Illusions for Linear Translation and Stretching using Physical Proxies in Virtual Reality
CHI '21: Proceedings of the 2021 CHI Conference on Human Factors in Computing SystemsProviding haptic feedback when manipulating virtual objects is an essential part of immersive virtual reality experiences; however, it is challenging to replicate all of an object's properties and characteristics. We propose the use of visuo-haptic ...
Haptic Revolver: Touch, Shear, Texture, and Shape Rendering on a Reconfigurable Virtual Reality Controller
CHI '18: Proceedings of the 2018 CHI Conference on Human Factors in Computing SystemsWe present Haptic Revolver, a handheld virtual reality controller that renders fingertip haptics when interacting with virtual surfaces. Haptic Revolver's core haptic element is an actuated wheel that raises and lowers underneath the finger to render ...
Haptic Retargeting: Dynamic Repurposing of Passive Haptics for Enhanced Virtual Reality Experiences
CHI '16: Proceedings of the 2016 CHI Conference on Human Factors in Computing SystemsManipulating a virtual object with appropriate passive haptic cues provides a satisfying sense of presence in virtual reality. However, scaling such experiences to support multiple virtual objects is a challenge as each one needs to be accompanied with ...
Comments