Adalberto L. Simeone
Eduardo Velloso
Hans Gellersen
ABSTRACT
Experiencing Virtual Reality in domestic and other uncontrolled settings is challenging due to the presence of physical objects and furniture that are not usually defined in the Virtual Environment. To address this challenge, we explore the concept of Substitutional Reality in the context of Virtual Reality: a class of Virtual Environments where every physical object surrounding a user is paired, with some degree of discrepancy, to a virtual counterpart. We present a model of potential substitutions and validate it in two user studies. In the first study we investigated factors that affect participants' suspension of disbelief and ease of use. We systematically altered the virtual representation of a physical object and recorded responses from 20 participants. The second study investigated users' levels of engagement as the physical proxy for a virtual object varied. From the results, we derive a set of guidelines for the design of future Substitutional Reality experiences.
Supplemental Material
- Barbagli, F., Salisbury, K., Ho, C., Spence, C., and Tan, H. Z. Haptic discrimination of force direction and the influence of visual information. ACM TAP 3, 2 (Apr. 2006), 125--135. Google Scholar
Digital Library
- Carlin, A. S., Hoffman, H. G., and Weghorst, S. Virtual reality and tactile augmentation in the treatment of spider phobia: a case report. Behav. Res. Ther. 35, 2 (1997), 153--158.Google ScholarCross Ref
- Cosco, F., Garre, C., Bruno, F., Muzzupappa, M., and Otaduy, M. A. Visuo-haptic mixed reality with unobstructed tool-hand integration. IEEE TVCG 19, 1 (2013), 159--172. Google ScholarDigital Library
- e Silva, A. d. S., and Delacruz, G. C. Hybrid reality games reframed potential uses in educational contexts. SAGE GAC 1, 3 (2006), 231--251.Google Scholar
- Gibson, J. J. The theory of affordances. Perceiving, Acting and Knowing (1977).Google Scholar
- Hinckley, K., Pausch, R., Goble, J. C., and Kassell, N. F. Passive real-world interface props for neurosurgical visualization. In Proc. CHI '94, 452--458. Google ScholarDigital Library
- Hoffmann, H. Physically touching virtual objects using tactile augmentation enhances the realism of virtual environments. In Proc. VR '98, 59--63. Google ScholarDigital Library
- Insko, B. E. Passive haptics significantly enhances virtual environments. PhD thesis, UNC, 2001. Google ScholarDigital Library
- Izadi, S., Kim, D., Hilliges, O., Molyneaux, D., Newcombe, R., Kohli, P., Shotton, J., Hodges, S., Freeman, D., Davison, A., et al. Kinectfusion: real-time 3d reconstruction and interaction using a moving depth camera. In Proc. UIST '11, 559--568. Google ScholarDigital Library
- Kanade, T., Rander, P., and Narayanan, P. Virtualized reality: Constructing virtual worlds from real scenes. IEEE Multimedia 4, 1 (1997), 34--47. Google ScholarDigital Library
- Knoerlein, B., Székely, G., and Harders, M. Visuo-haptic collaborative augmented reality ping-pong. In Proc. ACE '07, 91--94. Google ScholarDigital Library
- Kohli, L., Whitton, M. C., and Brooks, F. Redirected touching: The effect of warping space on task performance. In Proc. 3DUI '12, 105--112.Google Scholar
- Kotranza, A., and Lok, B. Virtual human+ tangible interface= mixed reality human an initial exploration with a virtual breast exam patient. In Proc. VR '08, 99--106.Google Scholar
- Kushner, D. Virtual reality's moment. IEEE Spectrum 51, 1 (Jan. 2014), 34--37.Google Scholar
- Kwon, E., Kim, G. J., and Lee, S. Effects of sizes and shapes of props in tangible augmented reality. In Proc. ISMAR '09, 201--202. Google ScholarDigital Library
- Matsuoka, Y., Allin, S. J., and Klatzky, R. L. The tolerance for visual feedback distortions in a virtual environment. Physiol. Behav. 77, 4 (2002), 651--655.Google ScholarCross Ref
- McNeely, W. A. Robotic graphics: a new approach to force feedback for virtual reality. In Proc. VR '93, 336--341. Google ScholarDigital Library
- Milgram, P., and Kishino, F. A taxonomy of mixed reality visual displays. IEICE Trans. Inf.& Syst. 77, 12 (1994), 1321--1329.Google Scholar
- Milgram, P., Takemura, H., Utsumi, A., and Kishino, F. Augmented reality: A class of displays on the reality-virtuality continuum. In Proc. SPIE 2351 (1995), 282--292.Google Scholar
- Reda, K., Febretti, A., Knoll, A., Aurisano, J., Leigh, J., Johnson, A. E., Papka, M. E., and Hereld, M. Visualizing large, heterogeneous data in hybrid-reality environments. IEEE CGA 33, 4 (2013), 38--48. Google ScholarDigital Library
- Robertson, G., Czerwinski, M., and Van Dantzich, M. Immersion in desktop virtual reality. In Proc. UIST '97, 11--19. Google ScholarDigital Library
- Slater, M., Usoh, M., and Steed, A. Taking steps: The influence of a walking technique on presence in virtual reality. ACM TOCHI 2, 3 (Sept. 1995), 201--219. Google ScholarDigital Library
- Steinicke, F., Bruder, G., Kohli, L., Jerald, J., and Hinrichs, K. Taxonomy and implementation of redirection techniques for ubiquitous passive haptic feedback. In Cyberworlds '08, 217--223. Google ScholarDigital Library
- Suzuki, K., Wakisaka, S., and Fujii, N. Substitutional reality system: a novel experimental platform for experiencing alternative reality. Sci. Rep. 2 (2012).Google Scholar
- Tachi, S., Maeda, T., Hirata, R., and Hoshino, H. A construction method of virtual haptic space. In Proc. ICAT '94, 131--138.Google Scholar
- Usoh, M., Arthur, K., Whitton, M. C., Bastos, R., Steed, A., Slater, M., and Brooks Jr, F. P. Walking > walking-in-place > flying, in virtual environments. In Proc. SIGGRAPH '99, 359--364. Google ScholarDigital Library
- Williams, B., Narasimham, G., Rump, B., McNamara, T. P., Carr, T. H., Rieser, J., and Bodenheimer, B. Exploring large virtual environments with an hmd when physical space is limited. In Proc. APGV '07, 41--48. Google ScholarDigital Library
Index Terms
- Substitutional Reality: Using the Physical Environment to Design Virtual Reality Experiences
Recommendations
VR Grabbers: Ungrounded Haptic Retargeting for Precision Grabbing Tools
UIST '18: Proceedings of the 31st Annual ACM Symposium on User Interface Software and TechnologyHaptic feedback in VR is important for realistic simulation in virtual reality. However, recreating the haptic experience for hand tools in VR traditionally requires hardware with precise actuators, adding complexity to the system. We propose Ungrounded ...
Reality jockey: lifting the barrier between alternate realities through audio and haptic feedback
CHI '13: Proceedings of the SIGCHI Conference on Human Factors in Computing SystemsWe present Reality Jockey, a system that confuses the participant's perception of the reality by mixing in a recorded past-reality. The participant will be immersed in a spatialized 3D sound environment that is a mix of sounds from the reality and from ...
Physical hand interaction for controlling multiple virtual objects in virtual reality
IWISC '18: Proceedings of the 3rd International Workshop on Interactive and Spatial ComputingImmersive virtual reality systems often strive to support realistic physical interaction through direct hand control, but it is not often possible to configure the physical environment to exactly match the virtual environment. We study methods that ...
Comments