skip to main content
10.1145/3338286.3340142acmconferencesArticle/Chapter ViewAbstractPublication PagesmobilehciConference Proceedingsconference-collections
research-article

Exploring the Potential of Augmented Reality in Domestic Environments

Published:01 October 2019Publication History

ABSTRACT

While Augmented Reality (AR) technologies are becoming increasingly available, our understanding of AR is primarily limited to controlled experiments which address use at work or for entertainment. Little is known about how it could enhance everyday interaction from a user's perspective. Personal use of AR at home may improve how users' interface with information on a daily basis. Through an online survey, we investigated attitudes towards domestic AR. We further explored the opportunities for AR at home in a technology probe. We first introduced the users to AR by offering an AR experience presented through mixed reality smart glasses. We then used a tailor-made tablet application to elicit photos illustrating how users imagine future AR experiences. Finally, we conducted semi-structured interviews based on elicited photos. Our results show that users are eager to benefit from on-demand information, assistance, enhanced sensory perception, and play offered by AR across many locations at home. We contribute insights for future AR systems designed for domestic environments.

References

  1. Ronald T. Azuma. 1997. A Survey of Augmented Reality. Presence: Teleoper. Virtual Environ. 6, 4 (Aug. 1997), 355--385. https://doi.org/10.1162/pres.1997.6.4.355Google ScholarGoogle ScholarDigital LibraryDigital Library
  2. Huidong Bai, Gun A. Lee, Mukundan Ramakrishnan, and Mark Billinghurst. 2014. 3D Gesture Interaction for Handheld Augmented Reality. In SIGGRAPH Asia 2014 Mobile Graphics and Interactive Applications (SA '14). ACM, New York, NY, USA, Article 7, 6 pages. https://doi.org/10.1145/2669062.2669073Google ScholarGoogle ScholarDigital LibraryDigital Library
  3. Ann Blandford, Dominic Furniss, and Stephann Makri. 2016. Qualitative HCI research: Going behind the scenes. Synthesis Lectures on Human-Centered Informatics 9, 1 (2016), 1--115.Google ScholarGoogle ScholarCross RefCross Ref
  4. Kirsten Boehner, Janet Vertesi, Phoebe Sengers, and Paul Dourish. 2007. How HCI Interprets the Probes. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI '07). ACM, New York, NY, USA, 1077--1086. https://doi.org/10.1145/1240624.1240789Google ScholarGoogle ScholarDigital LibraryDigital Library
  5. Leonardo Bonanni, Chia-Hsun Lee, and Ted Selker. 2005. CounterIntelligence: Augmented reality kitchen. In Proc. CHI, Vol. 2239. 45.Google ScholarGoogle Scholar
  6. Wendy H. Chun and Tobias Höllerer. 2013. Real-time Hand Interaction for Augmented Reality on Mobile Phones. In Proceedings of the 2013 International Conference on Intelligent User Interfaces (IUI '13). ACM, New York, NY, USA, 307--314. https://doi.org/10.1145/2449396.2449435Google ScholarGoogle ScholarDigital LibraryDigital Library
  7. Tamara Denning, Zakariya Dehlawi, and Tadayoshi Kohno. 2014. In Situ with Bystanders of Augmented Reality Glasses: Perspectives on Recording and Privacy-mediating Technologies. In Proceedings of the 32Nd Annual ACM Conference on Human Factors in Computing Systems (CHI '14). ACM, New York, NY, USA, 2377--2386. https://doi.org/10.1145/2556288.2557352Google ScholarGoogle ScholarDigital LibraryDigital Library
  8. Arindam Dey, Mark Billinghurst, Robert W. Lindeman, and J. Edward II Swan. 2018. A Systematic Review of 10 Years of Augmented Reality Usability Studies: 2005 to 2014. Frontiers in Robotics and AI 5 (2018). https://doi.org/10.3389/frobt.2018.00037Google ScholarGoogle Scholar
  9. Tom Djajadiningrat, Pei-Yin Chao, SeYoung Kim, Marleen Van Leengoed, and Jeroen Raijmakers. 2016. Mime: An AR-based System Helping Patients to Test Their Blood at Home. In Proceedings of the 2016 ACM Conference on Designing Interactive Systems (DIS '16). ACM, New York, NY, USA, 347--359. https://doi.org/10.1145/2901790.2901915Google ScholarGoogle ScholarDigital LibraryDigital Library
  10. Kevin Fan, Jochen Huber, Suranga Nanayakkara, and Masahiko Inami. 2014. SpiderVision: extending the human field of view for augmented awareness. In Proceedings of the 5th Augmented Human International Conference. ACM, 49.Google ScholarGoogle ScholarDigital LibraryDigital Library
  11. Peter Fröhlich, Antti Oulasvirta, Matthias Baldauf, and Antti Nurminen. 2011. On the Move, Wirelessly Connected to the World. Commun. ACM 54, 1 (Jan. 2011), 132--138. https://doi.org/10.1145/1866739.1866766Google ScholarGoogle Scholar
  12. Markus Funk, Andreas Bächler, Liane Bächler, Thomas Kosch, Thomas Heidenreich, and Albrecht Schmidt. 2017. Working with Augmented Reality?: A Long-Term Analysis of In-Situ Instructions at the Assembly Workplace. In Proceedings of the 10th International Conference on PErvasive Technologies Related to Assistive Environments (PETRA '17). ACM, New York, NY, USA, 222--229. https://doi.org/10.1145/3056540.3056548Google ScholarGoogle ScholarDigital LibraryDigital Library
  13. Bill Gaver, Tony Dunne, and Elena Pacenti. 1999. Design: Cultural Probes. interactions 6, 1 (Jan. 1999), 21--29. https://doi.org/10.1145/291224.291235Google ScholarGoogle ScholarDigital LibraryDigital Library
  14. William W. Gaver, Andrew Boucher, Sarah Pennington, and Brendan Walker. 2004. Cultural Probes and the Value of Uncertainty. interactions 11, 5 (Sept. 2004), 53--56. https://doi.org/10.1145/1015530.1015555Google ScholarGoogle ScholarDigital LibraryDigital Library
  15. Nanna Gorm and Irina Shklovski. 2017. Participant Driven Photo Elicitation for Understanding Activity Tracking: Benefits and Limitations. In Proceedings of the 2017 ACM Conference on Computer Supported Cooperative Work and Social Computing (CSCW '17). ACM, New York, NY, USA, 1350--1361. https://doi.org/10.1145/2998181.2998214Google ScholarGoogle ScholarDigital LibraryDigital Library
  16. Jan Gugenheimer, Pascal Knierim, Christian Winkler, Julian Seifert, and Enrico Rukzio. 2015. UbiBeam: Exploring the Interaction Space for Home Deployed Projector-Camera Systems. In 15th Human-Computer Interaction (INTERACT) (Human-Computer Interaction -- INTERACT 2015). Bamberg, Germany, 350--366. https://doi.org/10.1007/978-3-319-22698-9_23Google ScholarGoogle ScholarDigital LibraryDigital Library
  17. Anuruddha Hettiarachchi and Daniel Wigdor. 2016. Annexing Reality: Enabling Opportunistic Use of Everyday Objects As Tangible Proxies in Augmented Reality. In Proceedings of the 2016 CHI Conference on Human Factors in Computing Systems (CHI '16). ACM, New York, NY, USA, 1957--1967. https://doi.org/10.1145/2858036.2858134Google ScholarGoogle ScholarDigital LibraryDigital Library
  18. Hilary Hutchinson, Wendy Mackay, Bo Westerlund, Benjamin B. Bederson, Allison Druin, Catherine Plaisant, Michel Beaudouin-Lafon, Stéphane Conversy, Helen Evans, Heiko Hansen, Nicolas Roussel, and Björn Eiderbäck. 2003. Technology Probes: Inspiring Design for and with Families. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI '03). ACM, New York, NY, USA, 17--24. https://doi.org/10.1145/642611.642616Google ScholarGoogle ScholarDigital LibraryDigital Library
  19. Jisun Jang and Tomasz Bednarz. 2018. HoloSensor for Smart Home, Health, Entertainment. In ACM SIGGRAPH 2018 Appy Hour (SIGGRAPH '18). ACM, New York, NY, USA, Article 2, 2 pages. https://doi.org/10.1145/3213779.3213786Google ScholarGoogle ScholarDigital LibraryDigital Library
  20. Can Liu, Stephane Huot, Jonathan Diehl, Wendy Mackay, and Michel Beaudouin-Lafon. 2012. Evaluating the Benefits of Real-time Feedback in Mobile Augmented Reality with Hand-held Devices. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI '12). ACM, New York, NY, USA, 2973--2976. https://doi.org/10.1145/2207676.2208706Google ScholarGoogle ScholarDigital LibraryDigital Library
  21. M. Carmen Juan Lizandra, Mariano Alcañiz Raya, Carlos Monserrat, Cristina Botella, Rosa María Baños, and Belén Guerrero. 2005. Using Augmented Reality to Treat Phobias. IEEE Computer Graphics and Applications 25, 6 (2005), 31--37. https://doi.org/10.1109/MCG.2005.143Google ScholarGoogle ScholarDigital LibraryDigital Library
  22. Rosemary Luckin and Danae Stanton Fraser. 2011. Limitless or pointless? An evaluation of augmented reality technology in the school and home. International Journal of Technology Enhanced Learning 3, 5 (2011), 510--524. https://doi.org/10.1504/IJTEL.2011.042102Google ScholarGoogle ScholarDigital LibraryDigital Library
  23. Tuuli Mattelmäki and Katja Battarbee. 2002. Empathy probes. In PDC. 266--271.Google ScholarGoogle Scholar
  24. Janne Paavilainen, Hannu Korhonen, Kati Alha, Jaakko Stenros, Elina Koskinen, and Frans Mayra. 2017. The PokéMon GO Experience: A Location-Based Augmented Reality Mobile Game Goes Mainstream. In Proceedings of the 2017 CHI Conference on Human Factors in Computing Systems (CHI '17). ACM, New York, NY, USA, 2493--2498. https://doi.org/10.1145/3025453.3025871Google ScholarGoogle ScholarDigital LibraryDigital Library
  25. Yvonne Rogers. 2006. Moving on from Weiser's Vision of Calm Computing: Engaging Ubicomp Experiences. In Proceedings of the 8th International Conference on Ubiquitous Computing (UbiComp'06). Springer-Verlag, Berlin, Heidelberg, 404--421. https://doi.org/10.1007/11853565_24Google ScholarGoogle ScholarDigital LibraryDigital Library
  26. M. E. C. Santos, A. Chen, T. Taketomi, G. Yamamoto, J. Miyazaki, and H. Kato. 2014. Augmented Reality Learning Experiences: Survey of Prototype Design and Evaluation. IEEE Transactions on Learning Technologies 7, 1 (Jan 2014), 38--56. https://doi.org/10.1109/TLT.2013.37Google ScholarGoogle ScholarCross RefCross Ref
  27. M. E. C. Santos, A. Chen, T. Taketomi, G. Yamamoto, J. Miyazaki, and H. Kato. 2014. Augmented Reality Learning Experiences: Survey of Prototype Design and Evaluation. IEEE Transactions on Learning Technologies 7, 1 (Jan 2014), 38--56. https://doi.org/10.1109/TLT.2013.37Google ScholarGoogle ScholarCross RefCross Ref
  28. Albrecht Schmidt, Stefan Schneegass, Kai Kunze, Jun Rekimoto, and Woontack Woo. 2017. Workshop on Amplification and Augmentation of Human Perception. In Proceedings of the 2017 CHI Conference Extended Abstracts on Human Factors in Computing Systems (CHI EA '17). ACM, New York, NY, USA, 668--673. https://doi.org/10.1145/3027063.3027088Google ScholarGoogle ScholarDigital LibraryDigital Library
  29. Abigail Sellen, Yvonne Rogers, Richard Harper, and Tom Rodden. 2009. Reflecting Human Values in the Digital Age. Commun. ACM 52, 3 (March 2009), 58--66. https://doi.org/10.1145/1467247.1467265Google ScholarGoogle Scholar
  30. Maeve Serino, Kyla Cordrey, Laura McLaughlin, and Ruth L. Milanaik. 2016. Pokemon Go and augmented virtual reality games: a cautionary commentary for parents and pediatricians. Current Opinion in Pediatrics 28, 5 (2016), 673--677. https://doi.org/10.1097/MOP.0000000000000409Google ScholarGoogle ScholarCross RefCross Ref
  31. Rita Shewbridge, Amy Hurst, and Shaun K. Kane. 2014. Everyday Making: Identifying Future Uses for 3D Printing in the Home. In Proceedings of the 2014 Conference on Designing Interactive Systems (DIS '14). ACM, New York, NY, USA, 815--824. https://doi.org/10.1145/2598510.2598544Google ScholarGoogle ScholarDigital LibraryDigital Library
  32. M P Strzys, S Kapp, M Thees, Jochen Kuhn, P Lukowicz, P Knierim, and A Schmidt. 2017. Augmenting the thermal flux experiment: A mixed reality approach with the HoloLens. The Physics Teacher 55, 6 (2017), 376--377.Google ScholarGoogle ScholarCross RefCross Ref
  33. Bruce Thomas, Ben Close, John Donoghue, John Squires, Phillip De Bondi, and Wayne Piekarski. 2002. First Person Indoor/Outdoor Augmented Reality Application: ARQuake. Personal and Ubiquitous Computing 6, 1 (01 Feb 2002), 75--86. https://doi.org/10.1007/s007790200007Google ScholarGoogle Scholar
  34. Vero Vanden Abeele, Erik Hauters, and Bieke Zaman. 2012. Increasing the Reliability and Validity of Quantitative Laddering Data with LadderUX. In CHI '12 Extended Abstracts on Human Factors in Computing Systems (CHI EA '12). ACM, New York, NY, USA, 2057--2062. https://doi.org/10.1145/2212776.2223752Google ScholarGoogle Scholar
  35. Mark Weiser. 1999. The Computer for the 21st Century. SIGMOBILE Mob. Comput. Commun. Rev. 3, 3 (July 1999), 3--11. https://doi.org/10.1145/329124.329126Google ScholarGoogle ScholarDigital LibraryDigital Library
  36. Robert Xiao, Chris Harrison, and Scott E. Hudson. 2013. WorldKit: Rapid and Easy Creation of Ad-hoc Interactive Applications on Everyday Surfaces. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI '13). ACM, New York, NY, USA, 879--888. https://doi.org/10.1145/2470654.2466113Google ScholarGoogle ScholarDigital LibraryDigital Library

Index Terms

  1. Exploring the Potential of Augmented Reality in Domestic Environments

        Recommendations

        Comments

        Login options

        Check if you have access through your login credentials or your institution to get full access on this article.

        Sign in
        • Published in

          cover image ACM Conferences
          MobileHCI '19: Proceedings of the 21st International Conference on Human-Computer Interaction with Mobile Devices and Services
          October 2019
          646 pages
          ISBN:9781450368254
          DOI:10.1145/3338286

          Copyright © 2019 ACM

          Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than the author(s) must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected].

          Publisher

          Association for Computing Machinery

          New York, NY, United States

          Publication History

          • Published: 1 October 2019

          Permissions

          Request permissions about this article.

          Request Permissions

          Check for updates

          Qualifiers

          • research-article
          • Research
          • Refereed limited

          Acceptance Rates

          Overall Acceptance Rate202of906submissions,22%

        PDF Format

        View or Download as a PDF file.

        PDF

        eReader

        View online with eReader.

        eReader