Skip to main content
SpringerLink
Log in

An authorable context-aware augmented reality system to assist the maintenance technicians

  • ORIGINAL ARTICLE
  • Published:
The International Journal of Advanced Manufacturing Technology Aims and scope Submit manuscript

Abstract

The increasing complexity and the technology advancement of equipment pose challenges to the maintenance technicians nowadays. Augmented reality (AR) technology can be used to assist the maintenance technicians by providing useful information through visual interactions, e.g., superimposing the maintenance instructions virtually on the real equipment. However, to improve the usability of the state-of-the-art AR-assisted maintenance systems in routine and ad hoc maintenance activities, the virtual information provided should be adapted to the various contexts, i.e., context relevant. For example, the information provided should accord to the status of the activity and the user’s expertise level. In addition, the rendered AR contents should not be “read-only”, such that the maintenance technicians become passive information receivers. Providing the technicians with the means to interact with the AR contents actively is useful as they can rectify any incorrect AR contents that have been created by the AR developers and author AR contents to record and share the accumulated knowledge and experience on equipment maintenance with other technicians. In this paper, an authorable context-aware AR System (ACARS) is proposed to assist the maintenance technicians. To make ACARS context-aware and authorable, a bi-directional authoring tool, which enables the AR developers to create context-relevant information via a desktop 2D user interface and the maintenance technicians to author AR contents on-site, is proposed. A prototype system has been developed, and a case study has been conducted to demonstrate the usability of ACARS.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Similar content being viewed by others

References

  1. Campos J, Jantunen E, Prakash O (2009) A web and mobile device architecture for mobile e-maintenance. Int J Adv Manuf Technol 45(1–2):71–80

    Article  Google Scholar 

  2. Setchi R, White D (2003) The development of a hypermedia maintenance manual for an advanced manufacturing company. Int J Adv Manuf Technol 22(5–6):456–464

    Article  Google Scholar 

  3. Zhou F, Duh HB-L, Billinghurst M (2008) Trends in augmented reality tracking, interaction and display: a review of ten years of ISMAR. 7th IEEE International Symposium on Mixed and Augmented Reality, Cambridge UK, pp 193–202

  4. Dey AK (2001) Understanding and using context. Pers Ubiquit Comput 5(1):4–7

    Article  Google Scholar 

  5. Byun HE, Cheverst K (2004) Utilizing context history to provide dynamic adaptations. Appl Artif Intell 18(6):533–548

    Article  Google Scholar 

  6. Feiner S, Macintyre B, Seligmann D (1993) Knowledge-based augmented reality. Commun ACM 36:53–62

    Article  Google Scholar 

  7. Friedrich W (2002) ARVIKA-augmented reality for development, production and service. International Symposium on Mixed and Augmented Reality, Darmstadt, Germany, pp 3–4

  8. Schwald B, Figue J, Chauvineau E, Hong FV, Robert A, Arbolino M, Schnaider M, de Laval B, de Rauly FD, Anez FG, Baldo O, Santos J (2001) STARMATE: using augmented reality technology for computer guided maintenance of complex mechanical elements. Proceedings of eBusiness and eWork Conference (e2001), Venice-Italy, October 2001, pp 17–19

  9. Savioja P, Järvinen P, Karhela T, Siltanen P, Woodward C (2007) Developing a mobile, service-based augmented reality tool for modern maintenance work. Proceedings of the 2nd international conference on Virtual Reality, Beijing, China, pp 554–563

  10. ARTESAS—advanced augmented reality technologies for industrial service applicationshttp://www.artesas.de

  11. Lee S, Akin O (2011) Augmented reality-based computational fieldwork support for equipment operations and maintenance. Autom Constr 20(4):338–352

    Article  Google Scholar 

  12. Didier JY, Roussel D (2005) AMRA: augmented reality assistance for train maintenance tasks. ISMAR’05: Workshop on Industrial Augmented Reality pp xvii–xviii

  13. Klein G, Murray D (2007) Parallel tracking and mapping for small AR workspaces. International Symposium on Mixed and Augmented Reality, Nara, Japan, pp 225–234

  14. Goose S, Sudarsky S, Zhang X, Navab N (2003) Speech-enabled augmented reality supporting mobile industrial maintenance. IEEE Pervas Comput 2(1):65–70

    Article  Google Scholar 

  15. Park HM, Lee SH, Choi JS (2008) Wearable augmented reality system using gaze interaction. 7th IEEE International Symposium on Mixed and Augmented Reality, Cambridge, UK, pp 175–176

  16. Jacob RJK (1993) Eye-movement-based human–computer interaction techniques: toward non-command interfaces. Advances in human–computer interaction. Ablex, Norwood, New Jersey, vol 4, chapter 6, pp 151–190

  17. Henderson SJ, Feiner S (2010) Opportunistic tangible user interfaces for augmented reality. IEEE Trans Vis Comput Graph 16(1):4–16

    Article  Google Scholar 

  18. Fantini M, Persiani F, Di Stefano L, Azzari P, Salti S (2011) Augmented reality for aircraft maintenance training and operations support. IEEE Comput Graph Appl 31(1):96–101

    Article  Google Scholar 

  19. Sakata N, Kurata T, Kuzuoka H (2006) Visual assist with a laser pointer and wearable display for remote collaboration. Trans Virtua Real Soc Jap 11(4):561–568

    Google Scholar 

  20. Lee JY, Rhee G (2008) Context-aware 3D visualization and collaboration services for ubiquitous cars using augmented reality. Int J Adv Manuf Technol 37(5–6):431–442

    Article  Google Scholar 

  21. Haringer M and Regenbrecht HT (2002) A pragmatic approach to augmented reality authoring, the International Symposium on Mixed and Augmented Reality (ISMAR’02), Washington, DC, pp 237–245

  22. Zauner J, Haller M, Brandl A, Hartman W (2003) Authoring of a mixed reality assembly instructor for hierarchical structures, the International Symposium on Mixed and Augmented Reality (ISMAR’03), Tokyo, Japan, pp 237–246

  23. Knopfle C, Weidenhausen J, Chauvigne L, Stock I (2005) Template based authoring for AR based service scenarios, 2005 IEEE Conference on Virtual Reality (VR’05), Bonn, Germany, pp 249–252

  24. Zhu J, Ong SK, Nee AYC (2011) Online authoring for augmented reality remote maintenance, the 12th IASTED International Conference on Computer Graphics and Imaging, CGIM 2011, Innsbruck, Austria, pp 87–94

  25. SWRL: A semantic web rule language combining OWL and RuleML, http://www.w3.org/Submission/SWRL/

  26. Pellet: OWL 2 Reasoner for Java, http://clarkparsia.com/pellet

  27. Yuan ML, Ong SK, Nee AYC (2004) The virtual interaction panel: an easy control tool in augmented reality systems. Comp Anima Virtua Worlds J, Special Issue: The Very Best Papers from CASA 2004, vol 15, no 3–4, pp 425–432

  28. HITLabNZ ARToolkit (2005), http://www.artoolkit.sourceforge.net/

  29. The OWL API, http://owlapi.sourceforge.net/

  30. Shen Y, Ong SK, Nee AYC (2011) Vision-based hand interaction in augmented reality environment. Int J Hum Comput Interact 27(6):523–544

    Article  Google Scholar 

  31. Nee AYC, Ong SK, Chryssolouris G and Mourtzis D (2012) Augmented reality applications in design and manufacturing. Annals of CIRP, Vol 61, no 2

Download references

Author information

Authors and Affiliations

  1. NUS Graduate School for Integrative Sciences and Engineering, National University of Singapore, 28 Medical Drive, Singapore, 117456, Singapore

    J. Zhu

  2. Mechanical Engineering Department, Faculty of Engineering, National University of Singapore, 9 Engineering Drive 1, Singapore, 117576, Singapore

    S. K. Ong & A. Y. C. Nee

Authors
  1. J. Zhu
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. S. K. Ong
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. A. Y. C. Nee
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to S. K. Ong.

Rights and permissions

Reprints and permissions

About this article

Cite this article

Zhu, J., Ong, S.K. & Nee, A.Y.C. An authorable context-aware augmented reality system to assist the maintenance technicians. Int J Adv Manuf Technol 66, 1699–1714 (2013). https://doi.org/10.1007/s00170-012-4451-2

Download citation

  • Received:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s00170-012-4451-2

Keywords

Search

Navigation