Skip to main content
SpringerLink
Log in

Augmented reality aided interactive manual assembly design

  • ORIGINAL ARTICLE
  • Published:
The International Journal of Advanced Manufacturing Technology Aims and scope Submit manuscript

Abstract

Augmented reality (AR) is a novel technology which overlays computer-generated information seamlessly on the real-world environment. AR technologies have opened up a powerful set of tools for computer-aided assembly planning. This paper presents a manual assembly design system using AR technologies. An assembly data structure is devised for assembly information management. Algorithms for assembly constraint recognition and assembly location refinement have also been proposed. A hybrid approach based on these methods has been formulated and implemented to allow the users to simulate a manual assembly without the need for auxiliary computer-aided design information in assembly design. This would result in enhanced user experience and reduced preparation time. A methodology for 3D bare-hand interaction is integrated with this interactive manual assembly design system for the users to manipulate the virtual components in a natural and effective manner. A prototype system for interactive manual assembly design has been developed. An example has been provided to demonstrate the developed prototype system.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Similar content being viewed by others

References

  1. Azuma RT (1997) A survey of augmented reality. Teleoper Virtual Environ 6(4):355–385

    Google Scholar 

  2. Caudell TP, Mizell DW (1991) Augmented reality: an application of heads-up display technology to manual manufacturing processes. Proc Twenty Fifth Hawaii Int Conf Syst Sci 2:659–669

    Google Scholar 

  3. Chimienti V, Iliano S, Dassisti M, Dini G, Failli F (2010) Guidelines for implementing augmented reality procedures in assisting assembly operations. IFIP Adv Inf Commun Technol 315:174–179

    Article  Google Scholar 

  4. Choi J-Y, Seo B-K, Park J-I (2009) Robust hand detection for augmented reality interface. In: Proceedings of the 8th International Conference on Virtual Reality Continuum and its Applications in Industry (VRCAI ‘09), Yokohama, Japan, pp. 319–321

  5. CDPQ (2010) V-Collide. Available from http://gamma.cs.unc.edu/V_COLLIDE/. Accessed 3 December 2010

  6. Handheld Augmented reality (2010) ARToolkitPlus. Obtained through the Internet: http://studierstube.icg.tu-graz.ac.at/handheld_ar/artoolkitplus.php. Accessed 13 August 2010

  7. Homem de Mello LS, Sanderson AC (1991) Representation of mechanical assembly sequences. IEEE Trans Robot Autom 7(2):211–227

    Article  Google Scholar 

  8. Jayaram S, Jayaram U, Wang Y, Tirumali H, Lyons K, Hart P (1999) VADE: a virtual assembly design environment. IEEE Comput Graph Appl 19(6):44–50

    Article  Google Scholar 

  9. Lee T, Hollerer T (2007) Handy AR: markerless inspection of augmented reality objects using fingertip tracking. In: Proceedings of the 11th IEEE International Symposium on Wearable Computers, Boston, Massachusetts, 11–13 October 2007, pp. 83–90

  10. Li SQ, Peng T, Xu C, Fu Y, Liu Y (2009) A mixed reality-based assembly verification and training platform. In: Proceedings of the Third International Conference (VMR 2009), San Diego, CA, 19–24 July 2009, pp. 576–585

  11. Marcelino L, Murray N, Fernando T (2003) A constraint manager to support virtual maintainability. Comput Graph 27(1):19–26

    Article  Google Scholar 

  12. Ng LX, Wang ZB, Ong SK, Nee AYC (2013) Integrated product design and assembly planning in an augmented reality environment. Assembly Automation (in press)

  13. Nof SY, Wilhelm WE, Warnecke HJ (1997) Industrial assembly. Chapman & Hall, London

    Book  Google Scholar 

  14. Ong SK, Pang Y, Nee AYC (2007) Augmented reality aided assembly design and planning. CIRP Ann 56(1):49–52

    Article  Google Scholar 

  15. Ong SK, Yuan ML, Nee AYC (2008) Augmented reality applications in manufacturing: a survey. Int J Prod Res 46(10):2707–2742

    Article  MATH  Google Scholar 

  16. Pang Y, Nee AYC, Ong SK, Yuan ML, Youcef-Toumi K (2006) Assembly feature design in an augmented reality environment. Assem Autom 26(1):34–43

    Article  Google Scholar 

  17. Park H-S, Choi H-W, Park J-W (2008) Augmented reality based cockpit module assembly system. In: Proceedings of the International Conference on Smart Manufacturing Application, Goyang-Si, South Korea, 9–11 April 2008, pp. 130–135

  18. Point Grey Research (2011) Products and services. Available from: http://www.ptgrey.com/products/index.asp. Accessed 3 January 2011

  19. Raghavan V, Molineros J, Sharma R (1999) Interactive evaluation of assembly sequences using augmented reality. IEEE Trans Robot Autom 15(3):435–449

    Article  Google Scholar 

  20. Sung RCW, Corney JR, Clark DER (2001) Automatic assembly feature recognition and disassembly sequence generation. Int J Comput Inf Sci Eng 1(4):291–299

    Article  Google Scholar 

  21. Valentini PP (2009) Interactive virtual assembling in augmented reality. Interact Des Manuf 3(2):109–119

    Article  Google Scholar 

  22. van Holland W, Bronsvoort WF (2000) Assembly features in modeling and planning. Robot Comput Integr Manuf 16(4):277–294

    Article  Google Scholar 

  23. VUZIX (2011) Products. Available from http://www.vuzix.com/consumer/products_wrap920.html. Accessed 3 January 2011]

  24. Wiedenmaier S, Oehme O, Schmidt L, Luczak H (2003) Augmented reality (AR) for assembly processes design and experimental evaluation. Int J Hum Comput Interact 16(3):497–514

    Article  Google Scholar 

  25. Xia PJ, Yao YX, Liu JS, Li JG (2006) Optimising assembly planning based on virtual reality and bionic algorithm. Int J Manuf Technol Manag 9(3/4):265–293

    Google Scholar 

  26. Yang RD, Fan XM, Wu DL, Yan JQ (2007) Virtual assembly technologies based on constraint and DOF analysis. Robot Comput Integr Manuf 23(4):447–456

    Article  Google Scholar 

  27. Yuan ML, Ong SK, Nee AYC (2008) Augmented reality for assembly guidance using a virtual interactive tool. Int J Prod Res 46(7):1745–1767

    Article  MATH  Google Scholar 

  28. Zhang J, Ong SK, Nee AYC (2011) RFID-assisted assembly guidance system in an augmented reality environment. Int J Prod Res 49:3919–3938

    Google Scholar 

  29. Zhong YM, Shirinzadeh B, Ma WY, Liaw HC (2005) Assembly modelling through constraint-based manipulations in a virtual reality environment. In: IEEE Region 10 Annual International Conference, USA, pp.1–6

  30. Zorriassatine F, Wykes C, Parkin R, Gindy N (2003) A survey of virtual prototyping techniques for mechanical product development. J Eng Manuf 217(B4):513–530

    Article  Google Scholar 

Download references

Author information

Authors and Affiliations

  1. Mechanical Engineering Department, National University of Singapore, 9 Engineering Drive 1, 117576, Singapore, Singapore

    Z. B. Wang, S. K. Ong & A. Y. C. Nee

Authors
  1. Z. B. Wang
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. S. K. Ong
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. A. Y. C. Nee
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to S. K. Ong.

Rights and permissions

Reprints and permissions

About this article

Cite this article

Wang, Z.B., Ong, S.K. & Nee, A.Y.C. Augmented reality aided interactive manual assembly design. Int J Adv Manuf Technol 69, 1311–1321 (2013). https://doi.org/10.1007/s00170-013-5091-x

Download citation

  • Received:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s00170-013-5091-x

Keywords

Search

Navigation