Skip to main content
SpringerLink
Log in

Automated positioning of 3D virtual scene in AR-based assembly and disassembly guiding system

  • ORIGINAL ARTICLE
  • Published:
The International Journal of Advanced Manufacturing Technology Aims and scope Submit manuscript

Abstract

In augmented reality (AR)-based assembly and disassembly guiding systems, the guiding effects mainly depend on display characters of virtual guiding scene. If the virtual guiding scene is not displayed properly, such as displaying out of the operator’s view, overlaying on the interest region of the screen, selecting an inappropriate viewpoint of the three-dimensional (3D) guiding scene, and so on, it may disturb normal operation instead of guiding. To display the 3D virtual guiding scene on suitable screen region from a comfortable viewpoint, an adaptive guiding scene display method was proposed. In the adaptive selection of the display region, the display screen was divided into many grids. The screen projection coordinates for vertexes of CAD feature’s bounding boxes, and the occupied index of each grid was calculated. The maximum connected region of empty grids was chosen as a non-interest region on the screen for displaying the 3D guiding scene. In the optimal viewpoint selection algorithm, a viewpoint information measurement operator was put forward, which took projection area, visible proportion, information entropy, and difference in depth of all visible vertexes of CAD feature’s bounding box in 3D virtual guiding scene into account. Finally, based on the principle of perspective projection, the 3D virtual guiding scene was positioned into the virtual world and displayed from the specified viewpoint on the specified screen area. All algorithms proposed in this paper utilized the automatically extracted CAD feature’s bounding box model of part as input data so they could be implemented for online planning of 3D assembly guiding scenes.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Similar content being viewed by others

References

  1. Schwald B, Figue J, Chauvineau E, Vu-Hong F et al (2001) STARMATE: using augmented reality technology for computer guided maintenance of complex mechanical elements. Proceedings e2001: eBusiness and eWork E-work and E-Commerce pp: 196–202

  2. Schwald B, de Laval B (2003) An augmented reality system for training and assistance to maintenance in the industrial context. J WSCG 11(1):425–432

    Google Scholar 

  3. Salonen T, Saaski J, Hakkarainen M, Kanetis T, Perakakis M, Siltanen S (2007) Demonstration of assembly work using augmented reality. Proceedings of the 6th ACM international conference on image and video retrieval pp: 120–123

  4. Henderson SJ, Feiner S (2009) Evaluating the benefits of augmented reality for task localization in maintenance of an armored personnel carrier turret, Proceeding of IEEE International Symposium on Mixed and Augmented Reality pp: 135–144

  5. Henderson SJ, Feiner S (2011) Augmented reality in the psychomotor phase of a procedural task. Proceeding of 10th IEEE International Symposium on Mixed and Augmented Reality pp:191–200

  6. Servan J, Mas F, Menendez JL, Rios J (2012) Using augmented reality in AIRBUS A400M shop floor assembly work instructions. Am Inst Phys Conf Proc 1431:633–640

    Google Scholar 

  7. Servan J, Mas F, Menendez JL, Rios J (2012) Assembly work instruction deployment using augmented reality. Key Eng Mater 502:25–30

    Article  Google Scholar 

  8. Rios H, Hincapie M, Caponio A, Mercado E, Mendivil EG (2011) Augmented reality: an advantageous option for complex training and maintenance operations in aeronautic related processes. Lect Notes Comput Sci 6773:87–96

    Article  Google Scholar 

  9. Webel S, Bockholt U, Engelke T, Gavish N, Olbrich M, Preusche C (2013) An augmented reality training platform for assembly and maintenance skills. Robot Auton Syst 61(4):398–403

    Article  Google Scholar 

  10. Kreft S, Gausemeier J, Matysczok C (2009) Towards wearable augmented reality in automotive assembly training. Proceedings of the ASME 2009 International Design Engineering Technical Conferences and Computers and Information in Engineering Conference pp: 1537–1547

  11. Zhu J, Ong SK, Nee AYC (2013) An authorable context-aware augmented reality system to assist the maintenance technicians. Int J Adv Manuf Technol 66(9–12):1699–1714

    Google Scholar 

  12. Lee JY, Rhee G (2008) Context-aware 3D visualization and collaboration services for ubiquitous cars using augmented reality. Int J Adv Manuf Technol 37(5–6):431–442

    Article  Google Scholar 

  13. Wang ZB, Ong SK, Nee AYC (2013) Augmented reality aided interactive manual assembly design. Int J Adv Manuf Technol 69(5–8):1311–1321

    Article  Google Scholar 

  14. Fujimoto Y, Yamamoto G, Kato H, Miyazaki J (2012) Relation between location of information displayed by augmented reality and user's memorization. Proceedings of the 3rd Augmented Human International Conference 7

  15. Azuma R, Furmanski C (2003) Evaluating label placement for augmented reality view management. Proceedings of the Second IEEE and ACM International Symposium on Mixed and Augmented Reality pp: 66–75

  16. Shen Y, Ong SK, Nee AYC (2008) Product information visualization and augmentation in collaborative design. Comput Aided Des 40(9):963–974

    Article  Google Scholar 

  17. Tenmoku R, Kanbara M, Yokoya N (2006) A new view management method for wearable augmented reality systems—emphasizing the user-viewed object and the corresponding annotation. Proceedings of the 12th EuroGraphics Conference on Virtual Environments pp:127–134

  18. Shibata F, Nakamoto H, Sasaki R, Kimura A, Tamura H (2008) A view management method for mobile mixed reality systems. Proceedings of the 14th Eurographics Conference on Virtual Environments pp: 17–24

  19. Makita K, Kanbara M, Yokoya N (2009) View management of annotations for wearable augmented reality. IEEE International Conference on Multimedia and Expo pp: 982–985

  20. Grasset R, Langlotz T, Kalkofen D, Tatzgern M, Schmalstieg D (2012) Image-driven view management for augmented reality browsers. IEEE International Symposium on Mixed and Augmented Reality pp: 177–186

  21. Rosten E, Reitmayr G, Drummond T (2005) Real-time video annotations for augmented reality. Proceedings of the First International Conference on Advances in Visual Computing pp: 294–302

  22. Pick S, Hentschel B, Tedjo-Palczynski I, Wolter M, Kuhlen T (2010) Automated positioning of annotations in immersive virtual environments. Proceedings of the 16th Eurographics Conference on Virtual Environments pp:1–8

  23. Cao WG, Hu P, Li H, Lin ZK (2010) Canonical viewpoint selection based on distance-histogram. J Comput Aided Des Comput Graph 22(9):1515–1521

    Google Scholar 

  24. Yang LM, Wang WC, Wu EH (2008) Viewpoint selection by feature measurement on the viewing plane. J Comput Aided Des Comput Graph 20(9):1097–1103

    Google Scholar 

  25. Vazquez PP, Feixas M, Sbert M, Heidrich W (2001) Viewpoint selection using viewpoint entropy. Proceedings of the Vision Modeling and Visualization Conference pp: 273–280

  26. Liu Z, Feng YP, Pan X, Xu CH (2012) Optimal view selection algorithm for 3D object based on similarity learning. J Comput Aided Des Comput Graph 24(7):918–924

    Google Scholar 

  27. Zhou F, Duh HBL, Billinghurst M (2008) Trends in augmented reality tracking, interaction and display: a review of ten years of ISMAR. IEEE International Symposium on Mixed and Augmented Reality pp: 193–202

Download references

Author information

Authors and Affiliations

  1. School of Mechanical Engineering, Qingdao Technological University, Qingdao, 266033, China

    C. J. Chen

  2. State Key Lab of Manufacturing Systems Engineering, Xi’an Jiaotong University, Xi’an, 710049, China

    J. Hong & S. F. Wang

Authors
  1. C. J. Chen
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. J. Hong
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. S. F. Wang
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to J. Hong.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Chen, C.J., Hong, J. & Wang, S.F. Automated positioning of 3D virtual scene in AR-based assembly and disassembly guiding system. Int J Adv Manuf Technol 76, 753–764 (2015). https://doi.org/10.1007/s00170-014-6321-6

Download citation

  • Received:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s00170-014-6321-6

Keywords

Search

Navigation