Abstract
Assembly planning and evaluation is an important component of the product design process in which details about how parts of a new product will be put together are formalized. A well designed assembly process should take into account various factors such as optimum assembly time and sequence, tooling and fixture requirements, ergonomics, operator safety, and accessibility, among others. Existing computer-based tools to support virtual assembly either concentrate solely on representation of the geometry of parts and fixtures and evaluation of clearances and tolerances or use simulated human mannequins to approximate human interaction in the assembly process. Virtual reality technology has the potential to support integration of natural human motions into the computer aided assembly planning environment (Ritchie et al. in Proc I MECH E Part B J Eng 213(5):461–474, 1999). This would allow evaluations of an assembler’s ability to manipulate and assemble parts and result in reduced time and cost for product design. This paper provides a review of the research in virtual assembly and categorizes the different approaches. Finally, critical requirements and directions for future research are presented.
Similar content being viewed by others
References
Baldwin DF, Abell TE, Lui M-CM, De Fazio TL, Whitney DE (1991) An integrated computer aid for generating and evaluating assembly sequences for mechanical products. IEEE Trans Rob Autom 7(1):78–94
Baraff D (1989) Analytical methods for dynamic simulation of non-penetrating rigid bodies. Computer Graphics 23(3):223–232
Baraff D (1990) Curved surfaces and coherence for non-penetrating rigid body simulation. Computer Graphics 24(4):19–28
Baraff D (1995) Interactive simulation of solid rigid bodies. Comput Graph Appl 15(3):63–75
Baraff D (1997) Physically based modeling: principles and practice (online Siggraph 97 course note), http://www-2.cs.cmu.edu/~baraff/sigcourse/
Boothroyd G, Dewhurst P (1989) Product design for assembly. McGraw-Hill, New York
Boothroyd G, Dewhurst P, Knight W (1994) Product design for manufacture and assembly. Marcel Dekker, New York
Borro D, Hernantes J, Garcia-Alonso A, Matey L (2005) Collision problem: characteristics for a taxonomy. In: Proceedings of the ninth international conference on information visualisation (IV’05)
Bouma W, Fudos I, Hoffman CM, Cai J, Paige R (1995) A geometric constrain solver. Comput Aided Design 27(6):487–501
Bouzit M, Popescu G, Burdea GC, Boian R (2002) The Rutgers master II-ND force feedback glove. In: HAPTICS 2002: haptic interfaces for virtual environment and teleoperator systems. Orlando, FL
Brough JE, Schwartz M, Gupta SK, Anand DK, Kavetsky R, Petterson R (2007) Towards the development of a virtual environment-based training system for mechanical assembly operations. Virtual Real 11(4):189–206
Bryson S (1996) Virtual reality in scientific visualization. Commun ACM 39(5):62–71
Bullinger HJ, Richer M, Seidel KA (2000) Virtual assembly planning. Hum Factors Ergon Manuf 10(3):331–341
Burdea GC (1999a) Invited review: the synergy between virtual reality and robotics. IEEE Trans Rob Autom 15(3):400–410
Burdea GC (1999b) Invited review: the synergy between virtual reality and robotics. IEEE Trans Rob Autom 15(3):400–410
Burdea GC (2000) Haptics issues in virtual environments. In: Computer graphics international. Geneva, Switzerland
Buttolo P, Hannaford B (1995) Pen-based force display for precision manipulation in virtual environments. In: IEEE virtual reality annual international symposium. Research Triangle Park, NC, USA
Chen X, Xu N, Li Y (2005) A virtual environment for collaborative assembly. In: Second international conference on embedded software and systems (ICESS’05)
Chryssolouris G, Mavrikios D, Fragos D, Karabatsou V (2000) A virtual reality-based experimentation environment for the verification of human-related factors in assembly processes. Rob Comp Integr Manuf 16:267–276
Coutee AS, Bras B (2002) Collision detection for virtual objects in a haptic assembly and disassembly simulation environment. In: ASME design engineering technical conferences and computers and information in engineering conference (DETC2002/CIE-34385). Montreal, Canada
Cohen JD et al (1995) I-COLLIDE: an interactive and exact collision detection system for large-scale environments. In: The 1995 ACM international 3D graphics conference, pp 189–196
Coutee AS, Bras B (2004) An experiment on weight sensation in real and virtual environments. In: ASME design engineering technical conferences and computers and information in engineering conference (DETC2004-57674). Salt Lake City, Utah, USA
Coutee AS, McDermott SD, Bras B (2001) A haptic assembly and disassembly simulation environment and associated computational load optimization techniques. ASME Trans J Comput Inf Sci Eng 1(2):113–122
Cruz-Neira C, Sandin DJ, DeFanti TA, Kenyon R, Hart JC (1992) The CAVE, audio visual experience automatic virtual environment. In: Communications of the ACM, pp 64–72
Cruz-Neira C, Sandin D, DeFanti T (1993) Surround-screen projection-based virtual reality: the design and implementation of the CAVE. In: Proceedings of SIGGRAPH, vol 93, pp 135–142
Czernuszenko M, Pape D, Sandin D, DeFanti T, Dawe GL, Brown MD (1997) ImmersaDesk and infinity wall projection-based virtual reality displays. Computer Graphics 31(2):46–49
De Fazio TL, Whitney DE (1987) Simplified generation of all mechanical assembly sequences. IEEE J Rob Autom 3(6):640–658
de-Mello LSH, Sanderson AC (1989) A correct and complete algorithm for the generation of mechanical assembly sequences. In: IEEE international conference on robotics and automation. Scottsdale, AZ, USA
Dewar RG, Carpenter ID, Ritchie JM, Simmons JEL (1997a) Assembly planning in a virtual environment. In: Proceedings of Portland international conference on management of engineering and technology (PICMET 97). IEEE Press, Portland, OR
Dewar RG, Carpenter ID, Ritchie JM, Simmons JEL (1997b) Assembly planning in a virtual environment. In: Proceedings of Portland international conference on management of engineering and technology (PICMET 97). IEEE Press, Portland, OR
Eddy J, Lewis KE (2002) Visualization of multidimensional design and optimization data using cloud visualization. In: ASME design engineering technical conferences and computers and information in engineering conference (DETC2002/DAC-34130), Montreal, Canada
Ehmann SA, Lin MC (2000) SWIFT: accelerated proximity queries between convex polyhedra by multi-level Voronoi marching. Technical report, Computer Science Department, University of North Carolina at Chapel Hill
Ehmann SA, Lin MC (2001) Accurate and fast proximity queries between polyhedra using surface decomposition. Eurograph Comput Graph Forum 20(3)
Erleben K, Sporring J, Henriksen K, Dohlmann H (2005) Physics-based animation, 1st edn. Charles River Media, Hingham, p 817
Fa M, Fernando T, Dew PM (1993) Direct 3D manipulation for constraint-based solid modeling. Comput Graph Forum 12(3):237–248
Fernando T, Murray N, Tan K, Wilmalaratne P (1999) Software architecture for a constraint-based virtual environment. In: Proceedings of the ACM symposium on virtual reality software and technology. London, UK
Frohlich B, Tramberend H, Beers A, Agarawala M, Baraff D (2000) Physically-based modeling on the responsive workbench. In: IEEE Virtual reality conference
Fröhlich B, Tramberend H, Beers A, Agarawala M, Baraff D (2000) Physically-based modeling on the responsive workbench. In: IEEE virtual reality conference
Fudos I (1995) Constraint solving for computer aided design. In: Computer sciences, Purdue University, p 107
Fudos I, Hoffman CM (1995) Correctness proof of a geometric constraint solver. Int J Comput Geom Appl 6(4):405–420
Fudos I, Hoffman CM (1997) A graph constructive approach to solving system of geometric constraints. ACM Trans Graph 16(2):179–216
Garbaya S, Zaldivar-Colado U (2007) The affect of contact force sensations on user performance in virtual assembly tasks. Virtual Real 11(4):287–299
Garcia-Alonso A, Serrano N, Flaquer J (1994) Solving the collision detection problem. IEEE Comput Graph Appl 14(3):36–43
Gomes de Sa A, Zachmann G (1999) Virtual reality as a tool for verification of assembly and maintenance processes. Comput Graph 23:189–403
Gottschalk S, Lin MC, Manocha DD (1996) OBB-Tree: a hierarchical structure for rapid interference detection. ACM SIGGRAPH’96, pp 171–180
Gottschalk S, Lin MC, Manocha D (1996) OBBTree: a hierarchical structure for rapid interference detection. In: 23rd Annual conference on computer graphics and interactive techniques
Govindaraju NK, Redon S, Lin MC, Manocha D (2003) CULLIDE: interactive collision detection between complex models in large environments using graphics hardware. In: Proceedings of ACM SIGGRAPH/eurographics workshop on graphics hardware, pp 25–32
Guendelman E, Bridson R, Fedkiw RP (2003) Nonconvex rigid bodies with stacking. ACM Trans Comput Graph 22(3):871–879
Gupta R, Zeltzer D (1995) Prototyping and design for assembly analysis using multimodal virtual environments. In: Proceedings of ASME computers in engineering conference and the engineering database symposium. Boston, MA
Gupta R, Whitney D, Zeltzer D (1997) Prototyping and design for assembly analysis using multimodal virtual environments. Comput Aided Des 29(8):585–597 (Special issue on VR in CAD)
Gurocak H, Parrish B, Jayaram S, Jayaram U (2002) Design of a haptic device for weight sensation in virtual environments. In: ASME design engineering technical conferences and computers and information in engineering conference (DETC2002/CIE-34387). Montreal, Canada
Guy A, Wyvill B (1995) Controlled blending for implicit surfaces using a graph. In: Implicit surfaces. Grenoble, France
Hahn JK (1988) Realistic animation of rigid bodies. Computer Graphics 22(4):299–308
Holt PO, Ritchie JM, Day PN, Simmons JEL, Robinson G, Russell GT, Ng FM (2004) Immersive virtual reality in cable and pipe routing: design metaphors and cognitive ergonomics. ASME J Comput Inf Sci Eng 4(3):161–170
Hudson T et al (1997) V-COLLIDE: accelerated collision detection for VRML. In: Proceedings of the second symposium on virtual reality modeling language, pp 119–125
Jayaram S, Connacher HI, Lyons KW (1997) Virtual assembly using virtual reality techniques. Comput Aided Design 29(8):575–584
Jayaram S, Jayaram U, Wang Y, Tirumali H, Lyons K, Hart P (1999) VADE: a virtual assembly design environment. Comput Graph Appl 19(6):44–50
Jayaram U, Tirumali H, Jayaram S (2000a) A tool/part/human interaction model for assembly in virtual environments. In: ASME design engineering technical conferences 2000 (DETC 2000/CIE-14584). Baltimore, MD
Jayaram S, Jayaram U, Wang Y, Lyons K (2000b) CORBA-based Collaboration in a Virtual Assembly Design Environment. In: ASME design engineering technical conferences and computers and information in engineering conference (DETC 2000/CIE-14585). Baltimore, MD
Jayaram U, Jayaram S, Shaikh I, Kim Y, Palmer C (2006a) Introducing quantitative analysis methods into virtual environments for real-time and continuous ergonomic evaluations. Comput Ind 57(3):283–296
Jayaram S, Joshi H, Jayaram U, Kim Y, Kate H, Varoz L (2006b) Embedding haptic-enabled tools in CAD for training applications. In: ASME design engineering technical conferences and computers and information in engineering conference (DETC2006-99656). Philadelphia, PA
Jayaram S, Jayaram U, Kim Y, DeChenne C, Lyons K, Palmer C, Mitsui T (2007) Industry case studies in the use of immersive virtual assembly. Virtual Real 11(4):217–228
Jiménez P, Thomas F, Torras C (2001) 3D collision detection: a survey. Comput Graph 25(2):269–285
Jin X, Li Y, Peng Q (2000) General constrained deformations based on generalized metaballs. Comput Graph 24(2)
Jung B, Latoschik M, Wachsmuth I (1998) Knowledge-based assembly simulation for virtual prototype modeling. In: Proceedings of the 24th annual conference of the IEEE industrial electronics society. Aachen, Germany
Just C, Bierbaum A, Baker A, Cruz-Neira C (1998) VR juggler: a framework for virtual reality development. In: 2nd Immersive projection technology workshop (IPT98) CD-ROM. Ames, IA
Kaufman A, Cohen D, Yagle R (1993) Volume graphics. IEEE Comput 26(7):51–64
Kim CE, Vance JM (2003) Using Vps (Voxmap Pointshell) as the basis for interaction in a virtual assembly environment. In: ASME design engineering technical conferences and computers and information in engineering conference (DETC2003/CIE-48297). ASME, Chicago, IL
Kim CE, Vance JM (2004a) Collision detection and part interaction modeling to facilitate immersive virtual assembly methods. ASME J Comput Inf Sci Eng 4(1):83–90
Kim CE, Vance JM (2004b) Development of a networked haptic environment in VR to facilitate collaborative design using Voxmap Pointshell (VPS) software. In: ASME design engineering technical conferences and computers and information in engineering conference (DETC2004/CIE-57648). Salt Lake City, UT
Krüger W, Fröhlich B (1994) The responsive workbench. Comput Graph Appl 14(3):12–15
Kuehne R, Oliver J (1995) A virtual environment for interactive assembly planning and evaluation. In: Proceedings of ASME design automation conference. Boston, MA, USA
Light R, Gossard D (1982) Modification of geometric models through variational geometry. Comput Aided Design 14(4):209–214
Lim T, Ritchie JM, Corney JR, Dewar RG, Schmidt K, Bergsteiner K (2007a) Assessment of a haptic virtual assembly system that uses physics-based interactions. In: Proceedings of the 2007 IEEE international symposium on assembly and manufacturing. IEEE, Ann Arbor, MI
Lim T, Ritchie JM, Dewar RG, Corney JR, Wilkinson P, Calis M, Desmulliez M, Fang J-J (2007b) Factors affecting user performance in haptic assembly. Virtual Real 11(4):241–252
Lin M, Gottaschalk S (1998) Collision detection between geometric models: a survey. In: Proceedings of IMA conference on mathematics of surfaces
Liu Z, Tan J (2005) Virtual assembly and tolerance analysis for collaborative design. In: 9th International conference on computer supported cooperative work in design 2005. Coventry, UK
Liu Z, Tan J (2007) Constraint behavior manipulation for interactive assembly in a virtual environment. Int J Adv Manuf Technol 32(7–8):797–810
Marcelino L, Murray N, Fernando T (2003) A constraint manager to support virtual maintainability. Comput Graph 27(1):19–26
Massie T, Salisbury K (1994) The PHANToM haptic interface: a device for probing virtual objects. In: Proceedings of the ASME winter annual meeting, symposium on haptic interfaces for virtual environment and teleoperator systems. Chicago, IL
McNeely WA, Puterbaugh KD, Troy JJ (1999) Six degree-of-freedom haptic rendering using voxel sampling. In: SIGGRAPH 99 conference proceedings, annual conference series, Los Angeles, CA
Millman PA, Stanley M, Colgate JE (1993) Design of a high performance haptic interface to virtual environments. In: IEEE virtual reality annual international symposium. Seattle, WA
Mirtich B (1996) Impulse-based dynamic simulation of rigid body systems. In: Computer science. University of California at Berkeley, p 246
Mirtich B (1998) V-Clip: fast and robust polyhedral collision detection. ACM Trans Graph 17(3):177–208
Mirtich B, Canny J (1995) Impulse-based simulation of rigid bodies. In: Symposium on interactive 3D graphics
Owen JC (1991) Algebraic solution for geometry from dimensional constraints. In: ACM symposium foundations of solid modeling, ACM, Austic, TX
Pere E, Langrana N, Gomez D, Burdea G (1996) Virtual mechanical assembly on a PC-based system. In: ASME design engineering technical conferences and computers and information in engineering conference (DETC1996/DFM-1306). Irvine, CA
Regnbrecht H, Hauber J, Schoenfelder R, Maegerlein A (2005) Virtual reality aided assembly with directional Vibro-Tactile feedback. In: Proceedings of the 3rd international conference on computer graphics and interactive techniques in Australasia and South East Asia. Dunedin, New Zealand
Ritchie JM, Simmons JEL, Carpenter ID, Dewar RG (1995) Using virtual reality for knowledge elicitation in a mechanical assembly planning environment. In: Proceedings of 12th conference of the Irish manufacturing committee
Ritchie JM, Dewar RG, Simmons JEL (1999) The generation and practical use of plans for manual assembly using immersive virtual reality. Proc I MECH E Part B J Eng 213(5):461–474
Ritchie JM, Lim T, Sung RS, Corney JR, Rea H (2008) The analysis of design and manufacturing tasks using haptic and immersive VR: some case studies. In: Product engineering. Springer, The Netherlands, pp 507–522
Schwartz M, Gupta SK, Anand DK, Kavetsky R (2007) Virtual mentor: a step towards proactive user monitoring and assistance during virtual environment-based training. In: Performance metrics for intelligent systems workshop (PerMIS 07). Washington, DC, USA
Seth A, Su HJ, Vance JM (2005) A desktop networked haptic VR interface for mechanical assembly. In: ASME international mechanical engineering congress & exposition (IMECE2005-81873). Orlando, FL, USA
Seth A, Su HJ, Vance JM (2006) SHARP: a system for haptic assembly & realistic prototyping. In: ASME design engineering technical conferences and computers and information in engineering conference (DETC2006/CIE-99476). Philadelphia, PA, USA
Seth A, Vance JM, Oliver JH (2007) Combining geometric constraints with physics modeling for virtual assembly using SHARP. In: ASME design engineering technical conferences and computers and information in engineering conference (DETC2007/CIE-34681). Las Vegas, NV, USA
Shaikh I, Jayaram U, Jayaram S, Palmer C (2004) Participatory ergonomics using VR integrated with analysis tools. In: 2004 winter simulation conference. Washington, DC
Singh B, Bettig B (2004) Port-compatibility and connectability based assembly design. J Comput Inf Sci Eng 4(3):197–205
Smith SS-F, Smith G, Liao X (2001) Automatic stable assembly sequence generation and evaluation. J Manuf Syst 20(4):225–235
Sunde G (1988) Specification of shape by dimensions and other geometric constraints. In: Geometric modeling for CAD applications. North Holland IFIP
Sung RCW, Corney JR, Clark DER (2001) Automatic assembly feature recognition and disassembly sequence generation. J Comput Inf Sci Eng 1(4):291–299
Suzuki H, Ando H, Kimura F (1990) Variation of geometries based on a geometric-reasoning method. Comput Graph 14(2):211–224
Taylor F, Jayaram S, Jayaram U (2000) Functionality to facilitate assembly of heavy machines in a virtual environment. In: ASME design engineering technical conferences (DETC 2000/CIE-14590). Baltimore, MD
Verroust A, Schonek F, Roller D (1992) Rule-oriented method for parameterized computer-aided design. Comput Aided Design 24(3):531–540
Volkov S, Vance JM (2001) Effectiveness of haptic sensation for the evaluation of virtual prototypes. ASME J Comput Inf Sci Eng 1(2):123–128
Wan H, Gao S, Peng Q, Dai G, Zhang F (2004a) MIVAS: a multi-modal immersive virtual assembly system. In: ASME design engineering technical conferences and computers and information in engineering conference (DETC 2004/CIE-57660). Salt Lake City, UT
Wan H, Luo Y, Gao S, Peng Q (2004b) Realistic virtual hand modeling with applications for virtual grasping. In: 2004 ACM SIGGRAPH international conference on virtual reality continuum and its applications in industry, pp 81–87
Wang Y, Jayaram S, Jayaram U, Lyons K (2001) Physically based modeling in virtual assembly. In: ASME design engineering technical conferences and computers and information in engineering conference (DETC2001/CIE-21259). Pittsburg, PA
Wang Y, Jayaram U, Jayaram S, Shaikh I (2003) Methods and algorithms for constraint based virtual assembly. Virtual Real 6:229–243
Wang QH, Li JR, Gong HQ (2006) A CAD-linked virtual assembly environment. Int J Prod Res 44(3):467–486
Witkin A, Gleicher M, Welch W (1990) Interactive dynamics. Computer Graphics 24(2):11–22
Xianglong Y, Yuncheng F, Tao L, Fei W (2001) Solving sequential decision-making problems under virtual reality simulation system. In: Winter simulation conference proceedings, Arlington, Virginia
Yang R, Wu D, Fax X, Yan J (2007) Research on constraint-based virtual assembly technologies. Front Mech Eng China 2(2):243–249
Ye N, Banerjee P, Banerjee A, Dech F (1999) A comparative study of virtual assembly planning in traditional and virtual environments. IEEE Trans Syst Man Cybern Part C Appl Rev 29(4):546–555
Zachmann G, Rettig A (2001) Natural and robust interaction in virtual assembly simulation. In: 8th ISPE international conference on concurrent engineering: research and applications. Anaheim, CA
Zha XF, Lim SYE, Fok SC (1998) Integrated intelligent design and assembly planning: a survey. Int J Adv Manuf Technol 14(9):664–685
Zhang Y, Sotudeh R, Fernando T (2005) The use of visual and auditory feedback for assembly task performance in a virtual environment. In: Proceedings of the 21st spring conference on computer graphics. Budmerice, Slovakia
Zhu Z, Gao S, Wan H, Luo Y, Yang W (2004) Grasp identification and multi-finger haptic feedback for virtual assembly. In: ASME design engineering technical conferences and computers and information in engineering conference (DETC 2004/CIE-57718). ASME, Salt Lake City, Utah, USA
Zorriassatine F, Wykes C, Parkin R, Gindy N (2003) A survey of virtual prototyping techniques for mechanical product development. Inst Mech Eng Part B J Eng Manuf 217(4):513–530
Author information
Authors and Affiliations
Corresponding author
Additional information
This work was performed by Abhishek Seth while at Iowa State University.
Rights and permissions
About this article
Cite this article
Seth, A., Vance, J.M. & Oliver, J.H. Virtual reality for assembly methods prototyping: a review. Virtual Reality 15, 5–20 (2011). https://doi.org/10.1007/s10055-009-0153-y
Received:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s10055-009-0153-y