Skip to main content
SpringerLink
Log in

Validation of a virtual reality-based simulator for shoulder arthroscopy

  • Shoulder
  • Published:
Knee Surgery, Sports Traumatology, Arthroscopy Aims and scope

Abstract

Purpose

This study was to determine face and construct validity of a new virtual reality-based shoulder arthroscopy simulator which uses passive haptic feedback.

Methods

Fifty-one participants including 25 novices (<20 shoulder arthroscopies) and 26 experts (>100 shoulder arthroscopies) completed two tests: for assessment of face validity, a questionnaire was filled out concerning quality of simulated reality and training potential using a 7-point Likert scale (range 1–7). Construct validity was tested by comparing simulator metrics (operation time in seconds, camera and grasper pathway in centimetre and grasper openings) between novices and experts test results.

Results

Overall simulated reality was rated high with a median value of 5.5 (range 2.8–7) points. Training capacity scored a median value of 5.8 (range 3–7) points. Experts were significantly faster in the diagnostic test with a median of 91 (range 37–208) s than novices with 1177 (range 81–383) s (p < 0.0001) and in the therapeutic test 102 (range 58–283) s versus 229 (range 114–399) s (p < 0.0001). Similar results were seen in the other metric values except in the camera pathway in the therapeutic test.

Conclusion

The tested simulator achieved high scores in terms of realism and training capability. It reliably discriminated between novices and experts. Further improvements of the simulator, especially in the field of therapeutic arthroscopy, might improve its value as training and assessment tool for shoulder arthroscopy skills.

Level of evidence

II.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7
Fig. 8

Similar content being viewed by others

References

  1. Aggarwal R, Tully A, Grantcharov T, Larsen CR, Miskry T, Farthing A, Darzi A (2006) Virtual reality simulation training can improve technical skills during laparoscopic salpingectomy for ectopic pregnancy. BJOG Int J Obstet Gynaecol 113:1382–1387

    Article  CAS  Google Scholar 

  2. Atesok K, Mabrey JD, Jazrawi LM, Egol KA (2012) Surgical simulation in orthopaedic skills training. J Am Acad Orthop Surg 20:410–422

    PubMed  Google Scholar 

  3. Bajka M, Tuchschmid S, Fink D, Székely G, Harders M (2009) Establishing construct validity of a virtual-reality training simulator for hysteroscopy via a multimetric scoring system. Surg Endosc 24:79–88

    Article  PubMed  Google Scholar 

  4. Bajka M, Tuchschmid S, Streich M, Fink D, Székely G, Harders M (2008) Evaluation of a new virtual-reality training simulator for hysteroscopy. Surg Endosc 23:2026–2033

    Article  PubMed  Google Scholar 

  5. Basdogan C, Sedef M, Harders M, Wesarg S (2007) VR-based simulators for training in minimally invasive surgery. IEEE Comput Graph Appl 27:54–66

    Article  PubMed  Google Scholar 

  6. Bayona S, Fernández-Arroyo JM, Martín I, Bayona P (2008) Assessment study of insight ARTHRO VR® arthroscopy virtual training simulator: face, content, and construct validities. J Robot Surg 2:151–158

    Article  Google Scholar 

  7. Cannon WD, Eckhoff DG, Garrett WE Jr, Hunter RE, Sweeney HJ (2006) Report of a group developing a virtual reality simulator for arthroscopic surgery of the knee joint. Clin Orthop Relat Res 442:21–29

    Article  PubMed  Google Scholar 

  8. Carter FJ, Schijven MP, Aggarwal R, Grantcharov T, Francis NK, Hanna GB, Jakimowicz JJ (2006) Consensus guidelines for validation of virtual reality surgical simulators. Simul Healthc 1:171–179

    Article  CAS  PubMed  Google Scholar 

  9. Farnworth LR, Lemay DE, Wooldridge T, Mabrey JD, Blaschak MJ, DeCoster TA, Wascher DC, Schenck RC (2001) A comparison of operative times in arthroscopic ACL reconstruction between orthopaedic faculty and residents: the financial impact of orthopaedic surgical training in the operating room. Iowa Orthop J 21:31–35

    CAS  PubMed  PubMed Central  Google Scholar 

  10. Frank RM, Erickson B, Frank JM, Bush-Joseph CA, Bach BR Jr, Cole BJ, Romeo AA, Provencher MT, Verma NN (2014) Utility of modern arthroscopic simulator training models. Arthroscopy 30:121–133

    Article  PubMed  Google Scholar 

  11. Fucentese SF, Rahm S, Wieser K, Spillmann J, Harders M, Koch PP (2015) Evaluation of a virtual-reality-based simulator using passive haptic feedback for knee arthroscopy. Knee Surg Sports Traumatol Arthrosc 23:1077–1085

    Article  PubMed  Google Scholar 

  12. Gallagher AG, Ritter EM, Satava RM (2003) Fundamental principles of validation, and reliability: rigorous science for the assessment of surgical education and training. Surg Endosc 17:1525–1529

    Article  CAS  PubMed  Google Scholar 

  13. Gomoll AH, Pappas G, Forsythe B, Warner JJP (2008) Individual skill progression on a virtual reality simulator for shoulder a arthroscopy: a 3-year follow-up study. Am J Sports Med 36:1139–1142

    Article  PubMed  Google Scholar 

  14. Hall MP, Kaplan KM, Gorczynski CT, Zuckerman JD, Rosen JE (2010) Assessment of arthroscopic training in U.S. orthopedic surgery residency programs—a resident self-assessment. Bull NYU Hosp Jt Dis 68:5–10

    PubMed  Google Scholar 

  15. Haque S, Srinivasan S (2006) A meta-analysis of the training effectiveness of virtual reality surgical simulators. IEEE Trans Inf Technol Biomed 10:51–58

    Article  PubMed  Google Scholar 

  16. Howells NR, Gill HS, Carr AJ, Price AJ, Rees JL (2008) Transferring simulated arthroscopic skills to the operating theatre: a randomised blinded study. J Bone Joint Surg Br 90:494–499

    Article  CAS  PubMed  Google Scholar 

  17. Khalifa YM, Bogorad D, Gibson V, Peifer J, Nussbaum J (2006) Virtual reality in ophthalmology training. Surv Ophthalmol 51:259–273

    Article  PubMed  Google Scholar 

  18. Koch F, Koss MJ, Singh P, Naser H (2009) Virtual reality in ophthalmology. Klin Mon Augenheilkd 226:672–676

    Article  CAS  Google Scholar 

  19. Koehler RJ, Nicandri GT (2013) Using the arthroscopic surgery skill evaluation tool as a pass–fail examination. J Bone Joint Surg Am 95(e187):1

    Google Scholar 

  20. Larsen C, Grantcharov T, Schouenborg L, Ottosen C, Soerensen J, Ottesen B (2008) Objective assessment of surgical competence in gynaecological laparoscopy: development and validation of a procedure-specific rating scale. BJOG Int J Obstet Gynaecol 115:908–916

    Article  CAS  Google Scholar 

  21. Larsen CR, Soerensen JL, Grantcharov TP, Dalsgaard T, Schouenborg L, Ottosen C, Schroeder TV, Ottesen BS (2009) Effect of virtual reality training on laparoscopic surgery: randomised controlled trial. BMJ 338:b1802

    Article  PubMed  PubMed Central  Google Scholar 

  22. Mabrey JD, Reinig KD, Cannon WD (2010) Virtual reality in orthopaedics: is it a reality? Clin Orthop Relat Res 468:2586–2591

    Article  PubMed  PubMed Central  Google Scholar 

  23. McCarthy AD, Hollands RJ (1998) A commercially viable virtual reality knee arthroscopy training system. Stud Health Technol Inform 50:302–308

    CAS  PubMed  Google Scholar 

  24. Meyer RD, Tamarapalli JR, Lemons JE (1993) Arthroscopy training using a “black box” technique. Arthroscopy 9:338–340

    Article  CAS  PubMed  Google Scholar 

  25. Modi CS, Morris G, Mukherjee R (2010) Computer-simulation training for knee and shoulder arthroscopic surgery. Arthroscopy 26:832–840

    Article  PubMed  Google Scholar 

  26. Moody L, Waterworth A, Arthur JG, McCarthy AD (2009) Beyond the visuals: tactile augmentation and sensory enhancement in an arthroscopy simulator. Virtual Real 13(1):59–68

    Article  Google Scholar 

  27. Moody L, Waterworth A, McCarthy AD, Harley PJ (2008) The feasibility of a mixed reality surgical training environment. Virtual Real 12(2):77–86

    Article  Google Scholar 

  28. Moorthy K, Munz Y, Sarker SK, Darzi A (2003) Objective assessment of technical skills in surgery. BMJ 327:1032–1037

    Article  PubMed  PubMed Central  Google Scholar 

  29. Müller W, Bockholt U, Lahmer A, Voss G, Börner M (2000) VRATS-virtual reality arthroscopy training simulator. Radiologe 40:290–294

    Article  PubMed  Google Scholar 

  30. O’Neill PJ, Cosgarea AJ, Freedman JA, Queale WS, McFarland EG (2002) Arthroscopic proficiency: a survey of orthopaedic sports medicine fellowship directors and orthopaedic surgery department chairs. Arthroscopy 18:795–800

    Article  PubMed  Google Scholar 

  31. Ortmaier R, Resch H, Hitzl W, Mayer M, Blocher M, Vasvary I, Mattiassich G, Stundner O, Tauber M (2012) Reverse shoulder arthroplasty combined with latissimus dorsi transfer using the bone-chip technique. Surg Endosc 38:553–559

    Google Scholar 

  32. Pedowitz RA, Esch J, Snyder S (2002) Evaluation of a virtual reality simulator for arthroscopy skills development. Arthroscopy 18:E29

    Article  PubMed  Google Scholar 

  33. Pedowitz RA, Marsh JL (2012) Motor skills training in orthopaedic surgery: a paradigm shift toward a simulation-based educational curriculum. J Am Acad Orthop Surg 20:407–409

    Article  PubMed  Google Scholar 

  34. Schijven M, Jakimowicz J (2003) Construct validity: experts and novices performing on the Xitact LS500 laparoscopy simulator. Surg Endosc 17:803–810

    Article  CAS  PubMed  Google Scholar 

  35. Schijven MP, Jakimowicz J (2004) The learning curve on the Xitact LS 500 laparoscopy simulator: profiles of performance. Surg Endosc 18:121–127

    Article  CAS  PubMed  Google Scholar 

  36. Spillmann J, Tuchschmid S, Harders M (2013) Adaptive space warping to enhance passive haptics in an arthroscopy surgical simulator. IEEE Trans Vis Comput Graph 19:626–633

    Article  PubMed  Google Scholar 

  37. Srivastava S, Youngblood PL, Rawn C, Hariri S, Heinrichs WL, Ladd AL (2004) Initial evaluation of a shoulder arthroscopy simulator: establishing construct validity. J Shoulder Elbow Surg 13:196–205

    Article  PubMed  Google Scholar 

  38. Stunt JJ, Kerkhoffs GMMJ, van Dijk CN, Tuijthof GJM (2014) Validation of the ArthroS virtual reality simulator for arthroscopic skills. Knee Surg Sports Traumatol Arthrosc 23(11):3436–3442

    Article  PubMed  Google Scholar 

  39. Sutherland LM, Middleton PF, Anthony A, Hamdorf J, Cregan P, Scott D, Maddern GJ (2006) Surgical simulation. Ann Surg 243:291–300

    Article  PubMed  PubMed Central  Google Scholar 

  40. Tuijthof GJM, van Sterkenburg MN, Sierevelt IN, van Oldenrijk J, Van Dijk CN, Kerkhoffs GMMJ (2010) First validation of the PASSPORT training environment for arthroscopic skills. Knee Surg Sports Traumatol Arthrosc 18:218–224

    Article  PubMed  Google Scholar 

  41. Tuijthof GJM, Visser P, Sierevelt IN, Dijk CN, Kerkhoffs GMMJ (2011) Does perception of usefulness of arthroscopic simulators differ with levels of experience? Clin Orthop Relat Res 469:1701–1708

    Article  PubMed  PubMed Central  Google Scholar 

  42. Woodrum DT, Andreatta PB, Yellamanchilli RK, Feryus L, Gauger PG, Minter RM (2006) Construct validity of the LapSim laparoscopic surgical simulator. Am J Surg 191:28–32

    Article  PubMed  Google Scholar 

  43. Ziegler R, Fischer G, Müller W, Göbel M (1995) Virtual reality arthroscopy training simulator. Comput Biol Med 25:193–203

    Article  CAS  PubMed  Google Scholar 

Download references

Author information

Authors and Affiliations

  1. Orthopaedic Department, Balgrist University Hospital, University of Zurich, Forchstrasse 340, 8008, Zurich, Switzerland

    Stefan Rahm, Marco Germann, Andreas Hingsammer, Karl Wieser & Christian Gerber

Authors
  1. Stefan Rahm
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Marco Germann
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Andreas Hingsammer
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Karl Wieser
    View author publications

    You can also search for this author in PubMed Google Scholar

  5. Christian Gerber
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Stefan Rahm.

Ethics declarations

Conflict of interest

The authors declare that they have no conflict of interest.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Rahm, S., Germann, M., Hingsammer, A. et al. Validation of a virtual reality-based simulator for shoulder arthroscopy. Knee Surg Sports Traumatol Arthrosc 24, 1730–1737 (2016). https://doi.org/10.1007/s00167-016-4022-4

Download citation

  • Received:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s00167-016-4022-4

Keywords

Search

Navigation