Skip to main content
SpringerLink
Log in

Objective assessment based on motion-related metrics and technical performance in laparoscopic suturing

  • Original Article
  • Published:
International Journal of Computer Assisted Radiology and Surgery Aims and scope Submit manuscript

Abstract

Purpose

The aim of this study is to present the construct and concurrent validity of a motion-tracking method of laparoscopic instruments based on an optical pose tracker and determine its feasibility as an objective assessment tool of psychomotor skills during laparoscopic suturing.

Methods

A group of novice (\({<}10\) laparoscopic procedures), intermediate (11–100 laparoscopic procedures) and experienced (\({>}100\) laparoscopic procedures) surgeons performed three intracorporeal sutures on an ex vivo porcine stomach. Motion analysis metrics were recorded using the proposed tracking method, which employs an optical pose tracker to determine the laparoscopic instruments’ position. Construct validation was measured for all 10 metrics across the three groups and between pairs of groups. Concurrent validation was measured against a previously validated suturing checklist. Checklists were completed by two independent surgeons over blinded video recordings of the task.

Results

Eighteen novices, 15 intermediates and 11 experienced surgeons took part in this study. Execution time and path length travelled by the laparoscopic dissector presented construct validity. Experienced surgeons required significantly less time (\(p<0.008\)), travelled less distance using both laparoscopic instruments (\(p<0.013\)) and made more efficient use of the work space (\(p<0.018\)) compared with novice and intermediate surgeons. Concurrent validation showed strong correlation between both the execution time and path length and the checklist score (\(r =-0.712\) and \(r=-0.731\), \(p<0.001\)).

Conclusions

The suturing performance was successfully assessed by the motion analysis method. Construct and concurrent validity of the motion-based assessment method has been demonstrated for the execution time and path length metrics. This study demonstrates the efficacy of the presented method for objective evaluation of psychomotor skills in laparoscopic suturing. However, this method does not take into account the quality of the suture. Thus, future works will focus on developing new methods combining motion analysis and qualitative outcome evaluation to provide a complete performance assessment to trainees.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4

Similar content being viewed by others

References

  1. Smith CD, Farrell TM, McNatt SS, Metreveli RE (2001) Assessing laparoscopic manipulative skills. Am J Surg 181(6):547–550

    Article  CAS  PubMed  Google Scholar 

  2. van Hove PD, Tuijthof GJM, Verdaasdonk EGG, Stassen LPS, Dankelman J (2010) Objective assessment of technical surgical skills. Br J Surg 97(7):972–987

    Article  PubMed  Google Scholar 

  3. Fried GM, Feldman LS (2008) Objective assessment of technical performance. World J Surg 32(2):156–160

    Article  PubMed  Google Scholar 

  4. Parsons BA, Blencowe NS, Hollowood AD, Grant JR (2011) Surgical training: the impact of changes in curriculum and experience. J Surg Educ 68(1):44–51

    Article  PubMed  Google Scholar 

  5. Roberts KE, Bell RL, Duffy AJ (2006) Evolution of surgical skills training. World J World J Gastroenterol 12(20):3219–3224

    Article  PubMed  Google Scholar 

  6. Ritchie WP (2004) Basic certification in surgery by the American Board of Surgery (ABS). What does it mean? Does it have value? Is it relevant? A personal opinion. Ann Surg 239(2):133–139

    Article  PubMed  PubMed Central  Google Scholar 

  7. Kurashima Y, Feldman LS, Kaneva PA, Fried GM, Bergman S, Demyttenaere SV, Li C, Vassiliou MC (2014) Simulation-based training improves the operative performance of totally extraperitoneal (TEP) laparoscopic inguinal hernia repair: a prospective randomized controlled trial. Surg Endosc 28(3):783–788

    Article  PubMed  Google Scholar 

  8. Sánchez-Margallo JA, Sánchez-Margallo FM, Oropesa I, Gómez EJ (2014) Systems and technologies for objective evaluation of technical skills in laparoscopic surgery. Minim Invasive Ther Allied Technol 23(1):40–51

    Article  PubMed  Google Scholar 

  9. Oropesa I, Sánchez-González P, Lamata P, Chmarra MK, Pagador JB, Sánchez-Margallo JA, Sánchez-Margallo FM, Gómez EJ (2011) Methods and tools for objective assessment of psychomotor skills in laparoscopic surgery. J Surg Res 175(1):e81–e95

    Article  Google Scholar 

  10. Vassiliou MC, Feldman LS, Fraser SA, Charlebois P, Chaudhury P, Stanbridge DD, Fried GM (2007) Evaluating intraoperative laparoscopic skill: direct observation versus blinded videotaped performances. Surg Innov 14(3):211–216

    Article  PubMed  Google Scholar 

  11. Hasson HM (2008) Simulation training in laparoscopy using a computerized physical reality simulator. JSLS 12(4):363–367

    PubMed  PubMed Central  Google Scholar 

  12. Pérez F, Ordorica RM, Oropesa I, Zalles CR, Minor A (2015) Face, content, and construct validity of the EndoViS training system for objective assessment of psychomotor skills of laparoscopic surgeons. Surg Endosc 29(11):3392–3403

    Article  Google Scholar 

  13. Sánchez-Margallo JA, Sánchez-Margallo FM, Pagador JB, Gómez EJ, Sánchez-González P, Usón J, Moreno J (2011) Video-based assistance system for training in minimally invasive surgery. Minim Invasive Ther Allied Technol 20(4):197–205

    Article  PubMed  Google Scholar 

  14. Oropesa I, Sánchez-González P, Chmarra MK, Lamata P, Fernández A, Sánchez-Margallo JA, Jansen FW, Dankelman J, Sánchez-Margallo FM, Gómez EJ (2013) EVA: laparoscopic instrument tracking based on endoscopic video analysis for psychomotor skills assessment. Surg Endosc 27(3):1029–1039

    Article  PubMed  Google Scholar 

  15. Chmarra MK, Klein S, de Winter JCF, Jansen F-W, Dankelman J (2010) Objective classification of residents based on their psychomotor laparoscopic skills. Surg Endosc 24(5):1031–1039

    Article  PubMed  Google Scholar 

  16. Fried GM, Feldman LS, Vassiliou MC, Fraser SA, Stanbridge D, Ghitulescu G, Andrew CG (2004) Proving the value of simulation in laparoscopic surgery. Ann Surg 240(3):518–528

    Article  PubMed  PubMed Central  Google Scholar 

  17. Mason JD, Ansell J, Warren N, Torkington J (2013) Is motion analysis a valid tool for assessing laparoscopic skill? Surg Endosc 27(5):1468–1477

    Article  PubMed  Google Scholar 

  18. Kroeze SGC, Mayer EK, Chopra S, Aggarwal R, Darzi A, Patel A (2009) Assessment of laparoscopic suturing skills of urology residents: a Pan-European study. Eur Urol 56(5):865–872

    Article  PubMed  Google Scholar 

  19. Yamaguchi S, Yoshida D, Kenmotsu H, Yasunaga T, Konishi K, Ieiri S, Nakashima H, Tanoue K, Hashizume M (2011) Objective assessment of laparoscopic suturing skills using a motion-tracking system. Surg Endosc 25(3):771–775

    Article  PubMed  Google Scholar 

  20. Uemura M, Yamashita M, Tomikawa M, Obata S, Souzaki R, Ieiri S, Ohuchida K, Matsuoka N, Katayama T, Hashizume M (2015) Objective assessment of the suture ligature method for the laparoscopic intestinal anastomosis model using a new computerized system. Surg Endosc 29(2):444–452

    Article  PubMed  Google Scholar 

  21. Sánchez-Margallo JA, Sánchez-Margallo FM, Pagador Carrasco JB, Oropesa García I, Gómez Aguilera EJ, Moreno Del Pozo J (2013) Usefulness of an optical tracking system in laparoscopic surgery for motor skills assessment. Cir Esp 92(6):421–428

    Article  PubMed  Google Scholar 

  22. Sánchez-Margallo JA, Sánchez-Margallo FM, Pagador JB, Oropesa I, Lucas M, Gómez EJ, Moreno J (2013) Technical evaluation of a third generation optical pose tracker for motion analysis and image-guided surgery. Lect Notes Comput Sci 7761:75–82

    Article  Google Scholar 

  23. Enciso Sanz S, Sánchez Margallo FM, Díaz-Güemes Martín-Portugués I, Usón Gargallo J (2012) Preliminary validation of the Simulap \(\textregistered \) physical simulator and its assessment system for laparoscopic surgery. Cir Esp 90(1):38–44

    Article  PubMed  Google Scholar 

  24. Sánchez-Margallo FM, Díaz-Güemes I, Pérez FJ, Sánchez MA, Loscertales B, Usón J (2009) Preliminary results with a training program for thoracoscopic atrial fibrillation therapy. Surg Endosc 23(8):1882–1886

    Article  PubMed  Google Scholar 

  25. Pagador JB, Sánchez-Margallo FM, Sánchez-Peralta LF, Sánchez-Margallo JA, Moyano-Cuevas JL, Enciso-Sanz S, Usón-Gargallo J, Moreno J (2012) Decomposition and analysis of laparoscopic suturing task using tool-motion analysis (TMA): improving the objective assessment. Int J Comput Assist Radiol Surg 7(2):305–313

    Article  CAS  PubMed  Google Scholar 

  26. Hofstad EF, Våpenstad C, Chmarra MK, Langø T, Kuhry E, Mårvik R (2013) A study of psychomotor skills in minimally invasive surgery: what differentiates expert and nonexpert performance. Surg Endosc 27(3):854–863

    Article  PubMed  Google Scholar 

  27. Moorthy K, Munz Y, Dosis A, Bello F, Chang A, Darzi A (2004) Bimodal assessment of laparoscopic suturing skills: construct and concurrent validity. Surg Endosc 18(11):1608–1612

    CAS  PubMed  Google Scholar 

  28. Aggarwal R, Grantcharov T, Moorthy K, Milland T, Papasavas P, Dosis A, Bello F, Darzi A (2007) An evaluation of the feasibility, validity, and reliability of laparoscopic skills assessment in the operating room. Ann Surg 245(6):992–999

    Article  PubMed  PubMed Central  Google Scholar 

  29. Vassiliou MC, Feldman LS, Andrew CG, Bergman S, Leffondré K, Stanbridge D, Fried GM (2005) A global assessment tool for evaluation of intraoperative laparoscopic skills. Am J Surg 190(1):107–113

    Article  PubMed  Google Scholar 

Download references

Acknowledgments

This work has been partially funded by the Autonomous Community of Extremadura, Spain, and the European Social Fund (PO14034).

Author information

Authors and Affiliations

  1. Bioengineering and Health Technologies Unit, Jesús Usón Minimally Invasive Surgery Centre, Ctra. N-521, km 41.8, 10071, Cáceres, Spain

    Juan A. Sánchez-Margallo

  2. Laparoscopy Unit, Jesús Usón Minimally Invasive Surgery Centre, Cáceres, Spain

    Francisco M. Sánchez-Margallo & Silvia Enciso

  3. Biomedical Engineering and Telemedicine Centre (GBT), ETSI Telecomunicación, Universidad Politécnica de Madrid (UPM), Madrid, Spain

    Ignacio Oropesa & Enrique J. Gómez

  4. Networking Research Center on Bioengineering, Biomaterials and Nanomedicine (CIBER-BBN), Zaragoza, Spain

    Ignacio Oropesa & Enrique J. Gómez

Authors
  1. Juan A. Sánchez-Margallo
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Francisco M. Sánchez-Margallo
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Ignacio Oropesa
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Silvia Enciso
    View author publications

    You can also search for this author in PubMed Google Scholar

  5. Enrique J. Gómez
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Juan A. Sánchez-Margallo.

Ethics declarations

Conflict of interest

J. A. Sánchez-Margallo, F. M. Sánchez-Margallo, I. Oropesa, S. Enciso and E. J. Gómez declare that they have no conflict of interest.

Ethical approval

This article does not contain any studies with human participants or animals performed by any of the authors.

Informed consent

Informed consent was obtained from all individual participants included in the study.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Sánchez-Margallo, J.A., Sánchez-Margallo, F.M., Oropesa, I. et al. Objective assessment based on motion-related metrics and technical performance in laparoscopic suturing. Int J CARS 12, 307–314 (2017). https://doi.org/10.1007/s11548-016-1459-3

Download citation

  • Received:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s11548-016-1459-3

Keywords

Search

Navigation