Skip to main content

Advertisement

Log in

Surgical skills: Can learning curves be computed from recordings of surgical activities?

  • Original Article
  • Published:
International Journal of Computer Assisted Radiology and Surgery Aims and scope Submit manuscript

Abstract

Purpose

Surgery is one of the riskiest and most important medical acts that are performed today. The need to improve patient outcomes and surgeon training, and to reduce the costs of surgery, has motivated the equipment of operating rooms with sensors that record surgical interventions. The richness and complexity of the data that are collected call for new methods to support computer-assisted surgery. The aim of this paper is to support the monitoring of junior surgeons learning their surgical skill sets.

Methods

Our method is fully automatic and takes as input a series of surgical interventions each represented by a low-level recording of all activities performed by the surgeon during the intervention (e.g., cut the skin with a scalpel). Our method produces a curve describing the process of standardization of the behavior of junior surgeons. Given the fact that junior surgeons receive constant feedback from senior surgeons during surgery, these curves can be directly interpreted as learning curves.

Results

Our method is assessed using the behavior of a junior surgeon in anterior cervical discectomy and fusion surgery over his first three years after residency. They revealed the ability of the method to accurately represent the surgical skill evolution. We also showed that the learning curves can be computed by phases allowing a finer evaluation of the skill progression.

Conclusion

Preliminary results suggest that our approach constitutes a useful addition to surgical training monitoring.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Fig. 1
Fig. 2
Fig. 3
Fig. 4

Similar content being viewed by others

Notes

  1. http://germain-forestier.info/src/ipcai2018/.

References

  1. Akiyoshi T, Kuroyanagi H, Ueno M, Oya M, Fujimoto Y, Konishi T, Yamaguchi T (2011) Learning curve for standardized laparoscopic surgery for colorectal cancer under supervision: a single-center experience. Surg Endosc 25(5):1409–1414

    Article  PubMed  Google Scholar 

  2. Arora KS, Khan N, Abboudi H, Khan MS, Dasgupta P, Ahmed K (2015) Learning curves for cardiothoracic and vascular surgical procedures-a systematic review. Postgrad Med 127(2):202–214

  3. Barrie J, Jayne DG, Wright J, Murray CJC, Collinson FJ, Pavitt SH (2014) Attaining surgical competency and its implications in surgical clinical trial design: a systematic review of the learning curve in laparoscopic and robot-assisted laparoscopic colorectal cancer surgery. Ann Surg Oncol 21(3):829–840

    Article  PubMed  Google Scholar 

  4. Birkmeyer JD, Finks JF, O’Reilly A, Oerline M, Carlin AM, Nunn AR, Dimick J, Banerjee M, Birkmeyer NJ (2013) Surgical skill and complication rates after bariatric surgery. N Engl J Med 369(15):1434–1442

    Article  PubMed  CAS  Google Scholar 

  5. Choi DH, Jeong WK, Lim S-W, Chung TS, Park J-I, Lim S-B, Choi HS, Nam B-H, Chang HJ, Jeong S-Y (2009) Learning curves for laparoscopic sigmoidectomy used to manage curable sigmoid colon cancer: single-institute, three-surgeon experience. Surg Endosc 23(3):622–628

    Article  PubMed  Google Scholar 

  6. Despinoy F, Bouget D, Forestier G, Penet C, Zemiti N, Poignet P, Jannin P (2015) Unsupervised trajectory segmentation for surgical gesture recognition in robotic training. IEEE Trans Biomed Eng 63:1280–1291

    Article  PubMed  Google Scholar 

  7. Dewey RA (2007) Psychology: an introduction. Russ Dewey

  8. Dlouhy BJ, Rao RC (2014) Surgical skill and complication rates after bariatric surgery. N Engl J Med 370(3):285–285

    Article  PubMed  CAS  Google Scholar 

  9. Forestier G, Lalys F, Riffaud L, Trelhu B, Jannin P (2012) Classification of surgical processes using dynamic time warping. J Biomed Inform 45(2):255–264

    Article  PubMed  Google Scholar 

  10. Forestier G, Lalys F, Riffaud R, Collins L, Meixensberger J, Wassef SN, Neumuth T, Goulet B, Jannin P (2013) Multi-site study of surgical practice in neurosurgery based on surgical process models. J Biomed Inform 46(5):822–829

    Article  PubMed  Google Scholar 

  11. Forestier G, Riffaud L, Jannin P (2015) Automatic phase prediction from low-level surgical activities. Int J Comput Assist Radiol Surg 10(6):833–841

  12. Hanzly M, Frederick A, Creighton T, Atwood K, Mehedint D, Kauffman EC, Kim HL, Schwaab T (2014) Learning curves for robot-assisted and laparoscopic partial nephrectomy. J Endourol 20:297–303

    Google Scholar 

  13. Hopper A, Jamison M, Lewis W (2007) Learning curves in surgical practice. Postgrad Med J 83(986):777–779

    Article  PubMed  PubMed Central  CAS  Google Scholar 

  14. Islam G, Kahol K, Li B, Smith M, Patel VL (2016) Affordable, web-based surgical skill training and evaluation tool. J Biomed Inform 59:102–114

    Article  PubMed  Google Scholar 

  15. Jackson C, Gibbin K (2006) ‘per ardua...’training tomorrow’s surgeons using inter alia lessons from aviation. J R Soc Med 99(11):554–558

    PubMed  PubMed Central  CAS  Google Scholar 

  16. Jiménez-Rodríguez RM, Díaz-Pavón JM, de Juan F d l P, Prendes-Sillero E, Dussort HC, Padillo J (2013) Learning curve for robotic-assisted laparoscopic rectal cancer surgery. Int J Colorectal Dis 28(6):815–821

    Article  PubMed  Google Scholar 

  17. Kang J-C, Jao S-W, Chung M-H, Feng C-C, Chang Y-J (2007) The learning curve for hand-assisted laparoscopic colectomy: a single surgeon’s experience. Surg Endosc 21(2):234–237

    Article  PubMed  Google Scholar 

  18. Khan N, Abboudi H, Khan MS, Dasgupta P, Ahmed K (2014) Measuring the surgical learning curve: methods, variables and competency. BJU Int 113(3):504–508

    Article  PubMed  Google Scholar 

  19. Lalys F, Bouget D, Riffaud L, Jannin P (2013) Automatic knowledge-based recognition of low-level tasks in ophthalmological procedures. Int J Comput Assist Radiol Surg 8(1):39–49

    Article  PubMed  Google Scholar 

  20. Lalys F, Jannin P (2013) Surgical process modelling: a review. Int J Comput Assist Radiol Surg 8(5):1–17

    Google Scholar 

  21. Lalys F, Riffaud L, Morandi X, Jannin P (2010) Automatic phases recognition in pituitary surgeries by microscope images classification. In: Information processing in computer-assisted interventions. Springer, pp 34–44

  22. Le Reste P-J, Henaux P-L, Riffaud L, Haegelen C, Morandi X (2015) Influence of cumulative surgical experience on the outcome of poor-grade patients with ruptured intracranial aneurysm. Acta Neurochir 157(1):1–7

    Article  PubMed  Google Scholar 

  23. Lin HC, Shafran I, Murphy TE, Okamura AM, Yuh DD, Hager GD (2005) Automatic detection and segmentation of robot-assisted surgical motions. In Medical Image Computing and Computer-Assisted Intervention–MICCAI 2005. Springer, pp 802–810

  24. Lin HC, Shafran I, Yuh D, Hager GD (2006) Towards automatic skill evaluation: detection and segmentation of robot-assisted surgical motions. Comput Aided Surg 11(5):220–230

    Article  PubMed  Google Scholar 

  25. MacKenzie L, Ibbotson J, Cao C, Lomax A (2001) Hierarchical decomposition of laparoscopic surgery: a human factors approach to investigating the operating room environment. Minim Invasive Therapy Allied Technol 10(3):121–127

    Article  Google Scholar 

  26. Martin J, Regehr G, Reznick R, MacRae H, Murnaghan J, Hutchison C, Brown M (1997) Objective structured assessment of technical skill (OSATS) for surgical residents. Br J Surg 84(2):273–278

    Article  PubMed  CAS  Google Scholar 

  27. Mazur JE, Hastie R (1978) Learning as accumulation: a reexamination of the learning curve. Psychol Bull 85(6):1256

    Article  PubMed  CAS  Google Scholar 

  28. Mehta N, Haluck R, Frecker M, Snyder A (2002) Sequence and task analysis of instrument use in common laparoscopic procedures. Surg Endosc 16(2):280–285

    Article  PubMed  CAS  Google Scholar 

  29. Meißner C, Meixensberger J, Pretschner A, Neumuth T (2014) Sensor-based surgical activity recognition in unconstrained environments. Minim Invasive Therapy Allied Technol 23:198–205

    Article  Google Scholar 

  30. Neumuth T, Durstewitz N, Fischer M, Strauß G, Dietz A, Meixensberger J, Jannin P, Cleary K, Lemke HU, Burgert O (2006) Structured recording of intraoperative surgical workflows. In: Medical imaging. International Society for Optics and Photonics, pp 61450A–61450A

  31. PARK1a S-H, Suh IH, Chien J-h, Paik J, Ritter FE, Oleynikov D, Siu K-C (2011) Modeling surgical skill learning with cognitive simulation. Medi Meets Virtual Real 18: NextMed, 163:428

  32. Pavlidis I, Tsiamyrtzis P, Shastri D, Wesley A, Zhou Y, Lindner P, Buddharaju P, Joseph R, Mandapati A, Dunkin B, Bass B (2012) Fast by nature-how stress patterns define human experience and performance in dexterous tasks. Sci Rep 2:305

    Article  PubMed  PubMed Central  CAS  Google Scholar 

  33. Ramsay CR, Grant AM, Wallace SA, Garthwaite PH, Monk AF, Russell IT (2001) Statistical assessment of the learning curves of health technologies. Health Technol Assess 5(12):1–79

    Article  PubMed  CAS  Google Scholar 

  34. Ritter FE, Schooler LJ (2001) The learning curve. Int Encycl Social Behav Sci 13:8602–8605

    Google Scholar 

  35. Rodriguez-Paz J, Kennedy M, Salas E, Wu A, Sexton J, Hunt E, Pronovost P (2009) Beyond “see one, do one, teach one” : toward a different training paradigm. Qual Saf Health Care 18(1):63–68

    PubMed  CAS  Google Scholar 

  36. Rogers SO, Gawande AA, Kwaan M, Puopolo AL, Yoon C, Brennan TA, Studdert DM (2006) Analysis of surgical errors in closed malpractice claims at 4 liability insurers. Surgery 140(1):25–33

    Article  PubMed  Google Scholar 

  37. Sakoe H, Chiba S (1978) Dynamic programming algorithm optimization for spoken word recognition. IEEE Trans Acoust Speech Signal Process 26(1):43–49

    Article  Google Scholar 

  38. Schumann S, Bühligen U, Neumuth T (2015) Outcome quality assessment by surgical process compliance measures in laparoscopic surgery. Artif Intell Med 63(2):85–90

    Article  PubMed  Google Scholar 

  39. Sharma Y, Plötz T, Hammerld N, Mellor S, McNaney R, Olivier P, Deshmukh S, McCaskie A, Essa I (2014) Automated surgical osats prediction from videos. In 2014 IEEE 11th International Symposium on Biomedical Imaging (ISBI). IEEE, pp 461–464

  40. Tekkis PP, Senagore AJ, Delaney CP, Fazio VW (2005) Evaluation of the learning curve in laparoscopic colorectal surgery: comparison of right-sided and left-sided resections. Ann Surg 242(1):83

    Article  PubMed  PubMed Central  Google Scholar 

  41. Van Hove P, Tuijthof G, Verdaasdonk E, Stassen L, Dankelman J (2010) Objective assessment of technical surgical skills. Br J Surg 97(7):972–987

    Article  PubMed  Google Scholar 

  42. Varadarajan B, Reiley C, Lin H, Khudanpur S, Hager G (2009) Data-derived models for segmentation with application to surgical assessment and training. In Medical Image Computing and Computer-Assisted Intervention—MICCAI 2009. Springer, pp 426–434

  43. Wright TP (2012) Factors affecting the cost of airplanes. J Aeronaut Sci (Inst Aeronaut Sci) 3(4):122–128

    Article  Google Scholar 

  44. Yelle LE (1979) The learning curve: historical review and comprehensive survey. Decis Sci 10(2):302–328

    Article  Google Scholar 

Download references

Acknowledgements

Dr François Petitjean is the recipient of an Australian Research Council Discovery Early Career Award (Project Number DE170100037) funded by the Australian Government.

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Germain Forestier.

Ethics declarations

Conflict of interest

The authors declare that they have no conflict of interest.

Ethical approval

All procedures performed in studies involving human participants were in accordance with the ethical standards of the institutional and/or national research committee and with the 1964 Helsinki Declaration and its later amendments or comparable ethical standards.

Informed consent

Informed consent was obtained from all individual participants included in the study.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Forestier, G., Riffaud, L., Petitjean, F. et al. Surgical skills: Can learning curves be computed from recordings of surgical activities?. Int J CARS 13, 629–636 (2018). https://doi.org/10.1007/s11548-018-1713-y

Download citation

  • Received:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s11548-018-1713-y

Keywords

Navigation