A surgical activity model of laparoscopic cholecystectomy for co-operation with collaborative robots
Background: Laparoscopic cholecystectomy is a very frequent surgical procedure. However, in an ageing society, less surgical staff will need to perform surgery on patients. Collaborative surgical robots (cobots) could address surgical staff shortages and workload. To achieve context-awareness for su...
Saved in:
| Main Authors: | , , , , , , , , , , , , , , , |
|---|---|
| Format: | Article (Journal) |
| Language: | English |
| Published: |
13 June 2024
|
| In: |
Surgical endoscopy and other interventional techniques
Year: 2024, Volume: 38, Issue: 8, Pages: 4316-4328 |
| ISSN: | 1432-2218 |
| DOI: | 10.1007/s00464-024-10958-w |
| Online Access: | Verlag, kostenfrei, Volltext: https://doi.org/10.1007/s00464-024-10958-w
|
| Author Notes: | R. Younis, A. Yamlahi, S. Bodenstedt, PM. Scheikl, A. Kisilenko, M. Daum, A. Schulze, P.A. Wise, F. Nickel, F. Mathis-Ullrich, L. Maier-Hein, BP. Müller-Stich, S. Speidel, M. Distler, J. Weitz, M. Wagner |
MARC
| LEADER | 00000caa a2200000 c 4500 | ||
|---|---|---|---|
| 001 | 1909617199 | ||
| 003 | DE-627 | ||
| 005 | 20241205223128.0 | ||
| 007 | cr uuu---uuuuu | ||
| 008 | 241127s2024 xx |||||o 00| ||eng c | ||
| 024 | 7 | |a 10.1007/s00464-024-10958-w |2 doi | |
| 035 | |a (DE-627)1909617199 | ||
| 035 | |a (DE-599)KXP1909617199 | ||
| 035 | |a (OCoLC)1475648128 | ||
| 040 | |a DE-627 |b ger |c DE-627 |e rda | ||
| 041 | |a eng | ||
| 084 | |a 33 |2 sdnb | ||
| 100 | 1 | |a Younis, Rayan |e VerfasserIn |0 (DE-588)1322594686 |0 (DE-627)1882526449 |4 aut | |
| 245 | 1 | 2 | |a A surgical activity model of laparoscopic cholecystectomy for co-operation with collaborative robots |c R. Younis, A. Yamlahi, S. Bodenstedt, PM. Scheikl, A. Kisilenko, M. Daum, A. Schulze, P.A. Wise, F. Nickel, F. Mathis-Ullrich, L. Maier-Hein, BP. Müller-Stich, S. Speidel, M. Distler, J. Weitz, M. Wagner |
| 264 | 1 | |c 13 June 2024 | |
| 300 | |b Illustrationen | ||
| 300 | |a 13 | ||
| 336 | |a Text |b txt |2 rdacontent | ||
| 337 | |a Computermedien |b c |2 rdamedia | ||
| 338 | |a Online-Ressource |b cr |2 rdacarrier | ||
| 500 | |a Gesehen am 27.11.2024 | ||
| 520 | |a Background: Laparoscopic cholecystectomy is a very frequent surgical procedure. However, in an ageing society, less surgical staff will need to perform surgery on patients. Collaborative surgical robots (cobots) could address surgical staff shortages and workload. To achieve context-awareness for surgeon-robot collaboration, the intraoperative action workflow recognition is a key challenge. Methods: A surgical process model was developed for intraoperative surgical activities including actor, instrument, action and target in laparoscopic cholecystectomy (excluding camera guidance). These activities, as well as instrument presence and surgical phases were annotated in videos of laparoscopic cholecystectomy performed on human patients (n = 10) and on explanted porcine livers (n = 10). The machine learning algorithm Distilled-Swin was trained on our own annotated dataset and the CholecT45 dataset. The validation of the model was conducted using a fivefold cross-validation approach. Results: In total, 22,351 activities were annotated with a cumulative duration of 24.9 h of video segments. The machine learning algorithm trained and validated on our own dataset scored a mean average precision (mAP) of 25.7% and a top K = 5 accuracy of 85.3%. With training and validation on our dataset and CholecT45, the algorithm scored a mAP of 37.9%. Conclusions: An activity model was developed and applied for the fine-granular annotation of laparoscopic cholecystectomies in two surgical settings. A machine recognition algorithm trained on our own annotated dataset and CholecT45 achieved a higher performance than training only on CholecT45 and can recognize frequently occurring activities well, but not infrequent activities. The analysis of an annotated dataset allowed for the quantification of the potential of collaborative surgical robots to address the workload of surgical staff. If collaborative surgical robots could grasp and hold tissue, up to 83.5% of the assistant’s tissue interacting tasks (i.e. excluding camera guidance) could be performed by robots. | ||
| 650 | 4 | |a Action recognition | |
| 650 | 4 | |a Collaborative surgical robots | |
| 650 | 4 | |a Machine learning | |
| 650 | 4 | |a Robot autonomy | |
| 650 | 4 | |a Surgical data science | |
| 650 | 4 | |a Surgical process modeling | |
| 700 | 1 | |a Yamlahi, Amine |e VerfasserIn |4 aut | |
| 700 | 1 | |a Bodenstedt, Sebastian |e VerfasserIn |0 (DE-588)1162865334 |0 (DE-627)1026968836 |0 (DE-576)507640497 |4 aut | |
| 700 | 1 | |a Scheikl, Paul Maria |e VerfasserIn |0 (DE-588)1302319159 |0 (DE-627)1859352022 |4 aut | |
| 700 | 1 | |a Kisilenko, Anna |e VerfasserIn |0 (DE-588)1349466565 |0 (DE-627)1909618837 |4 aut | |
| 700 | 1 | |a Daum, Marie T. J. |d 1993- |e VerfasserIn |0 (DE-588)1322672741 |0 (DE-627)188271931X |4 aut | |
| 700 | 1 | |a Schulze, André |e VerfasserIn |0 (DE-588)1173353534 |0 (DE-627)1042484341 |0 (DE-576)515173584 |4 aut | |
| 700 | 1 | |a Wise, Philipp |e VerfasserIn |0 (DE-588)1243127082 |0 (DE-627)1773577611 |4 aut | |
| 700 | 1 | |a Nickel, Felix |d 1982- |e VerfasserIn |0 (DE-588)1067980059 |0 (DE-627)819414875 |0 (DE-576)427122619 |4 aut | |
| 700 | 1 | |a Mathis-Ullrich, Franziska |d 1987- |e VerfasserIn |0 (DE-588)112418614X |0 (DE-627)877887276 |0 (DE-576)482386347 |4 aut | |
| 700 | 1 | |a Maier-Hein, Lena |d 1980- |e VerfasserIn |0 (DE-588)1075029252 |0 (DE-627)832869899 |0 (DE-576)190090804 |4 aut | |
| 700 | 1 | |a Müller, Beat P. |d 1971- |e VerfasserIn |0 (DE-588)14066209X |0 (DE-627)70374819X |0 (DE-576)317992287 |4 aut | |
| 700 | 1 | |a Speidel, Stefanie |e VerfasserIn |0 (DE-588)140539794 |0 (DE-627)646561995 |0 (DE-576)337205159 |4 aut | |
| 700 | 1 | |a Distler, Marius |d 1977- |e VerfasserIn |0 (DE-588)1059371898 |0 (DE-627)798322853 |0 (DE-576)415370256 |4 aut | |
| 700 | 1 | |a Weitz, Jürgen |e VerfasserIn |0 (DE-588)1022345974 |0 (DE-627)716954451 |0 (DE-576)171632176 |4 aut | |
| 700 | 1 | |a Wagner, Martin |d 1988- |e VerfasserIn |0 (DE-588)1060231980 |0 (DE-627)799324337 |0 (DE-576)416324282 |4 aut | |
| 773 | 0 | 8 | |i Enthalten in |t Surgical endoscopy and other interventional techniques |d New York : Springer-Verlag, 2002 |g 38(2024), 8, Seite 4316-4328 |h Online-Ressource |w (DE-627)254909620 |w (DE-600)1463171-4 |w (DE-576)074754106 |x 1432-2218 |7 nnas |a A surgical activity model of laparoscopic cholecystectomy for co-operation with collaborative robots |
| 773 | 1 | 8 | |g volume:38 |g year:2024 |g number:8 |g pages:4316-4328 |g extent:13 |a A surgical activity model of laparoscopic cholecystectomy for co-operation with collaborative robots |
| 856 | 4 | 0 | |u https://doi.org/10.1007/s00464-024-10958-w |x Verlag |x Resolving-System |z kostenfrei |3 Volltext |
| 951 | |a AR | ||
| 992 | |a 20241127 | ||
| 993 | |a Article | ||
| 994 | |a 2024 | ||
| 998 | |g 1060231980 |a Wagner, Martin |m 1060231980:Wagner, Martin |d 50000 |e 50000PW1060231980 |k 0/50000/ |p 16 |y j | ||
| 998 | |g 14066209X |a Müller, Beat P. |m 14066209X:Müller, Beat P. |d 50000 |e 50000PM14066209X |k 0/50000/ |p 12 | ||
| 998 | |g 1075029252 |a Maier-Hein, Lena |m 1075029252:Maier-Hein, Lena |d 910000 |d 910200 |e 910000PM1075029252 |e 910200PM1075029252 |k 0/910000/ |k 1/910000/910200/ |p 11 | ||
| 998 | |g 1067980059 |a Nickel, Felix |m 1067980059:Nickel, Felix |d 910000 |d 910200 |d 50000 |e 910000PN1067980059 |e 910200PN1067980059 |e 50000PN1067980059 |k 0/910000/ |k 1/910000/910200/ |k 0/50000/ |p 9 | ||
| 998 | |g 1243127082 |a Wise, Philipp |m 1243127082:Wise, Philipp |p 8 | ||
| 998 | |g 1173353534 |a Schulze, André |m 1173353534:Schulze, André |d 50000 |e 50000PS1173353534 |k 0/50000/ |p 7 | ||
| 998 | |g 1322672741 |a Daum, Marie T. J. |m 1322672741:Daum, Marie T. J. |p 6 | ||
| 998 | |g 1349466565 |a Kisilenko, Anna |m 1349466565:Kisilenko, Anna |d 50000 |e 50000PK1349466565 |k 0/50000/ |p 5 | ||
| 998 | |g 1302319159 |a Scheikl, Paul Maria |m 1302319159:Scheikl, Paul Maria |d 50000 |e 50000PS1302319159 |k 0/50000/ |p 4 | ||
| 998 | |g 1322594686 |a Younis, Rayan |m 1322594686:Younis, Rayan |d 50000 |e 50000PY1322594686 |k 0/50000/ |p 1 |x j | ||
| 999 | |a KXP-PPN1909617199 |e 4623017931 | ||
| BIB | |a Y | ||
| SER | |a journal | ||
| JSO | |a {"origin":[{"dateIssuedKey":"2024","dateIssuedDisp":"13 June 2024"}],"relHost":[{"origin":[{"publisher":"Springer-Verlag","dateIssuedDisp":"2002-","dateIssuedKey":"2002","publisherPlace":"New York"}],"title":[{"title_sort":"Surgical endoscopy and other interventional techniques","title":"Surgical endoscopy and other interventional techniques","subtitle":"official journal of the Society of American Gastrointestinal Endoscopic Surgeons (SAGES) and European Association for Endoscopic Surgery (E.A.E.S.)"}],"id":{"zdb":["1463171-4"],"eki":["254909620"],"issn":["1432-2218"]},"physDesc":[{"extent":"Online-Ressource"}],"recId":"254909620","disp":"A surgical activity model of laparoscopic cholecystectomy for co-operation with collaborative robotsSurgical endoscopy and other interventional techniques","type":{"bibl":"periodical","media":"Online-Ressource"},"note":["Gesehen am 19.06.24"],"pubHistory":["Volume 16, issue 1 (January 2002)-"],"language":["eng"],"part":{"volume":"38","year":"2024","issue":"8","extent":"13","pages":"4316-4328","text":"38(2024), 8, Seite 4316-4328"}}],"id":{"doi":["10.1007/s00464-024-10958-w"],"eki":["1909617199"]},"physDesc":[{"noteIll":"Illustrationen","extent":"13 S."}],"title":[{"title_sort":"surgical activity model of laparoscopic cholecystectomy for co-operation with collaborative robots","title":"A surgical activity model of laparoscopic cholecystectomy for co-operation with collaborative robots"}],"type":{"media":"Online-Ressource","bibl":"article-journal"},"note":["Gesehen am 27.11.2024"],"person":[{"display":"Younis, Rayan","given":"Rayan","family":"Younis","role":"aut"},{"role":"aut","family":"Yamlahi","given":"Amine","display":"Yamlahi, Amine"},{"role":"aut","family":"Bodenstedt","given":"Sebastian","display":"Bodenstedt, Sebastian"},{"display":"Scheikl, Paul Maria","given":"Paul Maria","role":"aut","family":"Scheikl"},{"given":"Anna","display":"Kisilenko, Anna","role":"aut","family":"Kisilenko"},{"given":"Marie T. J.","display":"Daum, Marie T. J.","family":"Daum","role":"aut"},{"given":"André","display":"Schulze, André","family":"Schulze","role":"aut"},{"role":"aut","family":"Wise","given":"Philipp","display":"Wise, Philipp"},{"family":"Nickel","role":"aut","given":"Felix","display":"Nickel, Felix"},{"display":"Mathis-Ullrich, Franziska","given":"Franziska","role":"aut","family":"Mathis-Ullrich"},{"role":"aut","family":"Maier-Hein","given":"Lena","display":"Maier-Hein, Lena"},{"family":"Müller","role":"aut","display":"Müller, Beat P.","given":"Beat P."},{"role":"aut","family":"Speidel","display":"Speidel, Stefanie","given":"Stefanie"},{"display":"Distler, Marius","given":"Marius","role":"aut","family":"Distler"},{"given":"Jürgen","display":"Weitz, Jürgen","family":"Weitz","role":"aut"},{"family":"Wagner","role":"aut","display":"Wagner, Martin","given":"Martin"}],"recId":"1909617199","name":{"displayForm":["R. Younis, A. Yamlahi, S. Bodenstedt, PM. Scheikl, A. Kisilenko, M. Daum, A. Schulze, P.A. Wise, F. Nickel, F. Mathis-Ullrich, L. Maier-Hein, BP. Müller-Stich, S. Speidel, M. Distler, J. Weitz, M. Wagner"]},"language":["eng"]} | ||
| SRT | |a YOUNISRAYASURGICALAC1320 | ||