Cover Image

Comparative validation of machine learning algorithms for surgical workflow and skill analysis with the HeiChole benchmark

Purpose - Surgical workflow and skill analysis are key technologies for the next generation of cognitive surgical assistance systems. These systems could increase the safety of the operation through context-sensitive warnings and semi-autonomous robotic assistance or improve training of surgeons via...

Full description

Saved in:
Bibliographic Details
Main Authors: Wagner, Martin (Author) , Müller, Beat P. (Author) , Kisilenko, Anna (Author) , Tran, Duc (Author) , Heger, Patrick (Author) , Mündermann, Lars (Author) , Lubotsky, David M. (Author) , Müller, Benjamin (Author) , Davitashvili, Tornike (Author) , Capek, Manuela (Author) , Reinke, Annika (Author) , Reid, Carissa (Author) , Yu, Tong (Author) , Vardazaryan, Armine (Author) , Nwoye, Chinedu Innocent (Author) , Padoy, Nicolas (Author) , Liu, Xinyang (Author) , Lee, Eung-Joo (Author) , Disch, Constantin (Author) , Meine, Hans (Author) , Xia, Tong (Author) , Jia, Fucang (Author) , Kondo, Satoshi (Author) , Reiter, Wolfgang (Author) , Jin, Yueming (Author) , Long, Yonghao (Author) , Jiang, Meirui (Author) , Dou, Qi (Author) , Heng, Pheng Ann (Author) , Twick, Isabell (Author) , Kirtac, Kadir (Author) , Hosgor, Enes (Author) , Bolmgren, Jon Lindström (Author) , Stenzel, Michael (Author) , von Siemens, Björn (Author) , Zhao, Long (Author) , Ge, Zhenxiao (Author) , Sun, Haiming (Author) , Xie, Di (Author) , Guo, Mengqi (Author) , Liu, Daochang (Author) , Kenngott, Hannes Götz (Author) , Nickel, Felix (Author) , Frankenberg, Moritz von (Author) , Mathis-Ullrich, Franziska (Author) , Kopp-Schneider, Annette (Author) , Maier-Hein, Lena (Author) , Speidel, Stefanie (Author) , Bodenstedt, Sebastian (Author)
Format: Article (Journal)
Language:English
Published: 7 March 2023
In: Medical image analysis
Year: 2023, Volume: 86, Pages: 1-21
ISSN:1361-8423
DOI:10.1016/j.media.2023.102770
Online Access:Verlag, lizenzpflichtig, Volltext: https://doi.org/10.1016/j.media.2023.102770
Verlag, lizenzpflichtig, Volltext: https://www.sciencedirect.com/science/article/pii/S1361841523000312
Get full text
Author Notes:Martin Wagner, Beat-Peter Müller-Stich, Anna Kisilenko, Duc Tran, Patrick Heger, Lars Mündermann, David M Lubotsky, Benjamin Müller, Tornike Davitashvili, Manuela Capek, Annika Reinke, Carissa Reid, Tong Yu, Armine Vardazaryan, Chinedu Innocent Nwoye, Nicolas Padoy, Xinyang Liu, Eung-Joo Lee, Constantin Disch, Hans Meine, Tong Xia, Fucang Jia, Satoshi Kondo, Wolfgang Reiter, Yueming Jin, Yonghao Long, Meirui Jiang, Qi Dou, Pheng Ann Heng, Isabell Twick, Kadir Kirtac, Enes Hosgor, Jon Lindström Bolmgren, Michael Stenzel, Björn von Siemens, Long Zhao, Zhenxiao Ge, Haiming Sun, Di Xie, Mengqi Guo, Daochang Liu, Hannes G. Kenngott, Felix Nickel, Moritz von Frankenberg, Franziska Mathis-Ullrich, Annette Kopp-Schneider, Lena Maier-Hein, Stefanie Speidel, Sebastian Bodenstedt

MARC

LEADER 00000caa a2200000 c 4500
001 1850961115
003 DE-627
005 20240328080703.0
007 cr uuu---uuuuu
008 230626s2023 xx |||||o 00| ||eng c
024 7 |a 10.1016/j.media.2023.102770  |2 doi 
035 |a (DE-627)1850961115 
035 |a (DE-599)KXP1850961115 
035 |a (OCoLC)1389527957 
040 |a DE-627  |b ger  |c DE-627  |e rda 
041 |a eng 
084 |a 33  |2 sdnb 
100 1 |a Wagner, Martin  |d 1988-  |e VerfasserIn  |0 (DE-588)1060231980  |0 (DE-627)799324337  |0 (DE-576)416324282  |4 aut 
245 1 0 |a Comparative validation of machine learning algorithms for surgical workflow and skill analysis with the HeiChole benchmark  |c Martin Wagner, Beat-Peter Müller-Stich, Anna Kisilenko, Duc Tran, Patrick Heger, Lars Mündermann, David M Lubotsky, Benjamin Müller, Tornike Davitashvili, Manuela Capek, Annika Reinke, Carissa Reid, Tong Yu, Armine Vardazaryan, Chinedu Innocent Nwoye, Nicolas Padoy, Xinyang Liu, Eung-Joo Lee, Constantin Disch, Hans Meine, Tong Xia, Fucang Jia, Satoshi Kondo, Wolfgang Reiter, Yueming Jin, Yonghao Long, Meirui Jiang, Qi Dou, Pheng Ann Heng, Isabell Twick, Kadir Kirtac, Enes Hosgor, Jon Lindström Bolmgren, Michael Stenzel, Björn von Siemens, Long Zhao, Zhenxiao Ge, Haiming Sun, Di Xie, Mengqi Guo, Daochang Liu, Hannes G. Kenngott, Felix Nickel, Moritz von Frankenberg, Franziska Mathis-Ullrich, Annette Kopp-Schneider, Lena Maier-Hein, Stefanie Speidel, Sebastian Bodenstedt 
264 1 |c 7 March 2023 
300 |a 21 
336 |a Text  |b txt  |2 rdacontent 
337 |a Computermedien  |b c  |2 rdamedia 
338 |a Online-Ressource  |b cr  |2 rdacarrier 
500 |a Online verfügbar 21. Februar 2023, Artikelversion 7. März 2023 
500 |a Gesehen am 26.06.2023 
520 |a Purpose - Surgical workflow and skill analysis are key technologies for the next generation of cognitive surgical assistance systems. These systems could increase the safety of the operation through context-sensitive warnings and semi-autonomous robotic assistance or improve training of surgeons via data-driven feedback. In surgical workflow analysis up to 91% average precision has been reported for phase recognition on an open data single-center video dataset. In this work we investigated the generalizability of phase recognition algorithms in a multicenter setting including more difficult recognition tasks such as surgical action and surgical skill. - Methods - To achieve this goal, a dataset with 33 laparoscopic cholecystectomy videos from three surgical centers with a total operation time of 22 h was created. Labels included framewise annotation of seven surgical phases with 250 phase transitions, 5514 occurences of four surgical actions, 6980 occurences of 21 surgical instruments from seven instrument categories and 495 skill classifications in five skill dimensions. The dataset was used in the 2019 international Endoscopic Vision challenge, sub-challenge for surgical workflow and skill analysis. Here, 12 research teams trained and submitted their machine learning algorithms for recognition of phase, action, instrument and/or skill assessment. - Results - F1-scores were achieved for phase recognition between 23.9% and 67.7% (n = 9 teams), for instrument presence detection between 38.5% and 63.8% (n = 8 teams), but for action recognition only between 21.8% and 23.3% (n = 5 teams). The average absolute error for skill assessment was 0.78 (n = 1 team). - Conclusion - Surgical workflow and skill analysis are promising technologies to support the surgical team, but there is still room for improvement, as shown by our comparison of machine learning algorithms. This novel HeiChole benchmark can be used for comparable evaluation and validation of future work. In future studies, it is of utmost importance to create more open, high-quality datasets in order to allow the development of artificial intelligence and cognitive robotics in surgery. 
650 4 |a Endoscopic vision 
650 4 |a Laparoscopic cholecystectomy 
650 4 |a Surgical data science 
650 4 |a Surgical workflow analysis 
700 1 |a Müller, Beat P.  |d 1971-  |e VerfasserIn  |0 (DE-588)14066209X  |0 (DE-627)70374819X  |0 (DE-576)317992287  |4 aut 
700 1 |a Kisilenko, Anna  |e VerfasserIn  |4 aut 
700 1 |a Tran, Duc  |e VerfasserIn  |4 aut 
700 1 |a Heger, Patrick  |d 1986-  |e VerfasserIn  |0 (DE-588)1071553445  |0 (DE-627)82621357X  |0 (DE-576)433143827  |4 aut 
700 1 |a Mündermann, Lars  |e VerfasserIn  |4 aut 
700 1 |a Lubotsky, David M.  |e VerfasserIn  |0 (DE-588)1293979155  |0 (DE-627)185096646X  |4 aut 
700 1 |a Müller, Benjamin  |e VerfasserIn  |4 aut 
700 1 |a Davitashvili, Tornike  |e VerfasserIn  |0 (DE-588)1293979902  |0 (DE-627)1850967245  |4 aut 
700 1 |a Capek, Manuela  |e VerfasserIn  |4 aut 
700 1 |a Reinke, Annika  |d 1993-  |e VerfasserIn  |0 (DE-588)1219684252  |0 (DE-627)1735662143  |4 aut 
700 1 |a Reid, Carissa  |e VerfasserIn  |0 (DE-588)1293980463  |0 (DE-627)1850967970  |4 aut 
700 1 |a Yu, Tong  |e VerfasserIn  |4 aut 
700 1 |a Vardazaryan, Armine  |e VerfasserIn  |4 aut 
700 1 |a Nwoye, Chinedu Innocent  |e VerfasserIn  |4 aut 
700 1 |a Padoy, Nicolas  |e VerfasserIn  |4 aut 
700 1 |a Liu, Xinyang  |e VerfasserIn  |4 aut 
700 1 |a Lee, Eung-Joo  |e VerfasserIn  |4 aut 
700 1 |a Disch, Constantin  |e VerfasserIn  |4 aut 
700 1 |a Meine, Hans  |e VerfasserIn  |4 aut 
700 1 |a Xia, Tong  |e VerfasserIn  |4 aut 
700 1 |a Jia, Fucang  |e VerfasserIn  |4 aut 
700 1 |a Kondo, Satoshi  |e VerfasserIn  |4 aut 
700 1 |a Reiter, Wolfgang  |e VerfasserIn  |4 aut 
700 1 |a Jin, Yueming  |e VerfasserIn  |4 aut 
700 1 |a Long, Yonghao  |e VerfasserIn  |4 aut 
700 1 |a Jiang, Meirui  |e VerfasserIn  |4 aut 
700 1 |a Dou, Qi  |e VerfasserIn  |4 aut 
700 1 |a Heng, Pheng Ann  |e VerfasserIn  |4 aut 
700 1 |a Twick, Isabell  |e VerfasserIn  |4 aut 
700 1 |a Kirtac, Kadir  |e VerfasserIn  |4 aut 
700 1 |a Hosgor, Enes  |e VerfasserIn  |4 aut 
700 1 |a Bolmgren, Jon Lindström  |e VerfasserIn  |4 aut 
700 1 |a Stenzel, Michael  |e VerfasserIn  |4 aut 
700 1 |a von Siemens, Björn  |e VerfasserIn  |4 aut 
700 1 |a Zhao, Long  |e VerfasserIn  |4 aut 
700 1 |a Ge, Zhenxiao  |e VerfasserIn  |4 aut 
700 1 |a Sun, Haiming  |e VerfasserIn  |4 aut 
700 1 |a Xie, Di  |e VerfasserIn  |4 aut 
700 1 |a Guo, Mengqi  |e VerfasserIn  |4 aut 
700 1 |a Liu, Daochang  |e VerfasserIn  |4 aut 
700 1 |a Kenngott, Hannes Götz  |d 1979-  |e VerfasserIn  |0 (DE-588)141469994  |0 (DE-627)62780117X  |0 (DE-576)324023065  |4 aut 
700 1 |a Nickel, Felix  |d 1982-  |e VerfasserIn  |0 (DE-588)1067980059  |0 (DE-627)819414875  |0 (DE-576)427122619  |4 aut 
700 1 |a Frankenberg, Moritz von  |e VerfasserIn  |0 (DE-588)1026854458  |0 (DE-627)727500678  |0 (DE-576)372184367  |4 aut 
700 1 |a Mathis-Ullrich, Franziska  |e VerfasserIn  |4 aut 
700 1 |a Kopp-Schneider, Annette  |e VerfasserIn  |0 (DE-588)1119160545  |0 (DE-627)872460444  |0 (DE-576)178153206  |4 aut 
700 1 |a Maier-Hein, Lena  |d 1980-  |e VerfasserIn  |0 (DE-588)1075029252  |0 (DE-627)832869899  |0 (DE-576)190090804  |4 aut 
700 1 |a Speidel, Stefanie  |e VerfasserIn  |0 (DE-588)140539794  |0 (DE-627)646561995  |0 (DE-576)337205159  |4 aut 
700 1 |a Bodenstedt, Sebastian  |e VerfasserIn  |4 aut 
773 0 8 |i Enthalten in  |t Medical image analysis  |d Amsterdam [u.a.] : Elsevier Science, 1996  |g 86(2023) vom: März, Artikel-ID 102770, Seite 1-21  |h Online-Ressource  |w (DE-627)306365081  |w (DE-600)1497450-2  |w (DE-576)091204941  |x 1361-8423  |7 nnas  |a Comparative validation of machine learning algorithms for surgical workflow and skill analysis with the HeiChole benchmark 
773 1 8 |g volume:86  |g year:2023  |g month:03  |g elocationid:102770  |g pages:1-21  |g extent:21  |a Comparative validation of machine learning algorithms for surgical workflow and skill analysis with the HeiChole benchmark 
856 4 0 |u https://doi.org/10.1016/j.media.2023.102770  |x Verlag  |x Resolving-System  |z lizenzpflichtig  |3 Volltext 
856 4 0 |u https://www.sciencedirect.com/science/article/pii/S1361841523000312  |x Verlag  |z lizenzpflichtig  |3 Volltext 
951 |a AR 
992 |a 20230626 
993 |a Article 
994 |a 2023 
998 |g 1075029252  |a Maier-Hein, Lena  |m 1075029252:Maier-Hein, Lena  |d 110000  |e 110000PM1075029252  |k 0/110000/  |p 47 
998 |g 1119160545  |a Kopp-Schneider, Annette  |m 1119160545:Kopp-Schneider, Annette  |d 50000  |e 50000PK1119160545  |k 0/50000/  |p 46 
998 |g 1026854458  |a Frankenberg, Moritz von  |m 1026854458:Frankenberg, Moritz von  |d 910000  |d 910200  |d 50000  |e 910000PF1026854458  |e 910200PF1026854458  |e 50000PF1026854458  |k 0/910000/  |k 1/910000/910200/  |k 0/50000/  |p 44 
998 |g 1067980059  |a Nickel, Felix  |m 1067980059:Nickel, Felix  |d 910000  |d 910200  |d 50000  |e 910000PN1067980059  |e 910200PN1067980059  |e 50000PN1067980059  |k 0/910000/  |k 1/910000/910200/  |k 0/50000/  |p 43 
998 |g 141469994  |a Kenngott, Hannes Götz  |m 141469994:Kenngott, Hannes Götz  |d 910000  |d 910200  |e 910000PK141469994  |e 910200PK141469994  |k 0/910000/  |k 1/910000/910200/  |p 42 
998 |g 1293980463  |a Reid, Carissa  |m 1293980463:Reid, Carissa  |d 50000  |e 50000PR1293980463  |k 0/50000/  |p 12 
998 |g 1219684252  |a Reinke, Annika  |m 1219684252:Reinke, Annika  |d 50000  |e 50000PR1219684252  |k 0/50000/  |p 11 
998 |g 1293979902  |a Davitashvili, Tornike  |m 1293979902:Davitashvili, Tornike  |p 9 
998 |g 1293979155  |a Lubotsky, David M.  |m 1293979155:Lubotsky, David M.  |p 7 
998 |g 1071553445  |a Heger, Patrick  |m 1071553445:Heger, Patrick  |p 5 
998 |g 14066209X  |a Müller, Beat P.  |m 14066209X:Müller, Beat P.  |d 50000  |e 50000PM14066209X  |k 0/50000/  |p 2 
998 |g 1060231980  |a Wagner, Martin  |m 1060231980:Wagner, Martin  |d 910000  |d 910200  |e 910000PW1060231980  |e 910200PW1060231980  |k 0/910000/  |k 1/910000/910200/  |p 1  |x j 
999 |a KXP-PPN1850961115  |e 4343433382 
BIB |a Y 
SER |a journal 
JSO |a {"id":{"eki":["1850961115"],"doi":["10.1016/j.media.2023.102770"]},"recId":"1850961115","name":{"displayForm":["Martin Wagner, Beat-Peter Müller-Stich, Anna Kisilenko, Duc Tran, Patrick Heger, Lars Mündermann, David M Lubotsky, Benjamin Müller, Tornike Davitashvili, Manuela Capek, Annika Reinke, Carissa Reid, Tong Yu, Armine Vardazaryan, Chinedu Innocent Nwoye, Nicolas Padoy, Xinyang Liu, Eung-Joo Lee, Constantin Disch, Hans Meine, Tong Xia, Fucang Jia, Satoshi Kondo, Wolfgang Reiter, Yueming Jin, Yonghao Long, Meirui Jiang, Qi Dou, Pheng Ann Heng, Isabell Twick, Kadir Kirtac, Enes Hosgor, Jon Lindström Bolmgren, Michael Stenzel, Björn von Siemens, Long Zhao, Zhenxiao Ge, Haiming Sun, Di Xie, Mengqi Guo, Daochang Liu, Hannes G. Kenngott, Felix Nickel, Moritz von Frankenberg, Franziska Mathis-Ullrich, Annette Kopp-Schneider, Lena Maier-Hein, Stefanie Speidel, Sebastian Bodenstedt"]},"type":{"bibl":"article-journal","media":"Online-Ressource"},"person":[{"roleDisplay":"VerfasserIn","given":"Martin","display":"Wagner, Martin","family":"Wagner","role":"aut"},{"role":"aut","family":"Müller","display":"Müller, Beat P.","roleDisplay":"VerfasserIn","given":"Beat P."},{"role":"aut","roleDisplay":"VerfasserIn","given":"Anna","display":"Kisilenko, Anna","family":"Kisilenko"},{"family":"Tran","given":"Duc","roleDisplay":"VerfasserIn","display":"Tran, Duc","role":"aut"},{"role":"aut","family":"Heger","given":"Patrick","roleDisplay":"VerfasserIn","display":"Heger, Patrick"},{"given":"Lars","roleDisplay":"VerfasserIn","display":"Mündermann, Lars","family":"Mündermann","role":"aut"},{"family":"Lubotsky","given":"David M.","roleDisplay":"VerfasserIn","display":"Lubotsky, David M.","role":"aut"},{"roleDisplay":"VerfasserIn","display":"Müller, Benjamin","given":"Benjamin","family":"Müller","role":"aut"},{"family":"Davitashvili","display":"Davitashvili, Tornike","roleDisplay":"VerfasserIn","given":"Tornike","role":"aut"},{"role":"aut","family":"Capek","roleDisplay":"VerfasserIn","given":"Manuela","display":"Capek, Manuela"},{"role":"aut","display":"Reinke, Annika","roleDisplay":"VerfasserIn","given":"Annika","family":"Reinke"},{"display":"Reid, Carissa","roleDisplay":"VerfasserIn","given":"Carissa","family":"Reid","role":"aut"},{"role":"aut","roleDisplay":"VerfasserIn","given":"Tong","display":"Yu, Tong","family":"Yu"},{"roleDisplay":"VerfasserIn","display":"Vardazaryan, Armine","given":"Armine","family":"Vardazaryan","role":"aut"},{"display":"Nwoye, Chinedu Innocent","roleDisplay":"VerfasserIn","given":"Chinedu Innocent","family":"Nwoye","role":"aut"},{"display":"Padoy, Nicolas","roleDisplay":"VerfasserIn","given":"Nicolas","family":"Padoy","role":"aut"},{"display":"Liu, Xinyang","roleDisplay":"VerfasserIn","given":"Xinyang","family":"Liu","role":"aut"},{"role":"aut","family":"Lee","roleDisplay":"VerfasserIn","given":"Eung-Joo","display":"Lee, Eung-Joo"},{"family":"Disch","roleDisplay":"VerfasserIn","given":"Constantin","display":"Disch, Constantin","role":"aut"},{"given":"Hans","roleDisplay":"VerfasserIn","display":"Meine, Hans","family":"Meine","role":"aut"},{"role":"aut","roleDisplay":"VerfasserIn","given":"Tong","display":"Xia, Tong","family":"Xia"},{"roleDisplay":"VerfasserIn","display":"Jia, Fucang","given":"Fucang","family":"Jia","role":"aut"},{"role":"aut","family":"Kondo","given":"Satoshi","roleDisplay":"VerfasserIn","display":"Kondo, Satoshi"},{"family":"Reiter","roleDisplay":"VerfasserIn","given":"Wolfgang","display":"Reiter, Wolfgang","role":"aut"},{"role":"aut","family":"Jin","given":"Yueming","roleDisplay":"VerfasserIn","display":"Jin, Yueming"},{"role":"aut","family":"Long","display":"Long, Yonghao","roleDisplay":"VerfasserIn","given":"Yonghao"},{"display":"Jiang, Meirui","roleDisplay":"VerfasserIn","given":"Meirui","family":"Jiang","role":"aut"},{"role":"aut","given":"Qi","roleDisplay":"VerfasserIn","display":"Dou, Qi","family":"Dou"},{"role":"aut","family":"Heng","display":"Heng, Pheng Ann","roleDisplay":"VerfasserIn","given":"Pheng Ann"},{"role":"aut","family":"Twick","roleDisplay":"VerfasserIn","given":"Isabell","display":"Twick, Isabell"},{"role":"aut","roleDisplay":"VerfasserIn","given":"Kadir","display":"Kirtac, Kadir","family":"Kirtac"},{"role":"aut","roleDisplay":"VerfasserIn","given":"Enes","display":"Hosgor, Enes","family":"Hosgor"},{"roleDisplay":"VerfasserIn","given":"Jon Lindström","display":"Bolmgren, Jon Lindström","family":"Bolmgren","role":"aut"},{"role":"aut","roleDisplay":"VerfasserIn","given":"Michael","display":"Stenzel, Michael","family":"Stenzel"},{"role":"aut","given":"Björn","roleDisplay":"VerfasserIn","display":"von Siemens, Björn","family":"von Siemens"},{"role":"aut","given":"Long","roleDisplay":"VerfasserIn","display":"Zhao, Long","family":"Zhao"},{"role":"aut","family":"Ge","given":"Zhenxiao","roleDisplay":"VerfasserIn","display":"Ge, Zhenxiao"},{"roleDisplay":"VerfasserIn","display":"Sun, Haiming","given":"Haiming","family":"Sun","role":"aut"},{"role":"aut","family":"Xie","roleDisplay":"VerfasserIn","display":"Xie, Di","given":"Di"},{"role":"aut","roleDisplay":"VerfasserIn","given":"Mengqi","display":"Guo, Mengqi","family":"Guo"},{"role":"aut","family":"Liu","display":"Liu, Daochang","roleDisplay":"VerfasserIn","given":"Daochang"},{"role":"aut","family":"Kenngott","display":"Kenngott, Hannes Götz","roleDisplay":"VerfasserIn","given":"Hannes Götz"},{"family":"Nickel","display":"Nickel, Felix","roleDisplay":"VerfasserIn","given":"Felix","role":"aut"},{"family":"Frankenberg","roleDisplay":"VerfasserIn","given":"Moritz von","display":"Frankenberg, Moritz von","role":"aut"},{"role":"aut","family":"Mathis-Ullrich","given":"Franziska","roleDisplay":"VerfasserIn","display":"Mathis-Ullrich, Franziska"},{"roleDisplay":"VerfasserIn","display":"Kopp-Schneider, Annette","given":"Annette","family":"Kopp-Schneider","role":"aut"},{"given":"Lena","roleDisplay":"VerfasserIn","display":"Maier-Hein, Lena","family":"Maier-Hein","role":"aut"},{"role":"aut","family":"Speidel","roleDisplay":"VerfasserIn","given":"Stefanie","display":"Speidel, Stefanie"},{"role":"aut","family":"Bodenstedt","display":"Bodenstedt, Sebastian","roleDisplay":"VerfasserIn","given":"Sebastian"}],"title":[{"title":"Comparative validation of machine learning algorithms for surgical workflow and skill analysis with the HeiChole benchmark","title_sort":"Comparative validation of machine learning algorithms for surgical workflow and skill analysis with the HeiChole benchmark"}],"origin":[{"dateIssuedKey":"2023","dateIssuedDisp":"7 March 2023"}],"relHost":[{"disp":"Comparative validation of machine learning algorithms for surgical workflow and skill analysis with the HeiChole benchmarkMedical image analysis","language":["eng"],"note":["Gesehen am 16.05.23"],"physDesc":[{"extent":"Online-Ressource"}],"origin":[{"dateIssuedKey":"1996","publisher":"Elsevier Science","dateIssuedDisp":"1996-","publisherPlace":"Amsterdam [u.a.]"}],"titleAlt":[{"title":"Medical image analysis online"}],"title":[{"title":"Medical image analysis","title_sort":"Medical image analysis"}],"part":{"extent":"21","text":"86(2023) vom: März, Artikel-ID 102770, Seite 1-21","volume":"86","pages":"1-21","year":"2023"},"type":{"media":"Online-Ressource","bibl":"periodical"},"pubHistory":["1.1996/97 -"],"recId":"306365081","id":{"eki":["306365081"],"zdb":["1497450-2"],"issn":["1361-8423"]}}],"physDesc":[{"extent":"21 S."}],"note":["Online verfügbar 21. Februar 2023, Artikelversion 7. März 2023","Gesehen am 26.06.2023"],"language":["eng"]} 
SRT |a WAGNERMARTCOMPARATIV7202 

Similar Items