Comparative validation of multi-instance instrument segmentation in endoscopy: results of the ROBUST-MIS 2019 challenge

Intraoperative tracking of laparoscopic instruments is often a prerequisite for computer and robotic-assisted interventions. While numerous methods for detecting, segmenting and tracking of medical instruments based on endoscopic video images have been proposed in the literature, key limitations rem...

Ausführliche Beschreibung

Gespeichert in:
Bibliographische Detailangaben
Hauptverfasser: Roß, Tobias (VerfasserIn) , Reinke, Annika (VerfasserIn) , Full, Peter M. (VerfasserIn) , Wagner, Martin (VerfasserIn) , Kenngott, Hannes Götz (VerfasserIn) , Apitz, Martin (VerfasserIn) , Hempe, Hellena (VerfasserIn) , Mindroc-Filimon, Diana (VerfasserIn) , Godau, Patrick (VerfasserIn) , Tran, Thuy Nuong (VerfasserIn) , Bruno, Pierangela (VerfasserIn) , Arbeláez, Pablo (VerfasserIn) , Bian, Gui-Bin (VerfasserIn) , Bodenstedt, Sebastian (VerfasserIn) , Bolmgren, Jon Lindström (VerfasserIn) , Bravo-Sánchez, Laura (VerfasserIn) , Chen, Hua-Bin (VerfasserIn) , González, Cristina (VerfasserIn) , Guo, Dong (VerfasserIn) , Halvorsen, Pål (VerfasserIn) , Heng, Pheng-Ann (VerfasserIn) , Hosgor, Enes (VerfasserIn) , Hou, Zeng-Guang (VerfasserIn) , Isensee, Fabian (VerfasserIn) , Jha, Debesh (VerfasserIn) , Jiang, Tingting (VerfasserIn) , Jin, Yueming (VerfasserIn) , Kirtac, Kadir (VerfasserIn) , Kletz, Sabrina (VerfasserIn) , Leger, Stefan (VerfasserIn) , Li, Zhixuan (VerfasserIn) , Maier-Hein, Klaus H. (VerfasserIn) , Ni, Zhen-Liang (VerfasserIn) , Riegler, Michael A. (VerfasserIn) , Schoeffmann, Klaus (VerfasserIn) , Shi, Ruohua (VerfasserIn) , Speidel, Stefanie (VerfasserIn) , Stenzel, Michael (VerfasserIn) , Twick, Isabell (VerfasserIn) , Wang, Gutai (VerfasserIn) , Wang, Jiacheng (VerfasserIn) , Wang, Liansheng (VerfasserIn) , Wang, Lu (VerfasserIn) , Zhang, Yujie (VerfasserIn) , Zhou, Yan-Jie (VerfasserIn) , Zhu, Lei (VerfasserIn) , Wiesenfarth, Manuel (VerfasserIn) , Kopp-Schneider, Annette (VerfasserIn) , Müller, Beat P. (VerfasserIn) , Maier-Hein, Lena (VerfasserIn)
Dokumenttyp: Article (Journal)
Sprache:Englisch
Veröffentlicht: 2021
In: Medical image analysis
Year: 2021, Jahrgang: 70, Pages: 1-26
ISSN:1361-8423
DOI:10.1016/j.media.2020.101920
Online-Zugang:Verlag, Volltext: https://doi.org/10.1016/j.media.2020.101920
Verlag, Volltext: https://www.sciencedirect.com/science/article/pii/S136184152030284X
Volltext
Verfasserangaben:Tobias Roß, Annika Reinke, Peter M. Full, Martin Wagner, Hannes Kenngott, Martin Apitz, Hellena Hempe, Diana Mindroc-Filimon, Patrick Scholz, Thuy Nuong Tran, Pierangela Bruno, Pablo Arbeláez, Gui-Bin Bian, Sebastian Bodenstedt, Jon Lindström Bolmgren, Laura Bravo-Sánchez, Hua-Bin Chen, Cristina González, Dong Guo, Pål Halvorsen, Pheng-Ann Heng, Enes Hosgor, Zeng-Guang Hou, Fabian Isensee, Debesh Jha, Tingting Jiang, Yueming Jin, Kadir Kirtac, Sabrina Kletz, Stefan Leger, Zhixuan Li, Klaus H. Maier-Hein, Zhen-Liang Ni, Michael A. Riegler, Klaus Schoeffmann, Ruohua Shi, Stefanie Speidel, Michael Stenzel, Isabell Twick, Gutai Wang, Jiacheng Wang, Liansheng Wang, Lu Wang, Yujie Zhang, Yan-Jie Zhou, Lei Zhu, Manuel Wiesenfarth, Annette Kopp-Schneider, Beat P. Müller-Stich, Lena Maier-Hein

MARC

LEADER 00000caa a2200000 c 4500
001 1767175701
003 DE-627
005 20230426082444.0
007 cr uuu---uuuuu
008 210817s2021 xx |||||o 00| ||eng c
024 7 |a 10.1016/j.media.2020.101920  |2 doi 
035 |a (DE-627)1767175701 
035 |a (DE-599)KXP1767175701 
035 |a (OCoLC)1341420662 
040 |a DE-627  |b ger  |c DE-627  |e rda 
041 |a eng 
084 |a 33  |2 sdnb 
100 1 |a Roß, Tobias  |d 1990-  |e VerfasserIn  |0 (DE-588)118364955X  |0 (DE-627)1663271143  |4 aut 
245 1 0 |a Comparative validation of multi-instance instrument segmentation in endoscopy  |b results of the ROBUST-MIS 2019 challenge  |c Tobias Roß, Annika Reinke, Peter M. Full, Martin Wagner, Hannes Kenngott, Martin Apitz, Hellena Hempe, Diana Mindroc-Filimon, Patrick Scholz, Thuy Nuong Tran, Pierangela Bruno, Pablo Arbeláez, Gui-Bin Bian, Sebastian Bodenstedt, Jon Lindström Bolmgren, Laura Bravo-Sánchez, Hua-Bin Chen, Cristina González, Dong Guo, Pål Halvorsen, Pheng-Ann Heng, Enes Hosgor, Zeng-Guang Hou, Fabian Isensee, Debesh Jha, Tingting Jiang, Yueming Jin, Kadir Kirtac, Sabrina Kletz, Stefan Leger, Zhixuan Li, Klaus H. Maier-Hein, Zhen-Liang Ni, Michael A. Riegler, Klaus Schoeffmann, Ruohua Shi, Stefanie Speidel, Michael Stenzel, Isabell Twick, Gutai Wang, Jiacheng Wang, Liansheng Wang, Lu Wang, Yujie Zhang, Yan-Jie Zhou, Lei Zhu, Manuel Wiesenfarth, Annette Kopp-Schneider, Beat P. Müller-Stich, Lena Maier-Hein 
264 1 |c 2021 
300 |a 26 
336 |a Text  |b txt  |2 rdacontent 
337 |a Computermedien  |b c  |2 rdamedia 
338 |a Online-Ressource  |b cr  |2 rdacarrier 
500 |a Available online 28 November 2020 
500 |a Gesehen am 17.08.2021 
520 |a Intraoperative tracking of laparoscopic instruments is often a prerequisite for computer and robotic-assisted interventions. While numerous methods for detecting, segmenting and tracking of medical instruments based on endoscopic video images have been proposed in the literature, key limitations remain to be addressed: Firstly, robustness, that is, the reliable performance of state-of-the-art methods when run on challenging images (e.g. in the presence of blood, smoke or motion artifacts). Secondly, generalization; algorithms trained for a specific intervention in a specific hospital should generalize to other interventions or institutions. In an effort to promote solutions for these limitations, we organized the Robust Medical Instrument Segmentation (ROBUST-MIS) challenge as an international benchmarking competition with a specific focus on the robustness and generalization capabilities of algorithms. For the first time in the field of endoscopic image processing, our challenge included a task on binary segmentation and also addressed multi-instance detection and segmentation. The challenge was based on a surgical data set comprising 10,040 annotated images acquired from a total of 30 surgical procedures from three different types of surgery. The validation of the competing methods for the three tasks (binary segmentation, multi-instance detection and multi-instance segmentation) was performed in three different stages with an increasing domain gap between the training and the test data. The results confirm the initial hypothesis, namely that algorithm performance degrades with an increasing domain gap. While the average detection and segmentation quality of the best-performing algorithms is high, future research should concentrate on detection and segmentation of small, crossing, moving and transparent instrument(s) (parts). 
650 4 |a Minimally invasive surgery 
650 4 |a Multi-instance instrument 
650 4 |a Robustness and generalization 
650 4 |a Surgical data science 
700 1 |a Reinke, Annika  |d 1993-  |e VerfasserIn  |0 (DE-588)1219684252  |0 (DE-627)1735662143  |4 aut 
700 1 |a Full, Peter M.  |e VerfasserIn  |0 (DE-588)1219695777  |0 (DE-627)1735698784  |4 aut 
700 1 |a Wagner, Martin  |d 1988-  |e VerfasserIn  |0 (DE-588)1060231980  |0 (DE-627)799324337  |0 (DE-576)416324282  |4 aut 
700 1 |a Kenngott, Hannes Götz  |d 1979-  |e VerfasserIn  |0 (DE-588)141469994  |0 (DE-627)62780117X  |0 (DE-576)324023065  |4 aut 
700 1 |a Apitz, Martin  |d 1987-  |e VerfasserIn  |0 (DE-588)1071497219  |0 (DE-627)825950252  |0 (DE-576)433113499  |4 aut 
700 1 |a Hempe, Hellena  |e VerfasserIn  |4 aut 
700 1 |a Mindroc-Filimon, Diana  |e VerfasserIn  |4 aut 
700 1 |a Godau, Patrick  |d 1993-  |e VerfasserIn  |0 (DE-588)1179282515  |0 (DE-627)1066788200  |0 (DE-576)518174212  |4 aut 
700 1 |a Tran, Thuy Nuong  |e VerfasserIn  |4 aut 
700 1 |a Bruno, Pierangela  |e VerfasserIn  |4 aut 
700 1 |a Arbeláez, Pablo  |e VerfasserIn  |4 aut 
700 1 |a Bian, Gui-Bin  |e VerfasserIn  |4 aut 
700 1 |a Bodenstedt, Sebastian  |e VerfasserIn  |4 aut 
700 1 |a Bolmgren, Jon Lindström  |e VerfasserIn  |4 aut 
700 1 |a Bravo-Sánchez, Laura  |e VerfasserIn  |4 aut 
700 1 |a Chen, Hua-Bin  |e VerfasserIn  |4 aut 
700 1 |a González, Cristina  |e VerfasserIn  |4 aut 
700 1 |a Guo, Dong  |e VerfasserIn  |4 aut 
700 1 |a Halvorsen, Pål  |e VerfasserIn  |4 aut 
700 1 |a Heng, Pheng-Ann  |e VerfasserIn  |4 aut 
700 1 |a Hosgor, Enes  |e VerfasserIn  |4 aut 
700 1 |a Hou, Zeng-Guang  |e VerfasserIn  |4 aut 
700 1 |a Isensee, Fabian  |d 1990-  |e VerfasserIn  |0 (DE-588)1207568430  |0 (DE-627)1694044998  |4 aut 
700 1 |a Jha, Debesh  |e VerfasserIn  |4 aut 
700 1 |a Jiang, Tingting  |e VerfasserIn  |4 aut 
700 1 |a Jin, Yueming  |e VerfasserIn  |4 aut 
700 1 |a Kirtac, Kadir  |e VerfasserIn  |4 aut 
700 1 |a Kletz, Sabrina  |e VerfasserIn  |4 aut 
700 1 |a Leger, Stefan  |e VerfasserIn  |4 aut 
700 1 |a Li, Zhixuan  |e VerfasserIn  |4 aut 
700 1 |a Maier-Hein, Klaus H.  |d 1980-  |e VerfasserIn  |0 (DE-588)1100551875  |0 (DE-627)85946461X  |0 (DE-576)333771222  |4 aut 
700 1 |a Ni, Zhen-Liang  |e VerfasserIn  |4 aut 
700 1 |a Riegler, Michael A.  |e VerfasserIn  |4 aut 
700 1 |a Schoeffmann, Klaus  |e VerfasserIn  |4 aut 
700 1 |a Shi, Ruohua  |e VerfasserIn  |4 aut 
700 1 |a Speidel, Stefanie  |e VerfasserIn  |4 aut 
700 1 |a Stenzel, Michael  |e VerfasserIn  |4 aut 
700 1 |a Twick, Isabell  |e VerfasserIn  |4 aut 
700 1 |a Wang, Gutai  |e VerfasserIn  |4 aut 
700 1 |a Wang, Jiacheng  |e VerfasserIn  |4 aut 
700 1 |a Wang, Liansheng  |e VerfasserIn  |4 aut 
700 1 |a Wang, Lu  |e VerfasserIn  |4 aut 
700 1 |a Zhang, Yujie  |e VerfasserIn  |4 aut 
700 1 |a Zhou, Yan-Jie  |e VerfasserIn  |4 aut 
700 1 |a Zhu, Lei  |e VerfasserIn  |4 aut 
700 1 |a Wiesenfarth, Manuel  |e VerfasserIn  |4 aut 
700 1 |a Kopp-Schneider, Annette  |e VerfasserIn  |0 (DE-588)1119160545  |0 (DE-627)872460444  |0 (DE-576)178153206  |4 aut 
700 1 |a Müller, Beat P.  |d 1971-  |e VerfasserIn  |0 (DE-588)14066209X  |0 (DE-627)70374819X  |0 (DE-576)317992287  |4 aut 
700 1 |a Maier-Hein, Lena  |d 1980-  |e VerfasserIn  |0 (DE-588)1075029252  |0 (DE-627)832869899  |0 (DE-576)190090804  |4 aut 
773 0 8 |i Enthalten in  |t Medical image analysis  |d Amsterdam [u.a.] : Elsevier Science, 1996  |g 70(2021), Artikel-ID 101920, Seite 1-26  |h Online-Ressource  |w (DE-627)306365081  |w (DE-600)1497450-2  |w (DE-576)091204941  |x 1361-8423  |7 nnas  |a Comparative validation of multi-instance instrument segmentation in endoscopy results of the ROBUST-MIS 2019 challenge 
773 1 8 |g volume:70  |g year:2021  |g elocationid:101920  |g pages:1-26  |g extent:26  |a Comparative validation of multi-instance instrument segmentation in endoscopy results of the ROBUST-MIS 2019 challenge 
856 4 0 |u https://doi.org/10.1016/j.media.2020.101920  |x Verlag  |x Resolving-System  |3 Volltext 
856 4 0 |u https://www.sciencedirect.com/science/article/pii/S136184152030284X  |x Verlag  |3 Volltext 
951 |a AR 
992 |a 20210817 
993 |a Article 
994 |a 2021 
998 |g 1075029252  |a Maier-Hein, Lena  |m 1075029252:Maier-Hein, Lena  |d 110000  |e 110000PM1075029252  |k 0/110000/  |p 50  |y j 
998 |g 14066209X  |a Müller, Beat P.  |m 14066209X:Müller, Beat P.  |d 910000  |d 910200  |d 50000  |e 910000PM14066209X  |e 910200PM14066209X  |e 50000PM14066209X  |k 0/910000/  |k 1/910000/910200/  |k 0/50000/  |p 49 
998 |g 1119160545  |a Kopp-Schneider, Annette  |m 1119160545:Kopp-Schneider, Annette  |d 50000  |e 50000PK1119160545  |k 0/50000/  |p 48 
998 |g 1100551875  |a Maier-Hein, Klaus H.  |m 1100551875:Maier-Hein, Klaus H.  |d 910000  |d 911400  |e 910000PM1100551875  |e 911400PM1100551875  |k 0/910000/  |k 1/910000/911400/  |p 32 
998 |g 1179282515  |a Godau, Patrick  |m 1179282515:Godau, Patrick  |d 110000  |e 110000PG1179282515  |k 0/110000/  |p 9 
998 |g 1071497219  |a Apitz, Martin  |m 1071497219:Apitz, Martin  |p 6 
998 |g 141469994  |a Kenngott, Hannes Götz  |m 141469994:Kenngott, Hannes Götz  |d 910000  |d 910200  |e 910000PK141469994  |e 910200PK141469994  |k 0/910000/  |k 1/910000/910200/  |p 5 
998 |g 1060231980  |a Wagner, Martin  |m 1060231980:Wagner, Martin  |d 910000  |d 910200  |e 910000PW1060231980  |e 910200PW1060231980  |k 0/910000/  |k 1/910000/910200/  |p 4 
998 |g 1219695777  |a Full, Peter M.  |m 1219695777:Full, Peter M.  |d 50000  |e 50000PF1219695777  |k 0/50000/  |p 3 
998 |g 1219684252  |a Reinke, Annika  |m 1219684252:Reinke, Annika  |d 110000  |e 110000PR1219684252  |k 0/110000/  |p 2 
998 |g 118364955X  |a Roß, Tobias  |m 118364955X:Roß, Tobias  |d 50000  |e 50000PR118364955X  |k 0/50000/  |p 1  |x j 
999 |a KXP-PPN1767175701  |e 3969526477 
BIB |a Y 
SER |a journal 
JSO |a {"name":{"displayForm":["Tobias Roß, Annika Reinke, Peter M. Full, Martin Wagner, Hannes Kenngott, Martin Apitz, Hellena Hempe, Diana Mindroc-Filimon, Patrick Scholz, Thuy Nuong Tran, Pierangela Bruno, Pablo Arbeláez, Gui-Bin Bian, Sebastian Bodenstedt, Jon Lindström Bolmgren, Laura Bravo-Sánchez, Hua-Bin Chen, Cristina González, Dong Guo, Pål Halvorsen, Pheng-Ann Heng, Enes Hosgor, Zeng-Guang Hou, Fabian Isensee, Debesh Jha, Tingting Jiang, Yueming Jin, Kadir Kirtac, Sabrina Kletz, Stefan Leger, Zhixuan Li, Klaus H. Maier-Hein, Zhen-Liang Ni, Michael A. Riegler, Klaus Schoeffmann, Ruohua Shi, Stefanie Speidel, Michael Stenzel, Isabell Twick, Gutai Wang, Jiacheng Wang, Liansheng Wang, Lu Wang, Yujie Zhang, Yan-Jie Zhou, Lei Zhu, Manuel Wiesenfarth, Annette Kopp-Schneider, Beat P. Müller-Stich, Lena Maier-Hein"]},"id":{"doi":["10.1016/j.media.2020.101920"],"eki":["1767175701"]},"physDesc":[{"extent":"26 S."}],"recId":"1767175701","origin":[{"dateIssuedDisp":"2021","dateIssuedKey":"2021"}],"person":[{"display":"Roß, Tobias","family":"Roß","role":"aut","given":"Tobias"},{"display":"Reinke, Annika","given":"Annika","role":"aut","family":"Reinke"},{"role":"aut","given":"Peter M.","family":"Full","display":"Full, Peter M."},{"family":"Wagner","given":"Martin","role":"aut","display":"Wagner, Martin"},{"display":"Kenngott, Hannes Götz","family":"Kenngott","role":"aut","given":"Hannes Götz"},{"display":"Apitz, Martin","role":"aut","given":"Martin","family":"Apitz"},{"family":"Hempe","role":"aut","given":"Hellena","display":"Hempe, Hellena"},{"role":"aut","given":"Diana","family":"Mindroc-Filimon","display":"Mindroc-Filimon, Diana"},{"given":"Patrick","role":"aut","family":"Godau","display":"Godau, Patrick"},{"given":"Thuy Nuong","role":"aut","family":"Tran","display":"Tran, Thuy Nuong"},{"display":"Bruno, Pierangela","role":"aut","given":"Pierangela","family":"Bruno"},{"role":"aut","given":"Pablo","family":"Arbeláez","display":"Arbeláez, Pablo"},{"display":"Bian, Gui-Bin","family":"Bian","given":"Gui-Bin","role":"aut"},{"role":"aut","given":"Sebastian","family":"Bodenstedt","display":"Bodenstedt, Sebastian"},{"display":"Bolmgren, Jon Lindström","family":"Bolmgren","given":"Jon Lindström","role":"aut"},{"family":"Bravo-Sánchez","given":"Laura","role":"aut","display":"Bravo-Sánchez, Laura"},{"display":"Chen, Hua-Bin","family":"Chen","role":"aut","given":"Hua-Bin"},{"display":"González, Cristina","family":"González","given":"Cristina","role":"aut"},{"display":"Guo, Dong","family":"Guo","role":"aut","given":"Dong"},{"display":"Halvorsen, Pål","given":"Pål","role":"aut","family":"Halvorsen"},{"given":"Pheng-Ann","role":"aut","family":"Heng","display":"Heng, Pheng-Ann"},{"given":"Enes","role":"aut","family":"Hosgor","display":"Hosgor, Enes"},{"display":"Hou, Zeng-Guang","given":"Zeng-Guang","role":"aut","family":"Hou"},{"display":"Isensee, Fabian","family":"Isensee","given":"Fabian","role":"aut"},{"family":"Jha","given":"Debesh","role":"aut","display":"Jha, Debesh"},{"display":"Jiang, Tingting","family":"Jiang","role":"aut","given":"Tingting"},{"display":"Jin, Yueming","family":"Jin","role":"aut","given":"Yueming"},{"display":"Kirtac, Kadir","role":"aut","given":"Kadir","family":"Kirtac"},{"display":"Kletz, Sabrina","given":"Sabrina","role":"aut","family":"Kletz"},{"given":"Stefan","role":"aut","family":"Leger","display":"Leger, Stefan"},{"given":"Zhixuan","role":"aut","family":"Li","display":"Li, Zhixuan"},{"given":"Klaus H.","role":"aut","family":"Maier-Hein","display":"Maier-Hein, Klaus H."},{"family":"Ni","given":"Zhen-Liang","role":"aut","display":"Ni, Zhen-Liang"},{"family":"Riegler","given":"Michael A.","role":"aut","display":"Riegler, Michael A."},{"role":"aut","given":"Klaus","family":"Schoeffmann","display":"Schoeffmann, Klaus"},{"given":"Ruohua","role":"aut","family":"Shi","display":"Shi, Ruohua"},{"family":"Speidel","role":"aut","given":"Stefanie","display":"Speidel, Stefanie"},{"family":"Stenzel","given":"Michael","role":"aut","display":"Stenzel, Michael"},{"display":"Twick, Isabell","role":"aut","given":"Isabell","family":"Twick"},{"family":"Wang","given":"Gutai","role":"aut","display":"Wang, Gutai"},{"display":"Wang, Jiacheng","family":"Wang","given":"Jiacheng","role":"aut"},{"display":"Wang, Liansheng","family":"Wang","role":"aut","given":"Liansheng"},{"display":"Wang, Lu","family":"Wang","role":"aut","given":"Lu"},{"family":"Zhang","role":"aut","given":"Yujie","display":"Zhang, Yujie"},{"family":"Zhou","role":"aut","given":"Yan-Jie","display":"Zhou, Yan-Jie"},{"family":"Zhu","role":"aut","given":"Lei","display":"Zhu, Lei"},{"given":"Manuel","role":"aut","family":"Wiesenfarth","display":"Wiesenfarth, Manuel"},{"display":"Kopp-Schneider, Annette","role":"aut","given":"Annette","family":"Kopp-Schneider"},{"given":"Beat P.","role":"aut","family":"Müller","display":"Müller, Beat P."},{"display":"Maier-Hein, Lena","family":"Maier-Hein","role":"aut","given":"Lena"}],"relHost":[{"id":{"issn":["1361-8423"],"eki":["306365081"],"zdb":["1497450-2"]},"part":{"pages":"1-26","year":"2021","text":"70(2021), Artikel-ID 101920, Seite 1-26","volume":"70","extent":"26"},"pubHistory":["1.1996/97 -"],"titleAlt":[{"title":"Medical image analysis online"}],"title":[{"title":"Medical image analysis","title_sort":"Medical image analysis"}],"type":{"bibl":"periodical","media":"Online-Ressource"},"language":["eng"],"note":["Gesehen am 16.05.23"],"origin":[{"dateIssuedKey":"1996","publisherPlace":"Amsterdam [u.a.]","dateIssuedDisp":"1996-","publisher":"Elsevier Science"}],"disp":"Comparative validation of multi-instance instrument segmentation in endoscopy results of the ROBUST-MIS 2019 challengeMedical image analysis","recId":"306365081","physDesc":[{"extent":"Online-Ressource"}]}],"type":{"bibl":"article-journal","media":"Online-Ressource"},"language":["eng"],"note":["Available online 28 November 2020","Gesehen am 17.08.2021"],"title":[{"title":"Comparative validation of multi-instance instrument segmentation in endoscopy","title_sort":"Comparative validation of multi-instance instrument segmentation in endoscopy","subtitle":"results of the ROBUST-MIS 2019 challenge"}]} 
SRT |a ROSSTOBIASCOMPARATIV2021