Cover Image

CholecTriplet2022: show me a tool and tell me the triplet - an endoscopic vision challenge for surgical action triplet detection

Formalizing surgical activities as triplets of the used instruments, actions performed, and target anatomies is becoming a gold standard approach for surgical activity modeling. The benefit is that this formalization helps to obtain a more detailed understanding of tool-tissue interaction which can...

Full description

Saved in:
Bibliographic Details
Main Authors: Nwoye, Chinedu (Author) , Yu, Tong (Author) , Sharma, Saurav (Author) , Murali, Aditya (Author) , Alapatt, Deepak (Author) , Vardazaryan, Armine (Author) , Yuan, Kun (Author) , Hajek, Jonas (Author) , Reiter, Wolfgang (Author) , Yamlahi, Amine (Author) , Smidt, Finn-Henri (Author) , Zou, Xiaoyang (Author) , Zheng, Guoyan (Author) , Oliveira, Bruno (Author) , Torres, Helena R. (Author) , Kondo, Satoshi (Author) , Kasai, Satoshi (Author) , Holm, Felix (Author) , Özsoy, Ege (Author) , Gui, Shuangchun (Author) , Li, Han (Author) , Raviteja, Sista (Author) , Sathish, Rachana (Author) , Poudel, Pranav (Author) , Bhattarai, Binod (Author) , Wang, Ziheng (Author) , Rui, Guo (Author) , Schellenberg, Melanie (Author) , Vilaça, João L. (Author) , Czempiel, Tobias (Author) , Wang, Zhenkun (Author) , Sheet, Debdoot (Author) , Thapa, Shrawan Kumar (Author) , Berniker, Max (Author) , Godau, Patrick (Author) , Morais, Pedro (Author) , Regmi, Sudarshan (Author) , Tran, Thuy (Author) , Fonseca, Jaime (Author) , Nölke, Jan-Hinrich (Author) , Lima, Estevão (Author) , Vazquez, Eduard (Author) , Maier-Hein, Lena (Author) , Navab, Nassir (Author) , Mascagni, Pietro (Author) , Seeliger, Barbara (Author) , Gonzalez, Cristians (Author) , Mutter, Didier (Author) , Padoy, Nicolas (Author)
Format: Article (Journal)
Language:English
Published: 4 July 2023
In: Medical image analysis
Year: 2023, Volume: 89
ISSN:1361-8423
DOI:10.1016/j.media.2023.102888
Online Access:Verlag, kostenfrei, Volltext: https://doi.org/10.1016/j.media.2023.102888
Verlag, kostenfrei, Volltext: https://www.sciencedirect.com/science/article/pii/S1361841523001482
Get full text
Author Notes:Chinedu Innocent Nwoye, Tong Yu, Saurav Sharma, Aditya Murali, Deepak Alapatt, Armine Vardazaryan, Kun Yuan, Jonas Hajek, Wolfgang Reiter, Amine Yamlahi, Finn-Henri Smidt, Xiaoyang Zou, Guoyan Zheng, Bruno Oliveira, Helena R. Torres, Satoshi Kondo, Satoshi Kasai, Felix Holm, Ege Özsoy, Shuangchun Gui, Han Li, Sista Raviteja, Rachana Sathish, Pranav Poudel, Binod Bhattarai, Ziheng Wang, Guo Rui, Melanie Schellenberg, João L. Vilaça, Tobias Czempiel, Zhenkun Wang, Debdoot Sheet, Shrawan Kumar Thapa, Max Berniker, Patrick Godau, Pedro Morais, Sudarshan Regmi, Thuy Nuong Tran, Jaime Fonseca, Jan-Hinrich Nölke, Estevão Lima, Eduard Vazquez, Lena Maier-Hein, Nassir Navab, Pietro Mascagni, Barbara Seeliger, Cristians Gonzalez, Didier Mutter, Nicolas Padoy

MARC

LEADER 00000caa a2200000 c 4500
001 1892346877
003 DE-627
005 20250901170948.0
007 cr uuu---uuuuu
008 240627s2023 xx |||||o 00| ||eng c
024 7 |a 10.1016/j.media.2023.102888  |2 doi 
035 |a (DE-627)1892346877 
035 |a (DE-599)KXP1892346877 
035 |a (OCoLC)1475300982 
040 |a DE-627  |b ger  |c DE-627  |e rda 
041 |a eng 
084 |a 33  |2 sdnb 
100 1 |a Nwoye, Chinedu  |e VerfasserIn  |0 (DE-588)1334225745  |0 (DE-627)1892347490  |4 aut 
245 1 0 |a CholecTriplet2022  |b show me a tool and tell me the triplet - an endoscopic vision challenge for surgical action triplet detection  |c Chinedu Innocent Nwoye, Tong Yu, Saurav Sharma, Aditya Murali, Deepak Alapatt, Armine Vardazaryan, Kun Yuan, Jonas Hajek, Wolfgang Reiter, Amine Yamlahi, Finn-Henri Smidt, Xiaoyang Zou, Guoyan Zheng, Bruno Oliveira, Helena R. Torres, Satoshi Kondo, Satoshi Kasai, Felix Holm, Ege Özsoy, Shuangchun Gui, Han Li, Sista Raviteja, Rachana Sathish, Pranav Poudel, Binod Bhattarai, Ziheng Wang, Guo Rui, Melanie Schellenberg, João L. Vilaça, Tobias Czempiel, Zhenkun Wang, Debdoot Sheet, Shrawan Kumar Thapa, Max Berniker, Patrick Godau, Pedro Morais, Sudarshan Regmi, Thuy Nuong Tran, Jaime Fonseca, Jan-Hinrich Nölke, Estevão Lima, Eduard Vazquez, Lena Maier-Hein, Nassir Navab, Pietro Mascagni, Barbara Seeliger, Cristians Gonzalez, Didier Mutter, Nicolas Padoy 
264 1 |c 4 July 2023 
300 |a 1-21$p21 
336 |a Text  |b txt  |2 rdacontent 
337 |a Computermedien  |b c  |2 rdamedia 
338 |a Online-Ressource  |b cr  |2 rdacarrier 
500 |a Gesehen am 27.06.2024 
520 |a Formalizing surgical activities as triplets of the used instruments, actions performed, and target anatomies is becoming a gold standard approach for surgical activity modeling. The benefit is that this formalization helps to obtain a more detailed understanding of tool-tissue interaction which can be used to develop better Artificial Intelligence assistance for image-guided surgery. Earlier efforts and the CholecTriplet challenge introduced in 2021 have put together techniques aimed at recognizing these triplets from surgical footage. Estimating also the spatial locations of the triplets would offer a more precise intraoperative context-aware decision support for computer-assisted intervention. This paper presents the CholecTriplet2022 challenge, which extends surgical action triplet modeling from recognition to detection. It includes weakly-supervised bounding box localization of every visible surgical instrument (or tool), as the key actors, and the modeling of each tool-activity in the form of ‹instrument, verb, target› triplet. The paper describes a baseline method and 10 new deep learning algorithms presented at the challenge to solve the task. It also provides thorough methodological comparisons of the methods, an in-depth analysis of the obtained results across multiple metrics, visual and procedural challenges; their significance, and useful insights for future research directions and applications in surgery. 
650 4 |a Action detection 
650 4 |a CholecT50 
650 4 |a Computer-assisted surgery 
650 4 |a Fine-grained activity recognition 
650 4 |a Surgical action triplet 
650 4 |a Tool localization 
650 4 |a Weak supervision 
700 1 |a Yu, Tong  |e VerfasserIn  |4 aut 
700 1 |a Sharma, Saurav  |e VerfasserIn  |4 aut 
700 1 |a Murali, Aditya  |e VerfasserIn  |4 aut 
700 1 |a Alapatt, Deepak  |e VerfasserIn  |4 aut 
700 1 |a Vardazaryan, Armine  |e VerfasserIn  |4 aut 
700 1 |a Yuan, Kun  |e VerfasserIn  |4 aut 
700 1 |a Hajek, Jonas  |e VerfasserIn  |4 aut 
700 1 |a Reiter, Wolfgang  |e VerfasserIn  |4 aut 
700 1 |a Yamlahi, Amine  |e VerfasserIn  |4 aut 
700 1 |a Smidt, Finn-Henri  |e VerfasserIn  |4 aut 
700 1 |a Zou, Xiaoyang  |e VerfasserIn  |4 aut 
700 1 |a Zheng, Guoyan  |e VerfasserIn  |4 aut 
700 1 |a Oliveira, Bruno  |e VerfasserIn  |4 aut 
700 1 |a Torres, Helena R.  |e VerfasserIn  |4 aut 
700 1 |a Kondo, Satoshi  |e VerfasserIn  |4 aut 
700 1 |a Kasai, Satoshi  |e VerfasserIn  |4 aut 
700 1 |a Holm, Felix  |e VerfasserIn  |4 aut 
700 1 |a Özsoy, Ege  |e VerfasserIn  |4 aut 
700 1 |a Gui, Shuangchun  |e VerfasserIn  |4 aut 
700 1 |a Li, Han  |e VerfasserIn  |4 aut 
700 1 |a Raviteja, Sista  |e VerfasserIn  |4 aut 
700 1 |a Sathish, Rachana  |e VerfasserIn  |4 aut 
700 1 |a Poudel, Pranav  |e VerfasserIn  |4 aut 
700 1 |a Bhattarai, Binod  |e VerfasserIn  |4 aut 
700 1 |a Wang, Ziheng  |e VerfasserIn  |4 aut 
700 1 |a Rui, Guo  |e VerfasserIn  |4 aut 
700 1 |a Schellenberg, Melanie  |d 1994-  |e VerfasserIn  |0 (DE-588)1237779464  |0 (DE-627)176477745X  |4 aut 
700 1 |a Vilaça, João L.  |e VerfasserIn  |4 aut 
700 1 |a Czempiel, Tobias  |e VerfasserIn  |4 aut 
700 1 |a Wang, Zhenkun  |e VerfasserIn  |4 aut 
700 1 |a Sheet, Debdoot  |e VerfasserIn  |4 aut 
700 1 |a Thapa, Shrawan Kumar  |e VerfasserIn  |4 aut 
700 1 |a Berniker, Max  |e VerfasserIn  |4 aut 
700 1 |a Godau, Patrick  |d 1993-  |e VerfasserIn  |0 (DE-588)1179282515  |0 (DE-627)1066788200  |0 (DE-576)518174212  |4 aut 
700 1 |a Morais, Pedro  |e VerfasserIn  |4 aut 
700 1 |a Regmi, Sudarshan  |e VerfasserIn  |4 aut 
700 1 |a Tran, Thuy  |e VerfasserIn  |0 (DE-588)1293398039  |0 (DE-627)1850720029  |4 aut 
700 1 |a Fonseca, Jaime  |e VerfasserIn  |4 aut 
700 1 |a Nölke, Jan-Hinrich  |e VerfasserIn  |0 (DE-588)1197270973  |0 (DE-627)1679066692  |4 aut 
700 1 |a Lima, Estevão  |e VerfasserIn  |4 aut 
700 1 |a Vazquez, Eduard  |e VerfasserIn  |4 aut 
700 1 |a Maier-Hein, Lena  |d 1980-  |e VerfasserIn  |0 (DE-588)1075029252  |0 (DE-627)832869899  |0 (DE-576)190090804  |4 aut 
700 1 |a Navab, Nassir  |e VerfasserIn  |4 aut 
700 1 |a Mascagni, Pietro  |e VerfasserIn  |4 aut 
700 1 |a Seeliger, Barbara  |d 1981-  |e VerfasserIn  |0 (DE-588)13909024X  |0 (DE-627)608114006  |0 (DE-576)310211743  |4 aut 
700 1 |a Gonzalez, Cristians  |e VerfasserIn  |4 aut 
700 1 |a Mutter, Didier  |e VerfasserIn  |4 aut 
700 1 |a Padoy, Nicolas  |e VerfasserIn  |4 aut 
773 0 8 |i Enthalten in  |t Medical image analysis  |d Amsterdam [u.a.] : Elsevier Science, 1996  |g 89(2023) vom: Okt., Artikel-ID 102888  |h Online-Ressource  |w (DE-627)306365081  |w (DE-600)1497450-2  |w (DE-576)091204941  |x 1361-8423  |7 nnas  |a CholecTriplet2022 show me a tool and tell me the triplet - an endoscopic vision challenge for surgical action triplet detection 
773 1 8 |g volume:89  |g year:2023  |g month:10  |g elocationid:102888  |g extent:1-21$p21  |a CholecTriplet2022 show me a tool and tell me the triplet - an endoscopic vision challenge for surgical action triplet detection 
856 4 0 |u https://doi.org/10.1016/j.media.2023.102888  |x Verlag  |x Resolving-System  |z kostenfrei  |3 Volltext 
856 4 0 |u https://www.sciencedirect.com/science/article/pii/S1361841523001482  |x Verlag  |z kostenfrei  |3 Volltext 
951 |a AR 
992 |a 20240627 
993 |a Article 
994 |a 2023 
998 |g 1075029252  |a Maier-Hein, Lena  |m 1075029252:Maier-Hein, Lena  |d 110000  |e 110000PM1075029252  |k 0/110000/  |p 43 
998 |g 1197270973  |a Nölke, Jan-Hinrich  |m 1197270973:Nölke, Jan-Hinrich  |d 130000  |e 130000PN1197270973  |k 0/130000/  |p 40 
998 |g 1293398039  |a Tran, Thuy  |m 1293398039:Tran, Thuy  |d 110000  |e 110000PT1293398039  |k 0/110000/  |p 38 
998 |g 1179282515  |a Godau, Patrick  |m 1179282515:Godau, Patrick  |d 110000  |e 110000PG1179282515  |k 0/110000/  |p 35 
998 |g 1237779464  |a Schellenberg, Melanie  |m 1237779464:Schellenberg, Melanie  |p 28 
999 |a KXP-PPN1892346877  |e 4542563731 
BIB |a Y 
SER |a journal 
JSO |a {"title":[{"title":"CholecTriplet2022","title_sort":"CholecTriplet2022","subtitle":"show me a tool and tell me the triplet - an endoscopic vision challenge for surgical action triplet detection"}],"language":["eng"],"name":{"displayForm":["Chinedu Innocent Nwoye, Tong Yu, Saurav Sharma, Aditya Murali, Deepak Alapatt, Armine Vardazaryan, Kun Yuan, Jonas Hajek, Wolfgang Reiter, Amine Yamlahi, Finn-Henri Smidt, Xiaoyang Zou, Guoyan Zheng, Bruno Oliveira, Helena R. Torres, Satoshi Kondo, Satoshi Kasai, Felix Holm, Ege Özsoy, Shuangchun Gui, Han Li, Sista Raviteja, Rachana Sathish, Pranav Poudel, Binod Bhattarai, Ziheng Wang, Guo Rui, Melanie Schellenberg, João L. Vilaça, Tobias Czempiel, Zhenkun Wang, Debdoot Sheet, Shrawan Kumar Thapa, Max Berniker, Patrick Godau, Pedro Morais, Sudarshan Regmi, Thuy Nuong Tran, Jaime Fonseca, Jan-Hinrich Nölke, Estevão Lima, Eduard Vazquez, Lena Maier-Hein, Nassir Navab, Pietro Mascagni, Barbara Seeliger, Cristians Gonzalez, Didier Mutter, Nicolas Padoy"]},"origin":[{"dateIssuedDisp":"4 July 2023","dateIssuedKey":"2023"}],"recId":"1892346877","person":[{"family":"Nwoye","display":"Nwoye, Chinedu","given":"Chinedu","role":"aut"},{"role":"aut","family":"Yu","given":"Tong","display":"Yu, Tong"},{"family":"Sharma","given":"Saurav","display":"Sharma, Saurav","role":"aut"},{"display":"Murali, Aditya","given":"Aditya","family":"Murali","role":"aut"},{"family":"Alapatt","display":"Alapatt, Deepak","given":"Deepak","role":"aut"},{"role":"aut","family":"Vardazaryan","given":"Armine","display":"Vardazaryan, Armine"},{"role":"aut","family":"Yuan","display":"Yuan, Kun","given":"Kun"},{"role":"aut","family":"Hajek","display":"Hajek, Jonas","given":"Jonas"},{"display":"Reiter, Wolfgang","given":"Wolfgang","family":"Reiter","role":"aut"},{"role":"aut","family":"Yamlahi","given":"Amine","display":"Yamlahi, Amine"},{"role":"aut","family":"Smidt","given":"Finn-Henri","display":"Smidt, Finn-Henri"},{"display":"Zou, Xiaoyang","given":"Xiaoyang","family":"Zou","role":"aut"},{"family":"Zheng","display":"Zheng, Guoyan","given":"Guoyan","role":"aut"},{"family":"Oliveira","given":"Bruno","display":"Oliveira, Bruno","role":"aut"},{"family":"Torres","given":"Helena R.","display":"Torres, Helena R.","role":"aut"},{"display":"Kondo, Satoshi","given":"Satoshi","family":"Kondo","role":"aut"},{"given":"Satoshi","display":"Kasai, Satoshi","family":"Kasai","role":"aut"},{"family":"Holm","given":"Felix","display":"Holm, Felix","role":"aut"},{"given":"Ege","display":"Özsoy, Ege","family":"Özsoy","role":"aut"},{"family":"Gui","display":"Gui, Shuangchun","given":"Shuangchun","role":"aut"},{"family":"Li","given":"Han","display":"Li, Han","role":"aut"},{"family":"Raviteja","given":"Sista","display":"Raviteja, Sista","role":"aut"},{"family":"Sathish","display":"Sathish, Rachana","given":"Rachana","role":"aut"},{"family":"Poudel","given":"Pranav","display":"Poudel, Pranav","role":"aut"},{"role":"aut","given":"Binod","display":"Bhattarai, Binod","family":"Bhattarai"},{"role":"aut","display":"Wang, Ziheng","given":"Ziheng","family":"Wang"},{"role":"aut","display":"Rui, Guo","given":"Guo","family":"Rui"},{"family":"Schellenberg","display":"Schellenberg, Melanie","given":"Melanie","role":"aut"},{"role":"aut","display":"Vilaça, João L.","given":"João L.","family":"Vilaça"},{"role":"aut","display":"Czempiel, Tobias","given":"Tobias","family":"Czempiel"},{"family":"Wang","display":"Wang, Zhenkun","given":"Zhenkun","role":"aut"},{"family":"Sheet","given":"Debdoot","display":"Sheet, Debdoot","role":"aut"},{"display":"Thapa, Shrawan Kumar","given":"Shrawan Kumar","family":"Thapa","role":"aut"},{"given":"Max","display":"Berniker, Max","family":"Berniker","role":"aut"},{"family":"Godau","given":"Patrick","display":"Godau, Patrick","role":"aut"},{"role":"aut","family":"Morais","display":"Morais, Pedro","given":"Pedro"},{"role":"aut","given":"Sudarshan","display":"Regmi, Sudarshan","family":"Regmi"},{"family":"Tran","display":"Tran, Thuy","given":"Thuy","role":"aut"},{"role":"aut","display":"Fonseca, Jaime","given":"Jaime","family":"Fonseca"},{"role":"aut","given":"Jan-Hinrich","display":"Nölke, Jan-Hinrich","family":"Nölke"},{"role":"aut","given":"Estevão","display":"Lima, Estevão","family":"Lima"},{"role":"aut","family":"Vazquez","given":"Eduard","display":"Vazquez, Eduard"},{"role":"aut","family":"Maier-Hein","given":"Lena","display":"Maier-Hein, Lena"},{"given":"Nassir","display":"Navab, Nassir","family":"Navab","role":"aut"},{"given":"Pietro","display":"Mascagni, Pietro","family":"Mascagni","role":"aut"},{"role":"aut","given":"Barbara","display":"Seeliger, Barbara","family":"Seeliger"},{"family":"Gonzalez","display":"Gonzalez, Cristians","given":"Cristians","role":"aut"},{"display":"Mutter, Didier","given":"Didier","family":"Mutter","role":"aut"},{"family":"Padoy","display":"Padoy, Nicolas","given":"Nicolas","role":"aut"}],"note":["Gesehen am 27.06.2024"],"relHost":[{"pubHistory":["1.1996/97 -"],"type":{"media":"Online-Ressource","bibl":"periodical"},"recId":"306365081","disp":"CholecTriplet2022 show me a tool and tell me the triplet - an endoscopic vision challenge for surgical action triplet detectionMedical image analysis","language":["eng"],"titleAlt":[{"title":"Medical image analysis online"}],"physDesc":[{"extent":"Online-Ressource"}],"id":{"eki":["306365081"],"issn":["1361-8423"],"zdb":["1497450-2"]},"part":{"volume":"89","text":"89(2023) vom: Okt., Artikel-ID 102888","year":"2023","extent":"1-21$p21"},"note":["Gesehen am 16.05.23"],"origin":[{"publisher":"Elsevier Science","dateIssuedDisp":"1996-","dateIssuedKey":"1996","publisherPlace":"Amsterdam [u.a.]"}],"title":[{"title":"Medical image analysis","title_sort":"Medical image analysis"}]}],"id":{"doi":["10.1016/j.media.2023.102888"],"eki":["1892346877"]},"type":{"bibl":"article-journal","media":"Online-Ressource"},"physDesc":[{"extent":"1-21$p21 S."}]} 
SRT |a NWOYECHINECHOLECTRIP4202 

Similar Items