Why rankings of biomedical image analysis competitions should be interpreted with care
Biomedical image analysis challenges have increased in the last ten years, but common practices have not been established yet. Here the authors analyze 150 recent challenges and demonstrate that outcome varies based on the metrics used and that limited information reporting hampers reproducibility.
Gespeichert in:
| Hauptverfasser: | , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , |
|---|---|
| Dokumenttyp: | Article (Journal) |
| Sprache: | Englisch |
| Veröffentlicht: |
06 December 2018
|
| In: |
Nature Communications
Year: 2018, Jahrgang: 9, Pages: 5217 |
| ISSN: | 2041-1723 |
| DOI: | 10.1038/s41467-018-07619-7 |
| Online-Zugang: | Verlag, Volltext: http://dx.doi.org/10.1038/s41467-018-07619-7 Verlag, Volltext: https://www.nature.com/articles/s41467-018-07619-7 
|
| Verfasserangaben: | Lena Maier-Hein et al.# |
MARC
| LEADER | 00000caa a2200000 c 4500 | ||
|---|---|---|---|
| 001 | 1048777278 | ||
| 003 | DE-627 | ||
| 005 | 20241106204602.0 | ||
| 007 | cr uuu---uuuuu | ||
| 008 | 190208s2018 xx |||||o 00| ||eng c | ||
| 024 | 7 | |a 10.1038/s41467-018-07619-7 |2 doi | |
| 035 | |a (DE-627)1048777278 | ||
| 035 | |a (DE-599)GBV1048777278 | ||
| 035 | |a (OCoLC)1340371065 | ||
| 040 | |a DE-627 |b ger |c DE-627 |e rda | ||
| 041 | |a eng | ||
| 084 | |a 33 |2 sdnb | ||
| 100 | 1 | |a Maier-Hein, Lena |d 1980- |e VerfasserIn |0 (DE-588)1075029252 |0 (DE-627)832869899 |0 (DE-576)190090804 |4 aut | |
| 245 | 1 | 0 | |a Why rankings of biomedical image analysis competitions should be interpreted with care |c Lena Maier-Hein et al.# |
| 264 | 1 | |c 06 December 2018 | |
| 300 | |b Illustrationen | ||
| 300 | |a 13 | ||
| 336 | |a Text |b txt |2 rdacontent | ||
| 337 | |a Computermedien |b c |2 rdamedia | ||
| 338 | |a Online-Ressource |b cr |2 rdacarrier | ||
| 500 | |a #Lena Maier-Henn, Matthias Eisenmann, Annika Reinke, Sinan Onogur, Marko Stankovic, Patrick Scholz, Tal Arbel, Hrvoje Bogunovic, Andrew P. Bradley, Aaron Carass, Carolin Feldmann, Alejandro F. Frangi, Peter M. Full, Bram van Ginneken, Allan Hanbury, Katrin Honauer, Michal Kozubek, Bennett A. Landman, Keno März, Oskar Maier, Klaus Maier-Hein, Bjoern H. Menze, Henning Müller, Peter F. Neher, Wiro Niessen, Nasir Rajpoot, Gregory C. Sharp, Korsuk Sirinukunwattana, Stefanie Speidel, Christian Stock, Danail Stoyanov, Abdel Aziz Taha, Fons van der Sommen, Ching-Wei Wang, Marc-André Weber, Guoyan Zheng, Pierre Jannin & Annette Kopp-Schneider | ||
| 500 | |a Gesehen am 27.02.2019 | ||
| 520 | |a Biomedical image analysis challenges have increased in the last ten years, but common practices have not been established yet. Here the authors analyze 150 recent challenges and demonstrate that outcome varies based on the metrics used and that limited information reporting hampers reproducibility. | ||
| 700 | 1 | |a Eisenmann, Matthias |e VerfasserIn |0 (DE-588)1219684139 |0 (DE-627)1735661740 |4 aut | |
| 700 | 1 | |a Reinke, Annika |d 1993- |e VerfasserIn |0 (DE-588)1219684252 |0 (DE-627)1735662143 |4 aut | |
| 700 | 1 | |a Onogur, Sinan |e VerfasserIn |4 aut | |
| 700 | 1 | |a Stankovic, Marko |e VerfasserIn |4 aut | |
| 700 | 1 | |a Godau, Patrick |d 1993- |e VerfasserIn |0 (DE-588)1179282515 |0 (DE-627)1066788200 |0 (DE-576)518174212 |4 aut | |
| 700 | 1 | |a Arbel, Tal |e VerfasserIn |4 aut | |
| 700 | 1 | |a Hrvoje, Bogunovic |e VerfasserIn |4 aut | |
| 700 | 1 | |a Bradley, Andrew P. |e VerfasserIn |4 aut | |
| 700 | 1 | |a Carass, Aaron |e VerfasserIn |4 aut | |
| 700 | 1 | |a Feldmann, Carolin |e VerfasserIn |0 (DE-588)1219695688 |0 (DE-627)1735698210 |4 aut | |
| 700 | 1 | |a Frangi, Alejandro F. |e VerfasserIn |4 aut | |
| 700 | 1 | |8 1\p |a Full, Peter M. |e VerfasserIn |0 (DE-588)1219695777 |0 (DE-627)1735698784 |4 aut | |
| 700 | 1 | |a van Ginneken, Bram |e VerfasserIn |4 aut | |
| 700 | 1 | |a Hanbury, Allan |d 1974- |e VerfasserIn |0 (DE-588)136248225 |0 (DE-627)578125943 |0 (DE-576)30091993X |4 aut | |
| 700 | 1 | |a Honauer, Katrin |d 1989- |e VerfasserIn |0 (DE-588)117835380X |0 (DE-627)1049300696 |0 (DE-576)517740923 |4 aut | |
| 700 | 1 | |a Kozubek, Michal |e VerfasserIn |4 aut | |
| 700 | 1 | |a Landman, Bennett A. |e VerfasserIn |4 aut | |
| 700 | 1 | |a März, Keno |e VerfasserIn |0 (DE-588)1076753175 |0 (DE-627)835290840 |0 (DE-576)445630914 |4 aut | |
| 700 | 1 | |a Maier, Oskar |e VerfasserIn |4 aut | |
| 700 | 1 | |a Maier-Hein, Klaus H. |d 1980- |e VerfasserIn |0 (DE-588)1100551875 |0 (DE-627)85946461X |0 (DE-576)333771222 |4 aut | |
| 700 | 1 | |a Menze, Bjoern |e VerfasserIn |0 (DE-588)133358690 |0 (DE-627)54365902X |0 (DE-576)299794148 |4 aut | |
| 700 | 1 | |a Müller, Henning |e VerfasserIn |0 (DE-588)1152241745 |0 (DE-627)1013728742 |0 (DE-576)499761561 |4 aut | |
| 700 | 1 | |a Neher, Peter |d 1984- |e VerfasserIn |0 (DE-588)1052246052 |0 (DE-627)788077287 |0 (DE-576)408004746 |4 aut | |
| 700 | 1 | |a Niessen, Wiro |e VerfasserIn |4 aut | |
| 700 | 1 | |a Rajppot, Nasir |e VerfasserIn |4 aut | |
| 700 | 1 | |a Sharp, Gregory C. |e VerfasserIn |4 aut | |
| 700 | 1 | |a Sirinukunwattana, Korsuk |e VerfasserIn |4 aut | |
| 700 | 1 | |a Speidel, Stafanie |e VerfasserIn |4 aut | |
| 700 | 1 | |a Stock, Christian |d 1978- |e VerfasserIn |0 (DE-588)123325218 |0 (DE-627)706256530 |0 (DE-576)29365624X |4 aut | |
| 700 | 1 | |a Stoyanov, Danail |e VerfasserIn |0 (DE-588)1067674721 |0 (DE-627)819071110 |0 (DE-576)426835034 |4 aut | |
| 700 | 1 | |8 2\p |a Taha, Abdel Aziz |e VerfasserIn |0 (DE-588)1277077436 |0 (DE-627)1830217623 |4 aut | |
| 700 | 1 | |a van der Sommen, Fons |e VerfasserIn |4 aut | |
| 700 | 1 | |a Wang, Ching-Wei |e VerfasserIn |4 aut | |
| 700 | 1 | |a Weber, Marc-André |d 1973- |e VerfasserIn |0 (DE-588)142373044 |0 (DE-627)704211432 |0 (DE-576)330376802 |4 aut | |
| 700 | 1 | |a Zheng, Guoyan |e VerfasserIn |0 (DE-588)1156348668 |0 (DE-627)1019131640 |0 (DE-576)50212525X |4 aut | |
| 700 | 1 | |a Jannin, Pierre |e VerfasserIn |4 aut | |
| 700 | 1 | |a Kopp-Schneider, Annette |e VerfasserIn |0 (DE-588)1119160545 |0 (DE-627)872460444 |0 (DE-576)178153206 |4 aut | |
| 773 | 0 | 8 | |i Enthalten in |t Nature Communications |d [London] : Springer Nature, 2010 |g 9(2018) Artikel-Nummer 5217, 13 Seiten |h Online-Ressource |w (DE-627)626457688 |w (DE-600)2553671-0 |w (DE-576)331555905 |x 2041-1723 |7 nnas |a Why rankings of biomedical image analysis competitions should be interpreted with care |
| 773 | 1 | 8 | |g volume:9 |g year:2018 |g pages:5217 |g extent:13 |a Why rankings of biomedical image analysis competitions should be interpreted with care |
| 787 | 0 | 8 | |i Errata |a Maier-Hein, Lena, 1980 - |t Author correction: Why rankings of biomedical image analysis competitions should be interpreted with care |d 2019 |w (DE-627)1587950871 |w (DE-576)517950871 |
| 856 | 4 | 0 | |u http://dx.doi.org/10.1038/s41467-018-07619-7 |x Verlag |x Resolving-System |3 Volltext |
| 856 | 4 | 0 | |u https://www.nature.com/articles/s41467-018-07619-7 |x Verlag |3 Volltext |
| 883 | |8 1\p |a cgwrk |d 20241001 |q DE-101 |u https://d-nb.info/provenance/plan#cgwrk | ||
| 883 | |8 2\p |a cgwrk |d 20241001 |q DE-101 |u https://d-nb.info/provenance/plan#cgwrk | ||
| 951 | |a AR | ||
| 992 | |a 20201027 | ||
| 993 | |a Article | ||
| 994 | |a 2018 | ||
| 998 | |g 1119160545 |a Kopp-Schneider, Annette |m 1119160545:Kopp-Schneider, Annette |d 50000 |e 50000PK1119160545 |k 0/50000/ |p 32 | ||
| 998 | |g 123325218 |a Stock, Christian |m 123325218:Stock, Christian |d 50000 |e 50000PS123325218 |k 0/50000/ |p 30 | ||
| 998 | |g 1100551875 |a Maier-Hein, Klaus H. |m 1100551875:Maier-Hein, Klaus H. |d 910000 |d 911400 |d 50000 |e 910000PM1100551875 |e 911400PM1100551875 |e 50000PM1100551875 |k 0/910000/ |k 1/910000/911400/ |k 0/50000/ |p 21 | ||
| 998 | |g 117835380X |a Honauer, Katrin |m 117835380X:Honauer, Katrin |d 700000 |d 708070 |e 700000PH117835380X |e 708070PH117835380X |k 0/700000/ |k 1/700000/708070/ |p 16 | ||
| 998 | |g 1219695777 |a Full, Peter M. |m 1219695777:Full, Peter M. |d 50000 |e 50000PF1219695777 |k 0/50000/ |p 13 | ||
| 998 | |g 1179282515 |a Godau, Patrick |m 1179282515:Godau, Patrick |d 110000 |e 110000PG1179282515 |k 0/110000/ |p 6 | ||
| 998 | |g 1219684252 |a Reinke, Annika |m 1219684252:Reinke, Annika |d 110000 |e 110000PR1219684252 |k 0/110000/ |p 3 | ||
| 998 | |g 1219684139 |a Eisenmann, Matthias |m 1219684139:Eisenmann, Matthias |d 50000 |e 50000PE1219684139 |k 0/50000/ |p 2 | ||
| 998 | |g 1075029252 |a Maier-Hein, Lena |m 1075029252:Maier-Hein, Lena |d 50000 |e 50000PM1075029252 |k 0/50000/ |p 1 |x j | ||
| 999 | |a KXP-PPN1048777278 |e 3786681155 | ||
| BIB | |a Y | ||
| SER | |a journal | ||
| JSO | |a {"name":{"displayForm":["Lena Maier-Hein et al.#"]},"note":["#Lena Maier-Henn, Matthias Eisenmann, Annika Reinke, Sinan Onogur, Marko Stankovic, Patrick Scholz, Tal Arbel, Hrvoje Bogunovic, Andrew P. Bradley, Aaron Carass, Carolin Feldmann, Alejandro F. Frangi, Peter M. Full, Bram van Ginneken, Allan Hanbury, Katrin Honauer, Michal Kozubek, Bennett A. Landman, Keno März, Oskar Maier, Klaus Maier-Hein, Bjoern H. Menze, Henning Müller, Peter F. Neher, Wiro Niessen, Nasir Rajpoot, Gregory C. Sharp, Korsuk Sirinukunwattana, Stefanie Speidel, Christian Stock, Danail Stoyanov, Abdel Aziz Taha, Fons van der Sommen, Ching-Wei Wang, Marc-André Weber, Guoyan Zheng, Pierre Jannin & Annette Kopp-Schneider","Gesehen am 27.02.2019"],"physDesc":[{"noteIll":"Illustrationen","extent":"13 S."}],"language":["eng"],"title":[{"title":"Why rankings of biomedical image analysis competitions should be interpreted with care","title_sort":"Why rankings of biomedical image analysis competitions should be interpreted with care"}],"relHost":[{"note":["Gesehen am 13.06.24"],"language":["eng"],"physDesc":[{"extent":"Online-Ressource"}],"title":[{"title":"Nature Communications","title_sort":"Nature Communications"}],"origin":[{"dateIssuedDisp":"[2010]-","publisherPlace":"[London] ; [London]","publisher":"Springer Nature ; Nature Publishing Group UK"}],"id":{"issn":["2041-1723"],"eki":["626457688"],"zdb":["2553671-0"]},"pubHistory":["2010-"],"disp":"Why rankings of biomedical image analysis competitions should be interpreted with careNature Communications","part":{"pages":"5217","volume":"9","year":"2018","extent":"13","text":"9(2018) Artikel-Nummer 5217, 13 Seiten"},"recId":"626457688","type":{"media":"Online-Ressource","bibl":"periodical"}}],"type":{"bibl":"article-journal","media":"Online-Ressource"},"person":[{"given":"Lena","role":"aut","display":"Maier-Hein, Lena","family":"Maier-Hein"},{"family":"Eisenmann","display":"Eisenmann, Matthias","role":"aut","given":"Matthias"},{"given":"Annika","display":"Reinke, Annika","family":"Reinke","role":"aut"},{"given":"Sinan","role":"aut","family":"Onogur","display":"Onogur, Sinan"},{"role":"aut","display":"Stankovic, Marko","family":"Stankovic","given":"Marko"},{"role":"aut","family":"Godau","display":"Godau, Patrick","given":"Patrick"},{"display":"Arbel, Tal","family":"Arbel","role":"aut","given":"Tal"},{"role":"aut","display":"Hrvoje, Bogunovic","family":"Hrvoje","given":"Bogunovic"},{"given":"Andrew P.","display":"Bradley, Andrew P.","family":"Bradley","role":"aut"},{"role":"aut","display":"Carass, Aaron","family":"Carass","given":"Aaron"},{"display":"Feldmann, Carolin","family":"Feldmann","role":"aut","given":"Carolin"},{"role":"aut","family":"Frangi","display":"Frangi, Alejandro F.","given":"Alejandro F."},{"display":"Full, Peter M.","family":"Full","role":"aut","given":"Peter M."},{"role":"aut","family":"van Ginneken","display":"van Ginneken, Bram","given":"Bram"},{"role":"aut","display":"Hanbury, Allan","family":"Hanbury","given":"Allan"},{"given":"Katrin","display":"Honauer, Katrin","family":"Honauer","role":"aut"},{"given":"Michal","role":"aut","family":"Kozubek","display":"Kozubek, Michal"},{"given":"Bennett A.","role":"aut","family":"Landman","display":"Landman, Bennett A."},{"role":"aut","family":"März","display":"März, Keno","given":"Keno"},{"family":"Maier","display":"Maier, Oskar","role":"aut","given":"Oskar"},{"display":"Maier-Hein, Klaus H.","family":"Maier-Hein","role":"aut","given":"Klaus H."},{"given":"Bjoern","display":"Menze, Bjoern","family":"Menze","role":"aut"},{"display":"Müller, Henning","family":"Müller","role":"aut","given":"Henning"},{"role":"aut","family":"Neher","display":"Neher, Peter","given":"Peter"},{"given":"Wiro","display":"Niessen, Wiro","family":"Niessen","role":"aut"},{"given":"Nasir","role":"aut","family":"Rajppot","display":"Rajppot, Nasir"},{"role":"aut","display":"Sharp, Gregory C.","family":"Sharp","given":"Gregory C."},{"given":"Korsuk","role":"aut","family":"Sirinukunwattana","display":"Sirinukunwattana, Korsuk"},{"display":"Speidel, Stafanie","family":"Speidel","role":"aut","given":"Stafanie"},{"given":"Christian","display":"Stock, Christian","family":"Stock","role":"aut"},{"given":"Danail","display":"Stoyanov, Danail","family":"Stoyanov","role":"aut"},{"given":"Abdel Aziz","role":"aut","display":"Taha, Abdel Aziz","family":"Taha"},{"role":"aut","family":"van der Sommen","display":"van der Sommen, Fons","given":"Fons"},{"given":"Ching-Wei","family":"Wang","display":"Wang, Ching-Wei","role":"aut"},{"given":"Marc-André","display":"Weber, Marc-André","family":"Weber","role":"aut"},{"given":"Guoyan","role":"aut","display":"Zheng, Guoyan","family":"Zheng"},{"role":"aut","display":"Jannin, Pierre","family":"Jannin","given":"Pierre"},{"given":"Annette","family":"Kopp-Schneider","display":"Kopp-Schneider, Annette","role":"aut"}],"id":{"doi":["10.1038/s41467-018-07619-7"],"eki":["1048777278"]},"recId":"1048777278","origin":[{"dateIssuedDisp":"06 December 2018","dateIssuedKey":"2018"}]} | ||
| SRT | |a MAIERHEINLWHYRANKING0620 | ||