Model soups improve performance of dermoscopic skin cancer classifiers
Background - Image-based cancer classifiers suffer from a variety of problems which negatively affect their performance. For example, variation in image brightness or different cameras can already suffice to diminish performance. Ensemble solutions, where multiple model predictions are combined into...
Saved in:
| Main Authors: | , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , |
|---|---|
| Format: | Article (Journal) |
| Language: | English |
| Published: |
September 2022
|
| In: |
European journal of cancer
Year: 2022, Volume: 173, Pages: 307-316 |
| ISSN: | 1879-0852 |
| DOI: | 10.1016/j.ejca.2022.07.002 |
| Online Access: | Verlag, lizenzpflichtig, Volltext: https://doi.org/10.1016/j.ejca.2022.07.002 Verlag, lizenzpflichtig, Volltext: https://www.sciencedirect.com/science/article/pii/S0959804922004129 
|
| Author Notes: | Roman C. Maron, Achim Hekler, Sarah Haggenmüller, Christof von Kalle, Jochen S. Utikal, Verena Müller, Maria Gaiser, Friedegund Meier, Sarah Hobelsberger, Frank F. Gellrich, Mildred Sergon, Axel Hauschild, Lars E. French, Lucie Heinzerling, Justin G. Schlager, Kamran Ghoreschi, Max Schlaak, Franz J. Hilke, Gabriela Poch, Sören Korsing, Carola Berking, Markus V. Heppt, Michael Erdmann, Sebastian Haferkamp, Dirk Schadendorf, Wiebke Sondermann, Matthias Goebeler, Bastian Schilling, Jakob N. Kather, Stefan Fröhling, Daniel B. Lipka, Eva Krieghoff-Henning, Titus J. Brinker |
MARC
| LEADER | 00000caa a2200000 c 4500 | ||
|---|---|---|---|
| 001 | 1845598644 | ||
| 003 | DE-627 | ||
| 005 | 20230706223711.0 | ||
| 007 | cr uuu---uuuuu | ||
| 008 | 230517s2022 xx |||||o 00| ||eng c | ||
| 024 | 7 | |a 10.1016/j.ejca.2022.07.002 |2 doi | |
| 035 | |a (DE-627)1845598644 | ||
| 035 | |a (DE-599)KXP1845598644 | ||
| 035 | |a (OCoLC)1389533810 | ||
| 040 | |a DE-627 |b ger |c DE-627 |e rda | ||
| 041 | |a eng | ||
| 084 | |a 33 |2 sdnb | ||
| 100 | 1 | |a Maron, Roman C. |e VerfasserIn |0 (DE-588)1198959851 |0 (DE-627)1681173867 |4 aut | |
| 245 | 1 | 0 | |a Model soups improve performance of dermoscopic skin cancer classifiers |c Roman C. Maron, Achim Hekler, Sarah Haggenmüller, Christof von Kalle, Jochen S. Utikal, Verena Müller, Maria Gaiser, Friedegund Meier, Sarah Hobelsberger, Frank F. Gellrich, Mildred Sergon, Axel Hauschild, Lars E. French, Lucie Heinzerling, Justin G. Schlager, Kamran Ghoreschi, Max Schlaak, Franz J. Hilke, Gabriela Poch, Sören Korsing, Carola Berking, Markus V. Heppt, Michael Erdmann, Sebastian Haferkamp, Dirk Schadendorf, Wiebke Sondermann, Matthias Goebeler, Bastian Schilling, Jakob N. Kather, Stefan Fröhling, Daniel B. Lipka, Eva Krieghoff-Henning, Titus J. Brinker |
| 264 | 1 | |c September 2022 | |
| 300 | |a 10 | ||
| 336 | |a Text |b txt |2 rdacontent | ||
| 337 | |a Computermedien |b c |2 rdamedia | ||
| 338 | |a Online-Ressource |b cr |2 rdacarrier | ||
| 500 | |a Gesehen am 17.05.2023 | ||
| 520 | |a Background - Image-based cancer classifiers suffer from a variety of problems which negatively affect their performance. For example, variation in image brightness or different cameras can already suffice to diminish performance. Ensemble solutions, where multiple model predictions are combined into one, can improve these problems. However, ensembles are computationally intensive and less transparent to practitioners than single model solutions. Constructing model soups, by averaging the weights of multiple models into a single model, could circumvent these limitations while still improving performance. - Objective - To investigate the performance of model soups for a dermoscopic melanoma-nevus skin cancer classification task with respect to (1) generalisation to images from other clinics, (2) robustness against small image changes and (3) calibration such that the confidences correspond closely to the actual predictive uncertainties. - Methods - We construct model soups by fine-tuning pre-trained models on seven different image resolutions and subsequently averaging their weights. Performance is evaluated on a multi-source dataset including holdout and external components. - Results - We find that model soups improve generalisation and calibration on the external component while maintaining performance on the holdout component. For robustness, we observe performance improvements for pertubated test images, while the performance on corrupted test images remains on par. - Conclusions - Overall, souping for skin cancer classifiers has a positive effect on generalisation, robustness and calibration. It is easy for practitioners to implement and by combining multiple models into a single model, complexity is reduced. This could be an important factor in achieving clinical applicability, as less complexity generally means more transparency. | ||
| 650 | 4 | |a Artificial intelligence | |
| 650 | 4 | |a Calibration | |
| 650 | 4 | |a Deep learning | |
| 650 | 4 | |a Dermatology | |
| 650 | 4 | |a Ensembles | |
| 650 | 4 | |a Generalisation | |
| 650 | 4 | |a Melanoma | |
| 650 | 4 | |a Model soups | |
| 650 | 4 | |a Nevus | |
| 650 | 4 | |a Robustness | |
| 700 | 1 | |a Hekler, Achim |e VerfasserIn |0 (DE-588)1196829314 |0 (DE-627)1678721344 |4 aut | |
| 700 | 1 | |a Haggenmüller, Sarah |e VerfasserIn |4 aut | |
| 700 | 1 | |a Kalle, Christof von |d 1962- |e VerfasserIn |0 (DE-588)1036481115 |0 (DE-627)75107926X |0 (DE-576)168957396 |4 aut | |
| 700 | 1 | |a Utikal, Jochen |d 1974- |e VerfasserIn |0 (DE-588)1026463750 |0 (DE-627)726765015 |0 (DE-576)371816580 |4 aut | |
| 700 | 1 | |a Müller, Verena |d 1987- |e VerfasserIn |0 (DE-588)1227909802 |0 (DE-627)1749122138 |4 aut | |
| 700 | 1 | |a Gaiser, Maria |d 1979- |e VerfasserIn |0 (DE-588)1074971930 |0 (DE-627)832793035 |0 (DE-576)443175551 |4 aut | |
| 700 | 1 | |a Meier, Friedegund |e VerfasserIn |4 aut | |
| 700 | 1 | |a Hobelsberger, Sarah |e VerfasserIn |4 aut | |
| 700 | 1 | |a Gellrich, Frank F. |e VerfasserIn |4 aut | |
| 700 | 1 | |a Sergon, Mildred |e VerfasserIn |4 aut | |
| 700 | 1 | |a Hauschild, Axel |e VerfasserIn |0 (DE-588)120701200 |0 (DE-627)080838448 |0 (DE-576)292346670 |4 aut | |
| 700 | 1 | |a French, Lars E. |d 1963- |e VerfasserIn |0 (DE-588)141166835 |0 (DE-627)70389966X |0 (DE-576)322518792 |4 aut | |
| 700 | 1 | |a Heinzerling, Lucie |d 1969- |e VerfasserIn |0 (DE-588)124732755 |0 (DE-627)537985638 |0 (DE-576)29447224X |4 aut | |
| 700 | 1 | |a Schlager, Justin Gabriel |d 1987- |e VerfasserIn |0 (DE-588)1119171520 |0 (DE-627)872683915 |0 (DE-576)479749930 |4 aut | |
| 700 | 1 | |a Ghoreschi, Kamran |d 1970- |e VerfasserIn |0 (DE-588)124466079 |0 (DE-627)363367357 |0 (DE-576)294184988 |4 aut | |
| 700 | 1 | |a Schlaak, Max |e VerfasserIn |4 aut | |
| 700 | 1 | |a Hilke, Franz |e VerfasserIn |0 (DE-588)1230558411 |0 (DE-627)1753030498 |4 aut | |
| 700 | 1 | |a Poch, Gabriela |e VerfasserIn |4 aut | |
| 700 | 1 | |a Korsing, Sören |e VerfasserIn |0 (DE-588)1187685666 |0 (DE-627)1666638749 |4 aut | |
| 700 | 1 | |a Berking, Carola |d 1971- |e VerfasserIn |0 (DE-588)115659714 |0 (DE-627)077390121 |0 (DE-576)290004942 |4 aut | |
| 700 | 1 | |a Heppt, Markus V. |d 1987- |e VerfasserIn |0 (DE-588)1072242346 |0 (DE-627)827081111 |0 (DE-576)43371767X |4 aut | |
| 700 | 1 | |a Erdmann, Michael |e VerfasserIn |0 (DE-588)1252474857 |0 (DE-627)1793816395 |4 aut | |
| 700 | 1 | |a Haferkamp, Sebastian |d 1978- |e VerfasserIn |0 (DE-588)132018330 |0 (DE-627)51684296X |0 (DE-576)298896044 |4 aut | |
| 700 | 1 | |a Schadendorf, Dirk |d 1960- |e VerfasserIn |0 (DE-588)11142576X |0 (DE-627)499566076 |0 (DE-576)289702275 |4 aut | |
| 700 | 1 | |a Sondermann, Wiebke |e VerfasserIn |0 (DE-588)1198953756 |0 (DE-627)1681162121 |4 aut | |
| 700 | 1 | |a Goebeler, Matthias |d 1963- |e VerfasserIn |0 (DE-588)11206468X |0 (DE-627)671503510 |0 (DE-576)352522062 |4 aut | |
| 700 | 1 | |a Schilling, Bastian |d 1979- |e VerfasserIn |0 (DE-588)142513563 |0 (DE-627)704247887 |0 (DE-576)331358913 |4 aut | |
| 700 | 1 | |a Kather, Jakob Nikolas |d 1989- |e VerfasserIn |0 (DE-588)1064064914 |0 (DE-627)812897587 |0 (DE-576)423589091 |4 aut | |
| 700 | 1 | |a Fröhling, Stefan |d 1969- |e VerfasserIn |0 (DE-588)120890046 |0 (DE-627)080950302 |0 (DE-576)188733930 |4 aut | |
| 700 | 1 | |a Lipka, Daniel |d 1976- |e VerfasserIn |0 (DE-588)131915312 |0 (DE-627)516076426 |0 (DE-576)298833328 |4 aut | |
| 700 | 1 | |a Krieghoff-Henning, Eva |d 1976- |e VerfasserIn |0 (DE-588)132407914 |0 (DE-627)52267786X |0 (DE-576)299126706 |4 aut | |
| 700 | 1 | |a Brinker, Titus Josef |d 1990- |e VerfasserIn |0 (DE-588)1156309395 |0 (DE-627)1018860487 |0 (DE-576)502097434 |4 aut | |
| 773 | 0 | 8 | |i Enthalten in |t European journal of cancer |d Amsterdam [u.a.] : Elsevier, 1992 |g 173(2022), Seite 307-316 |w (DE-627)266883400 |w (DE-600)1468190-0 |w (DE-576)090954173 |x 1879-0852 |7 nnas |a Model soups improve performance of dermoscopic skin cancer classifiers |
| 773 | 1 | 8 | |g volume:173 |g year:2022 |g pages:307-316 |g extent:10 |a Model soups improve performance of dermoscopic skin cancer classifiers |
| 856 | 4 | 0 | |u https://doi.org/10.1016/j.ejca.2022.07.002 |x Verlag |x Resolving-System |z lizenzpflichtig |3 Volltext |
| 856 | 4 | 0 | |u https://www.sciencedirect.com/science/article/pii/S0959804922004129 |x Verlag |z lizenzpflichtig |3 Volltext |
| 951 | |a AR | ||
| 992 | |a 20230517 | ||
| 993 | |a Article | ||
| 994 | |a 2022 | ||
| 998 | |g 1074971930 |a Gaiser, Maria |m 1074971930:Gaiser, Maria |d 60000 |d 61900 |e 60000PG1074971930 |e 61900PG1074971930 |k 0/60000/ |k 1/60000/61900/ |p 7 | ||
| 998 | |g 1026463750 |a Utikal, Jochen |m 1026463750:Utikal, Jochen |d 60000 |e 60000PU1026463750 |k 0/60000/ |p 5 | ||
| 998 | |g 131915312 |a Lipka, Daniel |m 131915312:Lipka, Daniel |d 140000 |e 140000PL131915312 |k 0/140000/ |p 31 | ||
| 998 | |g 120890046 |a Fröhling, Stefan |m 120890046:Fröhling, Stefan |d 50000 |e 50000PF120890046 |k 0/50000/ |p 30 | ||
| 998 | |g 1064064914 |a Kather, Jakob Nikolas |m 1064064914:Kather, Jakob Nikolas |d 910000 |d 910100 |e 910000PK1064064914 |e 910100PK1064064914 |k 0/910000/ |k 1/910000/910100/ |p 29 | ||
| 998 | |g 11142576X |a Schadendorf, Dirk |m 11142576X:Schadendorf, Dirk |d 50000 |e 50000PS11142576X |k 0/50000/ |p 25 | ||
| 998 | |g 1156309395 |a Brinker, Titus Josef |m 1156309395:Brinker, Titus Josef |d 50000 |e 50000PB1156309395 |k 0/50000/ |p 21 | ||
| 998 | |g 1036481115 |a Kalle, Christof von |m 1036481115:Kalle, Christof von |d 50000 |e 50000PK1036481115 |k 0/50000/ |p 4 | ||
| 999 | |a KXP-PPN1845598644 |e 4322982832 | ||
| BIB | |a Y | ||
| SER | |a journal | ||
| JSO | |a {"id":{"doi":["10.1016/j.ejca.2022.07.002"],"eki":["1845598644"]},"type":{"bibl":"article-journal","media":"Online-Ressource"},"physDesc":[{"extent":"10 S."}],"note":["Gesehen am 17.05.2023"],"relHost":[{"title":[{"title":"European journal of cancer","title_sort":"European journal of cancer"}],"origin":[{"publisherPlace":"Amsterdam [u.a.] ; [Erscheinungsort nicht ermittelbar]","dateIssuedKey":"1992","dateIssuedDisp":"1992-","publisher":"Elsevier ; Pergamon Press"}],"corporate":[{"role":"isb","display":"European Organization for Research on Treatment of Cancer"},{"role":"isb","display":"European Association for Cancer Research"},{"display":"European School of Oncology","role":"isb"}],"note":["Gesehen am 21.03.24","Ungezählte Beil.: Supplement"],"id":{"eki":["266883400"],"zdb":["1468190-0"],"issn":["1879-0852"]},"part":{"volume":"173","text":"173(2022), Seite 307-316","pages":"307-316","year":"2022","extent":"10"},"titleAlt":[{"title":"EJC online"}],"language":["eng"],"recId":"266883400","disp":"Model soups improve performance of dermoscopic skin cancer classifiersEuropean journal of cancer","pubHistory":["28.1992 -"],"type":{"bibl":"periodical","media":"Online-Ressource"}}],"origin":[{"dateIssuedKey":"2022","dateIssuedDisp":"September 2022"}],"name":{"displayForm":["Roman C. Maron, Achim Hekler, Sarah Haggenmüller, Christof von Kalle, Jochen S. Utikal, Verena Müller, Maria Gaiser, Friedegund Meier, Sarah Hobelsberger, Frank F. Gellrich, Mildred Sergon, Axel Hauschild, Lars E. French, Lucie Heinzerling, Justin G. Schlager, Kamran Ghoreschi, Max Schlaak, Franz J. Hilke, Gabriela Poch, Sören Korsing, Carola Berking, Markus V. Heppt, Michael Erdmann, Sebastian Haferkamp, Dirk Schadendorf, Wiebke Sondermann, Matthias Goebeler, Bastian Schilling, Jakob N. Kather, Stefan Fröhling, Daniel B. Lipka, Eva Krieghoff-Henning, Titus J. Brinker"]},"recId":"1845598644","person":[{"family":"Maron","given":"Roman C.","display":"Maron, Roman C.","role":"aut"},{"family":"Hekler","given":"Achim","display":"Hekler, Achim","role":"aut"},{"family":"Haggenmüller","given":"Sarah","display":"Haggenmüller, Sarah","role":"aut"},{"family":"Kalle","display":"Kalle, Christof von","given":"Christof von","role":"aut"},{"family":"Utikal","given":"Jochen","display":"Utikal, Jochen","role":"aut"},{"given":"Verena","display":"Müller, Verena","family":"Müller","role":"aut"},{"role":"aut","family":"Gaiser","display":"Gaiser, Maria","given":"Maria"},{"display":"Meier, Friedegund","given":"Friedegund","family":"Meier","role":"aut"},{"role":"aut","family":"Hobelsberger","display":"Hobelsberger, Sarah","given":"Sarah"},{"role":"aut","family":"Gellrich","display":"Gellrich, Frank F.","given":"Frank F."},{"role":"aut","family":"Sergon","display":"Sergon, Mildred","given":"Mildred"},{"role":"aut","family":"Hauschild","given":"Axel","display":"Hauschild, Axel"},{"given":"Lars E.","display":"French, Lars E.","family":"French","role":"aut"},{"family":"Heinzerling","display":"Heinzerling, Lucie","given":"Lucie","role":"aut"},{"role":"aut","given":"Justin Gabriel","display":"Schlager, Justin Gabriel","family":"Schlager"},{"role":"aut","family":"Ghoreschi","display":"Ghoreschi, Kamran","given":"Kamran"},{"given":"Max","display":"Schlaak, Max","family":"Schlaak","role":"aut"},{"role":"aut","family":"Hilke","given":"Franz","display":"Hilke, Franz"},{"given":"Gabriela","display":"Poch, Gabriela","family":"Poch","role":"aut"},{"role":"aut","family":"Korsing","given":"Sören","display":"Korsing, Sören"},{"given":"Carola","display":"Berking, Carola","family":"Berking","role":"aut"},{"role":"aut","display":"Heppt, Markus V.","given":"Markus V.","family":"Heppt"},{"display":"Erdmann, Michael","given":"Michael","family":"Erdmann","role":"aut"},{"role":"aut","family":"Haferkamp","given":"Sebastian","display":"Haferkamp, Sebastian"},{"display":"Schadendorf, Dirk","given":"Dirk","family":"Schadendorf","role":"aut"},{"display":"Sondermann, Wiebke","given":"Wiebke","family":"Sondermann","role":"aut"},{"role":"aut","given":"Matthias","display":"Goebeler, Matthias","family":"Goebeler"},{"display":"Schilling, Bastian","given":"Bastian","family":"Schilling","role":"aut"},{"role":"aut","family":"Kather","given":"Jakob Nikolas","display":"Kather, Jakob Nikolas"},{"role":"aut","given":"Stefan","display":"Fröhling, Stefan","family":"Fröhling"},{"role":"aut","family":"Lipka","display":"Lipka, Daniel","given":"Daniel"},{"given":"Eva","display":"Krieghoff-Henning, Eva","family":"Krieghoff-Henning","role":"aut"},{"role":"aut","family":"Brinker","given":"Titus Josef","display":"Brinker, Titus Josef"}],"title":[{"title":"Model soups improve performance of dermoscopic skin cancer classifiers","title_sort":"Model soups improve performance of dermoscopic skin cancer classifiers"}],"language":["eng"]} | ||
| SRT | |a MARONROMANMODELSOUPS2022 | ||