Collective human intelligence outperforms artificial intelligence in a skin lesion classification task
Background and objectives Convolutional neural networks (CNN) enable accurate diagnosis of medical images and perform on or above the level of individual physicians. Recently, collective human intelligence (CoHI) was shown to exceed the diagnostic accuracy of individuals. Thus, diagnostic performanc...
Gespeichert in:
| Hauptverfasser: | , , , , , , , , , , , , |
|---|---|
| Dokumenttyp: | Article (Journal) |
| Sprache: | Englisch |
| Veröffentlicht: |
2021
|
| In: |
Journal der Deutschen Dermatologischen Gesellschaft
Year: 2021, Jahrgang: 19, Heft: 8, Pages: 1178-1184 |
| ISSN: | 1610-0387 |
| DOI: | 10.1111/ddg.14510 |
| Online-Zugang: | Verlag, kostenfrei, Volltext: https://doi.org/10.1111/ddg.14510 Verlag, kostenfrei, Volltext: https://onlinelibrary.wiley.com/doi/abs/10.1111/ddg.14510 
|
| Verfasserangaben: | Julia K. Winkler, Katharina Sies, Christine Fink, Ferdinand Toberer, Alexander Enk, Mohamed Souhayel Abassi, Tobias Fuchs, Andreas Blum, Wilhelm Stolz, Brigitte Coras-Stepanek, Robert Cipic, Stefanie Guther, Holger A. Haenssle |
MARC
| LEADER | 00000caa a2200000 c 4500 | ||
|---|---|---|---|
| 001 | 1858742358 | ||
| 003 | DE-627 | ||
| 005 | 20240306115146.0 | ||
| 007 | cr uuu---uuuuu | ||
| 008 | 230904s2021 xx |||||o 00| ||eng c | ||
| 024 | 7 | |a 10.1111/ddg.14510 |2 doi | |
| 035 | |a (DE-627)1858742358 | ||
| 035 | |a (DE-599)KXP1858742358 | ||
| 035 | |a (OCoLC)1425063075 | ||
| 040 | |a DE-627 |b ger |c DE-627 |e rda | ||
| 041 | |a eng | ||
| 084 | |a 33 |2 sdnb | ||
| 100 | 1 | |a Winkler, Julia K. |d 1987- |e VerfasserIn |0 (DE-588)1038218993 |0 (DE-627)756780721 |0 (DE-576)392196514 |4 aut | |
| 245 | 1 | 0 | |a Collective human intelligence outperforms artificial intelligence in a skin lesion classification task |c Julia K. Winkler, Katharina Sies, Christine Fink, Ferdinand Toberer, Alexander Enk, Mohamed Souhayel Abassi, Tobias Fuchs, Andreas Blum, Wilhelm Stolz, Brigitte Coras-Stepanek, Robert Cipic, Stefanie Guther, Holger A. Haenssle |
| 264 | 1 | |c 2021 | |
| 300 | |a 7 | ||
| 336 | |a Text |b txt |2 rdacontent | ||
| 337 | |a Computermedien |b c |2 rdamedia | ||
| 338 | |a Online-Ressource |b cr |2 rdacarrier | ||
| 500 | |a Gesehen am 04.09.2023 | ||
| 520 | |a Background and objectives Convolutional neural networks (CNN) enable accurate diagnosis of medical images and perform on or above the level of individual physicians. Recently, collective human intelligence (CoHI) was shown to exceed the diagnostic accuracy of individuals. Thus, diagnostic performance of CoHI (120 dermatologists) versus individual dermatologists versus two state-of-the-art CNN was investigated. Patients and Methods Cross-sectional reader study with presentation of 30 clinical cases to 120 dermatologists. Six diagnoses were offered and votes collected via remote voting devices (quizzbox®, Quizzbox Solutions GmbH, Stuttgart, Germany). Dermatoscopic images were classified by a binary and multiclass CNN (FotoFinder Systems GmbH, Bad Birnbach, Germany). Three sets of diagnostic classifications were scored against ground truth: (1) CoHI, (2) individual dermatologists, and (3) CNN. Results CoHI attained a significantly higher accuracy [95 % confidence interval] (80.0 % [62.7 %-90.5 %]) than individual dermatologists (75.7 % [73.8 %-77.5 %]) and CNN (70.0 % [52.1 %-83.3 %]; all P < 0.001) in binary classifications. Moreover, CoHI achieved a higher sensitivity (82.4 % [59.0 %-93.8 %]) and specificity (76.9 % [49.7 %-91.8 %]) than individual dermatologists (sensitivity 77.8 % [75.3 %-80.2 %], specificity 73.0 % [70.6 %-75.4 %]) and CNN (sensitivity 70.6 % [46.9 %-86.7 %], specificity 69.2 % [42.4 %-87.3 %]). The diagnostic accuracy of CoHI was superior to that of individual dermatologists (P < 0.001) in multiclass evaluation, with the accuracy of the latter comparable to multiclass CNN. Conclusions Our analysis revealed that the majority vote of an interconnected group of dermatologists (CoHI) outperformed individuals and CNN in a demanding skin lesion classification task. | ||
| 650 | 4 | |a artificial intelligence | |
| 650 | 4 | |a collective | |
| 650 | 4 | |a convolution neural network | |
| 650 | 4 | |a skin lesion classification | |
| 700 | 1 | |a Kommoss, Katharina |e VerfasserIn |0 (DE-588)1216661227 |0 (DE-627)1727913124 |4 aut | |
| 700 | 1 | |a Müller-Christmann, Christine |d 1983- |e VerfasserIn |0 (DE-588)143738127 |0 (DE-627)654330387 |0 (DE-576)338647651 |4 aut | |
| 700 | 1 | |a Toberer, Ferdinand |d 1981- |e VerfasserIn |0 (DE-588)102155832X |0 (DE-627)715821962 |0 (DE-576)362852367 |4 aut | |
| 700 | 1 | |a Enk, Alexander |d 1963- |e VerfasserIn |0 (DE-588)1032757140 |0 (DE-627)739272535 |0 (DE-576)166173517 |4 aut | |
| 700 | 1 | |a Abassi, Mohamed Souhayel |e VerfasserIn |4 aut | |
| 700 | 1 | |a Fuchs, Tobias |e VerfasserIn |4 aut | |
| 700 | 1 | |a Blum, Andreas |e VerfasserIn |4 aut | |
| 700 | 1 | |a Stolz, Wilhelm |e VerfasserIn |4 aut | |
| 700 | 1 | |a Coras-Stepanek, Brigitte |e VerfasserIn |4 aut | |
| 700 | 1 | |a Cipic, Robert |e VerfasserIn |4 aut | |
| 700 | 1 | |a Guther, Stefanie |e VerfasserIn |4 aut | |
| 700 | 1 | |a Hänßle, Holger |e VerfasserIn |0 (DE-588)1074971531 |0 (DE-627)832791733 |0 (DE-576)443174598 |4 aut | |
| 773 | 0 | 8 | |i Enthalten in |a Deutsche Dermatologische Gesellschaft |t Journal der Deutschen Dermatologischen Gesellschaft |d Berlin : Wiley-Blackwell, 2003 |g 19(2021), 8, Seite 1178-1184 |h Online-Ressource |w (DE-627)362755833 |w (DE-600)2099463-1 |w (DE-576)103373837 |x 1610-0387 |7 nnas |
| 773 | 1 | 8 | |g volume:19 |g year:2021 |g number:8 |g pages:1178-1184 |g extent:7 |a Collective human intelligence outperforms artificial intelligence in a skin lesion classification task |
| 856 | 4 | 0 | |u https://doi.org/10.1111/ddg.14510 |x Verlag |x Resolving-System |z kostenfrei |3 Volltext |
| 856 | 4 | 0 | |u https://onlinelibrary.wiley.com/doi/abs/10.1111/ddg.14510 |x Verlag |z kostenfrei |3 Volltext |
| 951 | |a AR | ||
| 992 | |a 20230904 | ||
| 993 | |a Article | ||
| 994 | |a 2021 | ||
| 998 | |g 1074971531 |a Hänßle, Holger |m 1074971531:Hänßle, Holger |d 910000 |d 911300 |e 910000PH1074971531 |e 911300PH1074971531 |k 0/910000/ |k 1/910000/911300/ |p 13 |y j | ||
| 998 | |g 1032757140 |a Enk, Alexander |m 1032757140:Enk, Alexander |d 910000 |d 911300 |e 910000PE1032757140 |e 911300PE1032757140 |k 0/910000/ |k 1/910000/911300/ |p 5 | ||
| 998 | |g 102155832X |a Toberer, Ferdinand |m 102155832X:Toberer, Ferdinand |d 910000 |d 911300 |e 910000PT102155832X |e 911300PT102155832X |k 0/910000/ |k 1/910000/911300/ |p 4 | ||
| 998 | |g 143738127 |a Müller-Christmann, Christine |m 143738127:Müller-Christmann, Christine |d 910000 |d 911300 |d 50000 |e 910000PM143738127 |e 911300PM143738127 |e 50000PM143738127 |k 0/910000/ |k 1/910000/911300/ |k 0/50000/ |p 3 | ||
| 998 | |g 1216661227 |a Kommoss, Katharina |m 1216661227:Kommoss, Katharina |d 910000 |d 911300 |e 910000PK1216661227 |e 911300PK1216661227 |k 0/910000/ |k 1/910000/911300/ |p 2 | ||
| 998 | |g 1038218993 |a Winkler, Julia K. |m 1038218993:Winkler, Julia K. |d 910000 |d 911300 |e 910000PW1038218993 |e 911300PW1038218993 |k 0/910000/ |k 1/910000/911300/ |p 1 |x j | ||
| 999 | |a KXP-PPN1858742358 |e 4372337280 | ||
| BIB | |a Y | ||
| SER | |a journal | ||
| JSO | |a {"name":{"displayForm":["Julia K. Winkler, Katharina Sies, Christine Fink, Ferdinand Toberer, Alexander Enk, Mohamed Souhayel Abassi, Tobias Fuchs, Andreas Blum, Wilhelm Stolz, Brigitte Coras-Stepanek, Robert Cipic, Stefanie Guther, Holger A. Haenssle"]},"note":["Gesehen am 04.09.2023"],"title":[{"title_sort":"Collective human intelligence outperforms artificial intelligence in a skin lesion classification task","title":"Collective human intelligence outperforms artificial intelligence in a skin lesion classification task"}],"language":["eng"],"physDesc":[{"extent":"7 S."}],"recId":"1858742358","id":{"doi":["10.1111/ddg.14510"],"eki":["1858742358"]},"origin":[{"dateIssuedKey":"2021","dateIssuedDisp":"2021"}],"relHost":[{"corporate":[{"display":"Deutsche Dermatologische Gesellschaft","role":"aut"}],"pubHistory":["1.2003 -"],"part":{"pages":"1178-1184","volume":"19","text":"19(2021), 8, Seite 1178-1184","year":"2021","extent":"7","issue":"8"},"disp":"Deutsche Dermatologische GesellschaftJournal der Deutschen Dermatologischen Gesellschaft","recId":"362755833","type":{"bibl":"periodical","media":"Online-Ressource"},"titleAlt":[{"title":"JDDG"}],"titleTranslated":[{"translated":"Journal of the German Society of Dermatology"}],"physDesc":[{"extent":"Online-Ressource"}],"language":["ger","eng"],"title":[{"subtitle":"JDDG = Journal of the German Society of Dermatology","title":"Journal der Deutschen Dermatologischen Gesellschaft","title_sort":"Journal der Deutschen Dermatologischen Gesellschaft"}],"note":["Gesehen am 03.03.10"],"id":{"doi":["10.1111/(ISSN)1610-0387"],"issn":["1610-0387"],"eki":["362755833"],"zdb":["2099463-1"]},"origin":[{"dateIssuedKey":"2003","publisherPlace":"Berlin ; Berlin","dateIssuedDisp":"2003-","publisher":"Wiley-Blackwell ; Blackwell"}]}],"type":{"media":"Online-Ressource","bibl":"article-journal"},"person":[{"given":"Julia K.","family":"Winkler","display":"Winkler, Julia K.","role":"aut"},{"family":"Kommoss","display":"Kommoss, Katharina","role":"aut","given":"Katharina"},{"family":"Müller-Christmann","display":"Müller-Christmann, Christine","role":"aut","given":"Christine"},{"family":"Toberer","display":"Toberer, Ferdinand","role":"aut","given":"Ferdinand"},{"role":"aut","display":"Enk, Alexander","family":"Enk","given":"Alexander"},{"given":"Mohamed Souhayel","family":"Abassi","display":"Abassi, Mohamed Souhayel","role":"aut"},{"given":"Tobias","role":"aut","family":"Fuchs","display":"Fuchs, Tobias"},{"given":"Andreas","display":"Blum, Andreas","family":"Blum","role":"aut"},{"given":"Wilhelm","role":"aut","display":"Stolz, Wilhelm","family":"Stolz"},{"given":"Brigitte","family":"Coras-Stepanek","display":"Coras-Stepanek, Brigitte","role":"aut"},{"family":"Cipic","display":"Cipic, Robert","role":"aut","given":"Robert"},{"family":"Guther","display":"Guther, Stefanie","role":"aut","given":"Stefanie"},{"given":"Holger","role":"aut","family":"Hänßle","display":"Hänßle, Holger"}]} | ||
| SRT | |a WINKLERJULCOLLECTIVE2021 | ||