Integration of deep learning-based image analysis and genomic data in cancer pathology: a systematic review

Background - Over the past decade, the development of molecular high-throughput methods (omics) increased rapidly and provided new insights for cancer research. In parallel, deep learning approaches revealed the enormous potential for medical image analysis, especially in digital pathology. Combinin...

Full description

Saved in:
Bibliographic Details
Main Authors: Schneider, Lucas (Author) , Laiouar-Pedari, Sara (Author) , Kuntz, Sara (Author) , Krieghoff-Henning, Eva (Author) , Hekler, Achim (Author) , Kather, Jakob Nikolas (Author) , Gaiser, Timo (Author) , Fröhling, Stefan (Author) , Brinker, Titus Josef (Author)
Format: Article (Journal)
Language:English
Published: 2022
In: European journal of cancer
Year: 2022, Volume: 160, Pages: 80-91
ISSN:1879-0852
DOI:10.1016/j.ejca.2021.10.007
Online Access:Verlag, lizenzpflichtig, Volltext: https://doi.org/10.1016/j.ejca.2021.10.007
Verlag, lizenzpflichtig, Volltext: https://www.sciencedirect.com/science/article/pii/S0959804921011606
Get full text
Author Notes:Lucas Schneider, Sara Laiouar-Pedari, Sara Kuntz, Eva Krieghoff-Henning, Achim Hekler, Jakob N. Kather, Timo Gaiser, Stefan Fröhling, Titus J. Brinker

MARC

LEADER 00000caa a2200000 c 4500
001 1807840972
003 DE-627
005 20240416193726.0
007 cr uuu---uuuuu
008 220627s2022 xx |||||o 00| ||eng c
024 7 |a 10.1016/j.ejca.2021.10.007  |2 doi 
035 |a (DE-627)1807840972 
035 |a (DE-599)KXP1807840972 
035 |a (OCoLC)1341461783 
040 |a DE-627  |b ger  |c DE-627  |e rda 
041 |a eng 
084 |a 33  |2 sdnb 
100 1 |a Schneider, Lucas  |d 1988-  |e VerfasserIn  |0 (DE-588)1233507001  |0 (DE-627)1757863079  |4 aut 
245 1 0 |a Integration of deep learning-based image analysis and genomic data in cancer pathology  |b a systematic review  |c Lucas Schneider, Sara Laiouar-Pedari, Sara Kuntz, Eva Krieghoff-Henning, Achim Hekler, Jakob N. Kather, Timo Gaiser, Stefan Fröhling, Titus J. Brinker 
264 1 |c 2022 
300 |a 12 
336 |a Text  |b txt  |2 rdacontent 
337 |a Computermedien  |b c  |2 rdamedia 
338 |a Online-Ressource  |b cr  |2 rdacarrier 
500 |a Available online 19 November 2021 
500 |a Gesehen am 27.06.2022 
520 |a Background - Over the past decade, the development of molecular high-throughput methods (omics) increased rapidly and provided new insights for cancer research. In parallel, deep learning approaches revealed the enormous potential for medical image analysis, especially in digital pathology. Combining image and omics data with deep learning tools may enable the discovery of new cancer biomarkers and a more precise prediction of patient prognosis. This systematic review addresses different multimodal fusion methods of convolutional neural network-based image analyses with omics data, focussing on the impact of data combination on the classification performance. - Methods - PubMed was screened for peer-reviewed articles published in English between January 2015 and June 2021 by two independent researchers. Search terms related to deep learning, digital pathology, omics, and multimodal fusion were combined. - Results - We identified a total of 11 studies meeting the inclusion criteria, namely studies that used convolutional neural networks for haematoxylin and eosin image analysis of patients with cancer in combination with integrated omics data. Publications were categorised according to their endpoints: 7 studies focused on survival analysis and 4 studies on prediction of cancer subtypes, malignancy or microsatellite instability with spatial analysis. - Conclusions - Image-based classifiers already show high performances in prognostic and predictive cancer diagnostics. The integration of omics data led to improved performance in all studies described here. However, these are very early studies that still require external validation to demonstrate their generalisability and robustness. Further and more comprehensive studies with larger sample sizes are needed to evaluate performance and determine clinical benefits. 
650 4 |a Biomarker identification 
650 4 |a Cancer 
650 4 |a Convolutional neural networks 
650 4 |a Multimodal fusion 
650 4 |a Omics 
700 1 |a Laiouar-Pedari, Sara  |e VerfasserIn  |4 aut 
700 1 |a Kuntz, Sara  |e VerfasserIn  |4 aut 
700 1 |a Krieghoff-Henning, Eva  |e VerfasserIn  |4 aut 
700 1 |a Hekler, Achim  |e VerfasserIn  |4 aut 
700 1 |a Kather, Jakob Nikolas  |d 1989-  |e VerfasserIn  |0 (DE-588)1064064914  |0 (DE-627)812897587  |0 (DE-576)423589091  |4 aut 
700 1 |a Gaiser, Timo  |d 1975-  |e VerfasserIn  |0 (DE-588)1030402280  |0 (DE-627)735221685  |0 (DE-576)378226533  |4 aut 
700 1 |a Fröhling, Stefan  |d 1969-  |e VerfasserIn  |0 (DE-588)120890046  |0 (DE-627)080950302  |0 (DE-576)188733930  |4 aut 
700 1 |a Brinker, Titus Josef  |d 1990-  |e VerfasserIn  |0 (DE-588)1156309395  |0 (DE-627)1018860487  |0 (DE-576)502097434  |4 aut 
773 0 8 |i Enthalten in  |t European journal of cancer  |d Amsterdam [u.a.] : Elsevier, 1992  |g 160(2022) vom: Jan., Seite 80-91  |w (DE-627)266883400  |w (DE-600)1468190-0  |w (DE-576)090954173  |x 1879-0852  |7 nnas  |a Integration of deep learning-based image analysis and genomic data in cancer pathology a systematic review 
773 1 8 |g volume:160  |g year:2022  |g month:01  |g pages:80-91  |g extent:12  |a Integration of deep learning-based image analysis and genomic data in cancer pathology a systematic review 
856 4 0 |u https://doi.org/10.1016/j.ejca.2021.10.007  |x Verlag  |x Resolving-System  |z lizenzpflichtig  |3 Volltext 
856 4 0 |u https://www.sciencedirect.com/science/article/pii/S0959804921011606  |x Verlag  |z lizenzpflichtig  |3 Volltext 
951 |a AR 
992 |a 20220627 
993 |a Article 
994 |a 2022 
998 |g 1030402280  |a Gaiser, Timo  |m 1030402280:Gaiser, Timo  |d 50000  |d 53200  |e 50000PG1030402280  |e 53200PG1030402280  |k 0/50000/  |k 1/50000/53200/  |p 7 
998 |g 1156309395  |a Brinker, Titus Josef  |m 1156309395:Brinker, Titus Josef  |d 50000  |e 50000PB1156309395  |k 0/50000/  |p 9  |y j 
998 |g 120890046  |a Fröhling, Stefan  |m 120890046:Fröhling, Stefan  |d 50000  |e 50000PF120890046  |k 0/50000/  |p 8 
998 |g 1064064914  |a Kather, Jakob Nikolas  |m 1064064914:Kather, Jakob Nikolas  |d 910000  |d 910100  |e 910000PK1064064914  |e 910100PK1064064914  |k 0/910000/  |k 1/910000/910100/  |p 6 
999 |a KXP-PPN1807840972  |e 415672221X 
BIB |a Y 
SER |a journal 
JSO |a {"name":{"displayForm":["Lucas Schneider, Sara Laiouar-Pedari, Sara Kuntz, Eva Krieghoff-Henning, Achim Hekler, Jakob N. Kather, Timo Gaiser, Stefan Fröhling, Titus J. Brinker"]},"physDesc":[{"extent":"12 S."}],"person":[{"role":"aut","given":"Lucas","family":"Schneider","display":"Schneider, Lucas"},{"family":"Laiouar-Pedari","display":"Laiouar-Pedari, Sara","given":"Sara","role":"aut"},{"given":"Sara","family":"Kuntz","display":"Kuntz, Sara","role":"aut"},{"role":"aut","family":"Krieghoff-Henning","display":"Krieghoff-Henning, Eva","given":"Eva"},{"role":"aut","display":"Hekler, Achim","family":"Hekler","given":"Achim"},{"role":"aut","display":"Kather, Jakob Nikolas","family":"Kather","given":"Jakob Nikolas"},{"family":"Gaiser","display":"Gaiser, Timo","given":"Timo","role":"aut"},{"family":"Fröhling","display":"Fröhling, Stefan","given":"Stefan","role":"aut"},{"role":"aut","given":"Titus Josef","family":"Brinker","display":"Brinker, Titus Josef"}],"origin":[{"dateIssuedDisp":"2022","dateIssuedKey":"2022"}],"id":{"eki":["1807840972"],"doi":["10.1016/j.ejca.2021.10.007"]},"note":["Available online 19 November 2021","Gesehen am 27.06.2022"],"type":{"media":"Online-Ressource","bibl":"article-journal"},"recId":"1807840972","language":["eng"],"title":[{"title":"Integration of deep learning-based image analysis and genomic data in cancer pathology","title_sort":"Integration of deep learning-based image analysis and genomic data in cancer pathology","subtitle":"a systematic review"}],"relHost":[{"disp":"Integration of deep learning-based image analysis and genomic data in cancer pathology a systematic reviewEuropean journal of cancer","type":{"bibl":"periodical","media":"Online-Ressource"},"part":{"year":"2022","extent":"12","text":"160(2022) vom: Jan., Seite 80-91","pages":"80-91","volume":"160"},"pubHistory":["28.1992 -"],"title":[{"title":"European journal of cancer","title_sort":"European journal of cancer"}],"corporate":[{"display":"European Organization for Research on Treatment of Cancer","role":"isb"},{"display":"European Association for Cancer Research","role":"isb"},{"role":"isb","display":"European School of Oncology"}],"origin":[{"publisherPlace":"Amsterdam [u.a.] ; [Erscheinungsort nicht ermittelbar]","dateIssuedDisp":"1992-","dateIssuedKey":"1992","publisher":"Elsevier ; Pergamon Press"}],"note":["Gesehen am 21.03.24","Ungezählte Beil.: Supplement"],"id":{"zdb":["1468190-0"],"issn":["1879-0852"],"eki":["266883400"]},"titleAlt":[{"title":"EJC online"}],"language":["eng"],"recId":"266883400"}]} 
SRT |a SCHNEIDERLINTEGRATIO2022