Reproducible biomedical benchmarking in the cloud: lessons from crowd-sourced data challenges

Challenges are achieving broad acceptance for addressing many biomedical questions and enabling tool assessment. But ensuring that the methods evaluated are reproducible and reusable is complicated by the diversity of software architectures, input and output file formats, and computing environments....

Ausführliche Beschreibung

Gespeichert in:
Bibliographische Detailangaben
Hauptverfasser: Ellrott, Kyle (VerfasserIn) , Sáez Rodríguez, Julio (VerfasserIn)
Dokumenttyp: Article (Journal)
Sprache:Englisch
Veröffentlicht: 10 September 2019
In: Genome biology
Year: 2019, Jahrgang: 20
ISSN:1474-760X
DOI:10.1186/s13059-019-1794-0
Online-Zugang:Verlag, Volltext: https://doi.org/10.1186/s13059-019-1794-0
Volltext
Verfasserangaben:Kyle Ellrott, Alex Buchanan, Allison Creason, Michael Mason, Thomas Schaffter, Bruce Hoff, James Eddy, John M. Chilton, Thomas Yu, Joshua M. Stuart, Julio Saez-Rodriguez, Gustavo Stolovitzky, Paul C. Boutros and Justin Guinney

MARC

LEADER 00000caa a2200000 c 4500
001 1678193003
003 DE-627
005 20220816234909.0
007 cr uuu---uuuuu
008 191007s2019 xx |||||o 00| ||eng c
024 7 |a 10.1186/s13059-019-1794-0  |2 doi 
035 |a (DE-627)1678193003 
035 |a (DE-599)KXP1678193003 
035 |a (OCoLC)1341244826 
040 |a DE-627  |b ger  |c DE-627  |e rda 
041 |a eng 
084 |a 33  |2 sdnb 
100 1 |a Ellrott, Kyle  |e VerfasserIn  |0 (DE-588)1196556377  |0 (DE-627)1678193534  |4 aut 
245 1 0 |a Reproducible biomedical benchmarking in the cloud  |b lessons from crowd-sourced data challenges  |c Kyle Ellrott, Alex Buchanan, Allison Creason, Michael Mason, Thomas Schaffter, Bruce Hoff, James Eddy, John M. Chilton, Thomas Yu, Joshua M. Stuart, Julio Saez-Rodriguez, Gustavo Stolovitzky, Paul C. Boutros and Justin Guinney 
264 1 |c 10 September 2019 
300 |a 9 
336 |a Text  |b txt  |2 rdacontent 
337 |a Computermedien  |b c  |2 rdamedia 
338 |a Online-Ressource  |b cr  |2 rdacarrier 
500 |a Gesehen am 07.10.2019 
520 |a Challenges are achieving broad acceptance for addressing many biomedical questions and enabling tool assessment. But ensuring that the methods evaluated are reproducible and reusable is complicated by the diversity of software architectures, input and output file formats, and computing environments. To mitigate these problems, some challenges have leveraged new virtualization and compute methods, requiring participants to submit cloud-ready software packages. We review recent data challenges with innovative approaches to model reproducibility and data sharing, and outline key lessons for improving quantitative biomedical data analysis through crowd-sourced benchmarking challenges. 
700 1 |a Sáez Rodríguez, Julio  |d 1978-  |e VerfasserIn  |0 (DE-588)133764362  |0 (DE-627)555766632  |0 (DE-576)300083114  |4 aut 
773 0 8 |i Enthalten in  |t Genome biology  |d London : BioMed Central, 2000  |g 20(2019) Artikel-Nummer 195, 9 Seiten  |h Online-Ressource  |w (DE-627)326173617  |w (DE-600)2040529-7  |w (DE-576)110736192  |x 1474-760X  |7 nnas  |a Reproducible biomedical benchmarking in the cloud lessons from crowd-sourced data challenges 
773 1 8 |g volume:20  |g year:2019  |g extent:9  |a Reproducible biomedical benchmarking in the cloud lessons from crowd-sourced data challenges 
856 4 0 |u https://doi.org/10.1186/s13059-019-1794-0  |x Verlag  |x Resolving-System  |3 Volltext 
951 |a AR 
992 |a 20191007 
993 |a Article 
994 |a 2019 
998 |g 133764362  |a Sáez Rodríguez, Julio  |m 133764362:Sáez Rodríguez, Julio  |d 910000  |d 912900  |d 700000  |d 716000  |e 910000PS133764362  |e 912900PS133764362  |e 700000PS133764362  |e 716000PS133764362  |k 0/910000/  |k 1/910000/912900/  |k 0/700000/  |k 1/700000/716000/  |p 11 
999 |a KXP-PPN1678193003  |e 3519941279 
BIB |a Y 
SER |a journal 
JSO |a {"id":{"doi":["10.1186/s13059-019-1794-0"],"eki":["1678193003"]},"recId":"1678193003","physDesc":[{"extent":"9 S."}],"note":["Gesehen am 07.10.2019"],"name":{"displayForm":["Kyle Ellrott, Alex Buchanan, Allison Creason, Michael Mason, Thomas Schaffter, Bruce Hoff, James Eddy, John M. Chilton, Thomas Yu, Joshua M. Stuart, Julio Saez-Rodriguez, Gustavo Stolovitzky, Paul C. Boutros and Justin Guinney"]},"person":[{"given":"Kyle","family":"Ellrott","display":"Ellrott, Kyle","role":"aut","roleDisplay":"VerfasserIn"},{"roleDisplay":"VerfasserIn","role":"aut","display":"Sáez Rodríguez, Julio","family":"Sáez Rodríguez","given":"Julio"}],"title":[{"title_sort":"Reproducible biomedical benchmarking in the cloud","title":"Reproducible biomedical benchmarking in the cloud","subtitle":"lessons from crowd-sourced data challenges"}],"relHost":[{"physDesc":[{"extent":"Online-Ressource"}],"note":["ISSN-Portal 1465-6914: GenomeBiology.com","Gesehen am 11.02.15"],"pubHistory":["1.2000 -"],"id":{"eki":["326173617"],"zdb":["2040529-7"],"issn":["1474-760X"]},"recId":"326173617","type":{"bibl":"periodical","media":"Online-Ressource"},"title":[{"subtitle":"biology for the post-genomic era","title_sort":"Genome biology","title":"Genome biology"}],"origin":[{"publisher":"BioMed Central","dateIssuedDisp":"2000-","dateIssuedKey":"2000","publisherPlace":"London"}],"part":{"volume":"20","extent":"9","text":"20(2019) Artikel-Nummer 195, 9 Seiten","year":"2019"},"disp":"Reproducible biomedical benchmarking in the cloud lessons from crowd-sourced data challengesGenome biology","language":["eng"]}],"origin":[{"dateIssuedKey":"2019","dateIssuedDisp":"10 September 2019"}],"language":["eng"],"type":{"media":"Online-Ressource","bibl":"article-journal"}} 
SRT |a ELLROTTKYLREPRODUCIB1020