Model diagnostics and forecast evaluation for quantiles
Model diagnostics and forecast evaluation are closely related tasks, with the former concerning in-sample goodness (or lack) of fit and the latter addressing predictive performance out-of-sample. We review the ubiquitous setting in which forecasts are cast in the form of quantiles or quantile-bounde...
Gespeichert in:
| Hauptverfasser: | , , , , , , , , , , |
|---|---|
| Dokumenttyp: | Article (Journal) |
| Sprache: | Englisch |
| Veröffentlicht: |
March 2023
|
| In: |
Annual review of statistics and its application
Year: 2023, Jahrgang: 10, Pages: 597-621 |
| ISSN: | 2326-831X |
| DOI: | 10.1146/annurev-statistics-032921-020240 |
| Online-Zugang: | Verlag, kostenfrei, Volltext: https://doi.org/10.1146/annurev-statistics-032921-020240
|
| Verfasserangaben: | Tilmann Gneiting, Daniel Wolffram, Johannes Resin, Kristof Kraus, Johannes Bracher, Timo Dimitriadis, Veit Hagenmeyer, Alexander I. Jordan, Sebastian Lerch, Kaleb Phipps, and Melanie Schienle |
MARC
| LEADER | 00000caa a2200000 c 4500 | ||
|---|---|---|---|
| 001 | 1846254590 | ||
| 003 | DE-627 | ||
| 005 | 20250113000847.0 | ||
| 007 | cr uuu---uuuuu | ||
| 008 | 230526s2023 xx |||||o 00| ||eng c | ||
| 024 | 7 | |a 10.1146/annurev-statistics-032921-020240 |2 doi | |
| 035 | |a (DE-627)1846254590 | ||
| 035 | |a (DE-599)KXP1846254590 | ||
| 035 | |a (OCoLC)1389529919 | ||
| 040 | |a DE-627 |b ger |c DE-627 |e rda | ||
| 041 | |a eng | ||
| 084 | |a 17 |2 sdnb | ||
| 100 | 1 | |a Gneiting, Tilmann |e VerfasserIn |0 (DE-588)1019627484 |0 (DE-627)690974809 |0 (DE-576)358470323 |4 aut | |
| 245 | 1 | 0 | |a Model diagnostics and forecast evaluation for quantiles |c Tilmann Gneiting, Daniel Wolffram, Johannes Resin, Kristof Kraus, Johannes Bracher, Timo Dimitriadis, Veit Hagenmeyer, Alexander I. Jordan, Sebastian Lerch, Kaleb Phipps, and Melanie Schienle |
| 264 | 1 | |c March 2023 | |
| 300 | |a 28 | ||
| 336 | |a Text |b txt |2 rdacontent | ||
| 337 | |a Computermedien |b c |2 rdamedia | ||
| 338 | |a Online-Ressource |b cr |2 rdacarrier | ||
| 500 | |a Zuerst veröffentlicht als "Review in Advance" am 01. November 2022 | ||
| 500 | |a Gesehen am 26.05.2023 | ||
| 520 | |a Model diagnostics and forecast evaluation are closely related tasks, with the former concerning in-sample goodness (or lack) of fit and the latter addressing predictive performance out-of-sample. We review the ubiquitous setting in which forecasts are cast in the form of quantiles or quantile-bounded prediction intervals. We distinguish unconditional calibration, which corresponds to classical coverage criteria, from the stronger notion of conditional calibration, as can be visualized in quantile reliability diagrams. Consistent scoring functions—including, but not limited to, the widely used asymmetricpiecewise linear score or pinball loss—provide for comparative assessment and ranking, and link to the coefficient of determination and skill scores. We illustrate the use of these tools on Engel's food expenditure data, the Global Energy Forecasting Competition 2014, and the US COVID-19 Forecast Hub. | ||
| 650 | 4 | |a calibration | |
| 650 | 4 | |a coverage plot | |
| 650 | 4 | |a Murphy diagram | |
| 650 | 4 | |a quantile regression | |
| 650 | 4 | |a reliability diagram | |
| 650 | 4 | |a scoring function | |
| 700 | 1 | |a Wolffram, Daniel |e VerfasserIn |4 aut | |
| 700 | 1 | |a Resin, Johannes |e VerfasserIn |0 (DE-588)1286759269 |0 (DE-627)1843351706 |4 aut | |
| 700 | 1 | |a Kraus, Kristof |e VerfasserIn |4 aut | |
| 700 | 1 | |a Bracher, Johannes |e VerfasserIn |4 aut | |
| 700 | 1 | |a Dimitriadis, Timo |e VerfasserIn |0 (DE-588)1230883045 |0 (DE-627)1753224217 |4 aut | |
| 700 | 1 | |a Hagenmeyer, Veit |d 1967- |e VerfasserIn |0 (DE-588)1093877545 |0 (DE-627)853895597 |0 (DE-576)462784916 |4 aut | |
| 700 | 1 | |a Jordan, Alexander I. |e VerfasserIn |0 (DE-588)1027203264 |0 (DE-627)72857747X |0 (DE-576)372589928 |4 aut | |
| 700 | 1 | |a Lerch, Sebastian |e VerfasserIn |0 (DE-588)1103840096 |0 (DE-627)86156636X |0 (DE-576)47079321X |4 aut | |
| 700 | 1 | |a Phipps, Kaleb |e VerfasserIn |4 aut | |
| 700 | 1 | |8 1\p |a Schienle, Melanie |d 1979- |e VerfasserIn |0 (DE-588)135794587 |0 (DE-627)571661068 |0 (DE-576)282689567 |4 aut | |
| 773 | 0 | 8 | |i Enthalten in |t Annual review of statistics and its application |d Palo Alto, Calif. : Annual Reviews, 2014 |g 10(2023) vom: März, Seite 597-621 |h Online-Ressource |w (DE-627)776633244 |w (DE-600)2750272-7 |w (DE-576)399753427 |x 2326-831X |7 nnas |a Model diagnostics and forecast evaluation for quantiles |
| 773 | 1 | 8 | |g volume:10 |g year:2023 |g month:03 |g pages:597-621 |g extent:28 |a Model diagnostics and forecast evaluation for quantiles |
| 856 | 4 | 0 | |u https://doi.org/10.1146/annurev-statistics-032921-020240 |x Verlag |x Resolving-System |z kostenfrei |3 Volltext |
| 883 | |8 1\p |a cgwrk |d 20241001 |q DE-101 |u https://d-nb.info/provenance/plan#cgwrk | ||
| 951 | |a AR | ||
| 992 | |a 20230526 | ||
| 993 | |a Article | ||
| 994 | |a 2023 | ||
| 998 | |g 1230883045 |a Dimitriadis, Timo |m 1230883045:Dimitriadis, Timo |d 180000 |d 181000 |e 180000PD1230883045 |e 181000PD1230883045 |k 0/180000/ |k 1/180000/181000/ |p 6 | ||
| 998 | |g 1286759269 |a Resin, Johannes |m 1286759269:Resin, Johannes |d 180000 |d 181000 |e 180000PR1286759269 |e 181000PR1286759269 |k 0/180000/ |k 1/180000/181000/ |p 3 | ||
| 998 | |g 1019627484 |a Gneiting, Tilmann |m 1019627484:Gneiting, Tilmann |p 1 |x j | ||
| 999 | |a KXP-PPN1846254590 |e 432548129X | ||
| BIB | |a Y | ||
| SER | |a journal | ||
| JSO | |a {"physDesc":[{"extent":"28 S."}],"relHost":[{"physDesc":[{"extent":"Online-Ressource"}],"id":{"issn":["2326-831X"],"zdb":["2750272-7"],"eki":["776633244"]},"origin":[{"publisher":"Annual Reviews","dateIssuedKey":"2014","dateIssuedDisp":"2014-","publisherPlace":"Palo Alto, Calif."}],"recId":"776633244","language":["eng"],"disp":"Model diagnostics and forecast evaluation for quantilesAnnual review of statistics and its application","type":{"bibl":"periodical","media":"Online-Ressource"},"note":["Gesehen am 13.01.14"],"part":{"text":"10(2023) vom: März, Seite 597-621","volume":"10","extent":"28","year":"2023","pages":"597-621"},"pubHistory":["1.2014 -"],"title":[{"title_sort":"Annual review of statistics and its application","title":"Annual review of statistics and its application"}]}],"origin":[{"dateIssuedDisp":"March 2023","dateIssuedKey":"2023"}],"id":{"doi":["10.1146/annurev-statistics-032921-020240"],"eki":["1846254590"]},"name":{"displayForm":["Tilmann Gneiting, Daniel Wolffram, Johannes Resin, Kristof Kraus, Johannes Bracher, Timo Dimitriadis, Veit Hagenmeyer, Alexander I. Jordan, Sebastian Lerch, Kaleb Phipps, and Melanie Schienle"]},"type":{"bibl":"article-journal","media":"Online-Ressource"},"note":["Zuerst veröffentlicht als \"Review in Advance\" am 01. November 2022","Gesehen am 26.05.2023"],"language":["eng"],"recId":"1846254590","title":[{"title":"Model diagnostics and forecast evaluation for quantiles","title_sort":"Model diagnostics and forecast evaluation for quantiles"}],"person":[{"family":"Gneiting","given":"Tilmann","roleDisplay":"VerfasserIn","display":"Gneiting, Tilmann","role":"aut"},{"role":"aut","roleDisplay":"VerfasserIn","display":"Wolffram, Daniel","given":"Daniel","family":"Wolffram"},{"display":"Resin, Johannes","roleDisplay":"VerfasserIn","role":"aut","family":"Resin","given":"Johannes"},{"given":"Kristof","family":"Kraus","role":"aut","display":"Kraus, Kristof","roleDisplay":"VerfasserIn"},{"roleDisplay":"VerfasserIn","display":"Bracher, Johannes","role":"aut","family":"Bracher","given":"Johannes"},{"display":"Dimitriadis, Timo","roleDisplay":"VerfasserIn","role":"aut","family":"Dimitriadis","given":"Timo"},{"family":"Hagenmeyer","given":"Veit","display":"Hagenmeyer, Veit","roleDisplay":"VerfasserIn","role":"aut"},{"display":"Jordan, Alexander I.","roleDisplay":"VerfasserIn","role":"aut","family":"Jordan","given":"Alexander I."},{"given":"Sebastian","family":"Lerch","role":"aut","display":"Lerch, Sebastian","roleDisplay":"VerfasserIn"},{"display":"Phipps, Kaleb","roleDisplay":"VerfasserIn","role":"aut","family":"Phipps","given":"Kaleb"},{"display":"Schienle, Melanie","roleDisplay":"VerfasserIn","role":"aut","family":"Schienle","given":"Melanie"}]} | ||
| SRT | |a GNEITINGTIMODELDIAGN2023 | ||