Forecast dominance testing via sign randomization

We propose randomization tests of whether forecast 1 outperforms forecast 2 across a class of scoring functions. This hypothesis is of applied interest: While the prediction context often prescribes a certain class of scoring functions, it is typically hard to motivate a specific choice on statistic...

Ausführliche Beschreibung

Gespeichert in:
Bibliographische Detailangaben
Hauptverfasser: Ehm, Werner (VerfasserIn) , Krüger, Fabian (VerfasserIn)
Dokumenttyp: Article (Journal)
Sprache:Englisch
Veröffentlicht: 2018
In: Electronic journal of statistics
Year: 2018, Jahrgang: 12, Heft: 2, Pages: 3758-3793
ISSN:1935-7524
DOI:10.1214/18-EJS1495
Online-Zugang:Verlag, Volltext: https://doi.org/10.1214/18-EJS1495
Verlag, Volltext: https://projecteuclid.org/euclid.ejs/1543374044
Volltext
Verfasserangaben:Werner Ehm and Fabian Krüger

MARC

LEADER 00000caa a2200000 c 4500
001 1669087778
003 DE-627
005 20220816191448.0
007 cr uuu---uuuuu
008 190712s2018 xx |||||o 00| ||eng c
024 7 |a 10.1214/18-EJS1495  |2 doi 
035 |a (DE-627)1669087778 
035 |a (DE-599)KXP1669087778 
035 |a (OCoLC)1341233438 
040 |a DE-627  |b ger  |c DE-627  |e rda 
041 |a eng 
084 |a 27  |2 sdnb 
100 1 |a Ehm, Werner  |e VerfasserIn  |0 (DE-588)1153362996  |0 (DE-627)101477392X  |0 (DE-576)167451197  |4 aut 
245 1 0 |a Forecast dominance testing via sign randomization  |c Werner Ehm and Fabian Krüger 
264 1 |c 2018 
300 |a 36 
336 |a Text  |b txt  |2 rdacontent 
337 |a Computermedien  |b c  |2 rdamedia 
338 |a Online-Ressource  |b cr  |2 rdacarrier 
500 |a Gesehen am 12.07.2019 
520 |a We propose randomization tests of whether forecast 1 outperforms forecast 2 across a class of scoring functions. This hypothesis is of applied interest: While the prediction context often prescribes a certain class of scoring functions, it is typically hard to motivate a specific choice on statistical or substantive grounds. We investigate the asymptotic behavior of the test statistics under mild conditions, avoiding the need to assume particular dynamic properties of forecasts and realizations. The properties of the one-sided tests depend on a corresponding version of Anderson’s inequality, which we state as a conjecture of independent interest. Numerical experiments and a data example indicate that the tests have good size and power properties in practically relevant situations. 
650 4 |a Comparative forecast evaluation 
650 4 |a hypothesis testing 
650 4 |a randomization 
700 1 |a Krüger, Fabian  |e VerfasserIn  |0 (DE-588)1047560887  |0 (DE-627)778555887  |0 (DE-576)401160637  |4 aut 
773 0 8 |i Enthalten in  |t Electronic journal of statistics  |d Ithaca, NY : Cornell University Library, 2007  |g 12(2018), 2, Seite 3758-3793  |h Online-Ressource  |w (DE-627)538998830  |w (DE-600)2381001-4  |w (DE-576)28134714X  |x 1935-7524  |7 nnas  |a Forecast dominance testing via sign randomization 
773 1 8 |g volume:12  |g year:2018  |g number:2  |g pages:3758-3793  |g extent:36  |a Forecast dominance testing via sign randomization 
856 4 0 |u https://doi.org/10.1214/18-EJS1495  |x Verlag  |x Resolving-System  |3 Volltext 
856 4 0 |u https://projecteuclid.org/euclid.ejs/1543374044  |x Verlag  |3 Volltext 
951 |a AR 
992 |a 20190712 
993 |a Article 
994 |a 2019 
998 |g 1047560887  |a Krüger, Fabian  |m 1047560887:Krüger, Fabian  |d 180000  |d 181000  |e 180000PK1047560887  |e 181000PK1047560887  |k 0/180000/  |k 1/180000/181000/  |p 2  |y j 
998 |g 1153362996  |a Ehm, Werner  |m 1153362996:Ehm, Werner  |p 1  |x j 
999 |a KXP-PPN1669087778  |e 3492946488 
BIB |a Y 
SER |a journal 
JSO |a {"name":{"displayForm":["Werner Ehm and Fabian Krüger"]},"origin":[{"dateIssuedDisp":"2018","dateIssuedKey":"2018"}],"id":{"doi":["10.1214/18-EJS1495"],"eki":["1669087778"]},"physDesc":[{"extent":"36 S."}],"relHost":[{"title":[{"subtitle":"EJS","title":"Electronic journal of statistics","title_sort":"Electronic journal of statistics"}],"disp":"Forecast dominance testing via sign randomizationElectronic journal of statistics","type":{"bibl":"periodical","media":"Online-Ressource"},"language":["eng"],"recId":"538998830","pubHistory":["1.2007 -"],"part":{"issue":"2","pages":"3758-3793","year":"2018","extent":"36","volume":"12","text":"12(2018), 2, Seite 3758-3793"},"titleAlt":[{"title":"EJS"}],"origin":[{"publisherPlace":"Ithaca, NY","dateIssuedDisp":"2007-","dateIssuedKey":"2007","publisher":"Cornell University Library"}],"id":{"issn":["1935-7524"],"zdb":["2381001-4"],"eki":["538998830"]},"physDesc":[{"extent":"Online-Ressource"}]}],"person":[{"roleDisplay":"VerfasserIn","display":"Ehm, Werner","role":"aut","family":"Ehm","given":"Werner"},{"display":"Krüger, Fabian","roleDisplay":"VerfasserIn","role":"aut","family":"Krüger","given":"Fabian"}],"title":[{"title":"Forecast dominance testing via sign randomization","title_sort":"Forecast dominance testing via sign randomization"}],"type":{"media":"Online-Ressource","bibl":"article-journal"},"note":["Gesehen am 12.07.2019"],"recId":"1669087778","language":["eng"]} 
SRT |a EHMWERNERKFORECASTDO2018