Statistical inference in sparse high-dimensional additive models

In this paper, we discuss the estimation of a nonparametric component f1 of a nonparametric additive model Y=f1(X1)+⋯+fq(Xq)+ϵ. We allow the number q of additive components to grow to infinity and we make sparsity assumptions about the number of nonzero additive components. We compare this estimatio...

Ausführliche Beschreibung

Gespeichert in:
Bibliographische Detailangaben
Hauptverfasser: Gregory, Karl (VerfasserIn) , Mammen, Enno (VerfasserIn) , Wahl, Martin (VerfasserIn)
Dokumenttyp: Article (Journal)
Sprache:Englisch
Veröffentlicht: June 2021
In: The annals of statistics
Year: 2021, Jahrgang: 49, Heft: 3, Pages: 1514-1536
ISSN:2168-8966
DOI:10.1214/20-AOS2011
Online-Zugang:Verlag, lizenzpflichtig, Volltext: https://doi.org/10.1214/20-AOS2011
Verlag, lizenzpflichtig, Volltext: https://projecteuclid.org/journals/annals-of-statistics/volume-49/issue-3/Statistical-inference-in-sparse-high-dimensional-additive-models/10.1214/20-AOS2011.full
Volltext
Verfasserangaben:Karl Gregory, Enno Mammen and Martin Wahl

MARC

LEADER 00000caa a2200000 c 4500
001 1813411689
003 DE-627
005 20230118162844.0
007 cr uuu---uuuuu
008 220808s2021 xx |||||o 00| ||eng c
024 7 |a 10.1214/20-AOS2011  |2 doi 
035 |a (DE-627)1813411689 
035 |a (DE-599)KXP1813411689 
035 |a (OCoLC)1361714485 
040 |a DE-627  |b ger  |c DE-627  |e rda 
041 |a eng 
084 |a 15  |2 sdnb 
100 1 |a Gregory, Karl  |e VerfasserIn  |0 (DE-588)1150875046  |0 (DE-627)1011134179  |0 (DE-576)497304384  |4 aut 
245 1 0 |a Statistical inference in sparse high-dimensional additive models  |c Karl Gregory, Enno Mammen and Martin Wahl 
264 1 |c June 2021 
300 |a 23 
336 |a Text  |b txt  |2 rdacontent 
337 |a Computermedien  |b c  |2 rdamedia 
338 |a Online-Ressource  |b cr  |2 rdacarrier 
500 |a Gesehen am 08.08.2022 
520 |a In this paper, we discuss the estimation of a nonparametric component f1 of a nonparametric additive model Y=f1(X1)+⋯+fq(Xq)+ϵ. We allow the number q of additive components to grow to infinity and we make sparsity assumptions about the number of nonzero additive components. We compare this estimation problem with that of estimating f1 in the oracle model Z=f1(X1)+ϵ, for which the additive components f2,…,fq are known. We construct a two-step presmoothing-and-resmoothing estimator of f1 and state finite-sample bounds for the difference between our estimator and a corresponding smoothing estimator fˆ1(oracle) in the oracle model. In an asymptotic setting, these bounds can be used to show asymptotic equivalence of our estimator and the oracle estimator; the paper thus shows that, asymptotically, under strong enough sparsity conditions, knowledge of f2,…,fq has no effect on estimation accuracy. Our first step is to estimate f1 with an undersmoothed estimator based on near-orthogonal projections with a group Lasso bias correction. In the second step, we construct pseudo responses Yˆ by evaluating this undersmoothed estimator of f1 at the design points and then apply the smoothing method of the oracle estimator fˆ1(oracle) to the nonparametric regression problem with “responses” Yˆ and covariates X1. Our mathematical exposition centers primarily on establishing properties of the presmoothing estimator. We present simulation results demonstrating close-to-oracle performance of our estimator in practical applications. 
650 4 |a 62G08 
650 4 |a 62G20 
650 4 |a Additive models 
650 4 |a bias correction 
650 4 |a Lasso 
650 4 |a near-orthogonality 
650 4 |a Nonparametric curve estimation 
700 1 |a Mammen, Enno  |d 1955-  |e VerfasserIn  |0 (DE-588)170668606  |0 (DE-627)060788658  |0 (DE-576)13153159X  |4 aut 
700 1 |a Wahl, Martin  |d 1983-  |e VerfasserIn  |0 (DE-588)1069853437  |0 (DE-627)822863480  |0 (DE-576)429549156  |4 aut 
773 0 8 |i Enthalten in  |t The annals of statistics  |d Hayward, Calif. : IMS Business Off., 1973  |g 49(2021), 3, Seite 1514-1536  |h Online-Ressource  |w (DE-627)270129162  |w (DE-600)1476670-X  |w (DE-576)094425213  |x 2168-8966  |7 nnas  |a Statistical inference in sparse high-dimensional additive models 
773 1 8 |g volume:49  |g year:2021  |g number:3  |g pages:1514-1536  |g extent:23  |a Statistical inference in sparse high-dimensional additive models 
856 4 0 |u https://doi.org/10.1214/20-AOS2011  |x Verlag  |x Resolving-System  |z lizenzpflichtig  |3 Volltext 
856 4 0 |u https://projecteuclid.org/journals/annals-of-statistics/volume-49/issue-3/Statistical-inference-in-sparse-high-dimensional-additive-models/10.1214/20-AOS2011.full  |x Verlag  |z lizenzpflichtig  |3 Volltext 
951 |a AR 
992 |a 20220808 
993 |a Article 
994 |a 2021 
998 |g 170668606  |a Mammen, Enno  |m 170668606:Mammen, Enno  |d 110000  |d 110200  |d 110000  |d 110400  |e 110000PM170668606  |e 110200PM170668606  |e 110000PM170668606  |e 110400PM170668606  |k 0/110000/  |k 1/110000/110200/  |k 0/110000/  |k 1/110000/110400/  |p 2 
999 |a KXP-PPN1813411689  |e 4176848715 
BIB |a Y 
SER |a journal 
JSO |a {"language":["eng"],"note":["Gesehen am 08.08.2022"],"physDesc":[{"extent":"23 S."}],"relHost":[{"part":{"text":"49(2021), 3, Seite 1514-1536","extent":"23","volume":"49","pages":"1514-1536","year":"2021","issue":"3"},"type":{"media":"Online-Ressource","bibl":"periodical"},"title":[{"title_sort":"annals of statistics","title":"The annals of statistics","subtitle":"an official journal of the Institute of Mathematical Statistics"}],"recId":"270129162","id":{"issn":["2168-8966"],"zdb":["1476670-X"],"eki":["270129162"]},"pubHistory":["1.1973 - 23.1995; 24.1996 -"],"physDesc":[{"extent":"Online-Ressource"}],"note":["Gesehen am 08-06-21"],"language":["eng"],"disp":"Statistical inference in sparse high-dimensional additive modelsThe annals of statistics","corporate":[{"roleDisplay":"Herausgebendes Organ","display":"Institute of Mathematical Statistics","role":"isb"}],"origin":[{"dateIssuedKey":"1973","dateIssuedDisp":"1973-","publisherPlace":"Hayward, Calif.","publisher":"IMS Business Off."}]}],"origin":[{"dateIssuedKey":"2021","dateIssuedDisp":"June 2021"}],"title":[{"title_sort":"Statistical inference in sparse high-dimensional additive models","title":"Statistical inference in sparse high-dimensional additive models"}],"person":[{"role":"aut","family":"Gregory","display":"Gregory, Karl","roleDisplay":"VerfasserIn","given":"Karl"},{"role":"aut","given":"Enno","roleDisplay":"VerfasserIn","display":"Mammen, Enno","family":"Mammen"},{"role":"aut","family":"Wahl","roleDisplay":"VerfasserIn","given":"Martin","display":"Wahl, Martin"}],"type":{"media":"Online-Ressource","bibl":"article-journal"},"name":{"displayForm":["Karl Gregory, Enno Mammen and Martin Wahl"]},"recId":"1813411689","id":{"doi":["10.1214/20-AOS2011"],"eki":["1813411689"]}} 
SRT |a GREGORYKARSTATISTICA2021