Statistical inference in sparse high-dimensional additive models

In this paper, we discuss the estimation of a nonparametric component f1 of a nonparametric additive model Y=f1(X1)+⋯+fq(Xq)+ϵ. We allow the number q of additive components to grow to infinity and we make sparsity assumptions about the number of nonzero additive components. We compare this estimatio...

Full description

Saved in:
Bibliographic Details
Main Authors: Gregory, Karl (Author) , Mammen, Enno (Author) , Wahl, Martin (Author)
Format: Article (Journal)
Language:English
Published: June 2021
In: The annals of statistics
Year: 2021, Volume: 49, Issue: 3, Pages: 1514-1536
ISSN:2168-8966
DOI:10.1214/20-AOS2011
Online Access:Verlag, lizenzpflichtig, Volltext: https://doi.org/10.1214/20-AOS2011
Verlag, lizenzpflichtig, Volltext: https://projecteuclid.org/journals/annals-of-statistics/volume-49/issue-3/Statistical-inference-in-sparse-high-dimensional-additive-models/10.1214/20-AOS2011.full
Get full text
Author Notes:Karl Gregory, Enno Mammen and Martin Wahl

MARC

LEADER 00000caa a2200000 c 4500
001 1813411689
003 DE-627
005 20230118162844.0
007 cr uuu---uuuuu
008 220808s2021 xx |||||o 00| ||eng c
024 7 |a 10.1214/20-AOS2011  |2 doi 
035 |a (DE-627)1813411689 
035 |a (DE-599)KXP1813411689 
035 |a (OCoLC)1361714485 
040 |a DE-627  |b ger  |c DE-627  |e rda 
041 |a eng 
084 |a 15  |2 sdnb 
100 1 |a Gregory, Karl  |e VerfasserIn  |0 (DE-588)1150875046  |0 (DE-627)1011134179  |0 (DE-576)497304384  |4 aut 
245 1 0 |a Statistical inference in sparse high-dimensional additive models  |c Karl Gregory, Enno Mammen and Martin Wahl 
264 1 |c June 2021 
300 |a 23 
336 |a Text  |b txt  |2 rdacontent 
337 |a Computermedien  |b c  |2 rdamedia 
338 |a Online-Ressource  |b cr  |2 rdacarrier 
500 |a Gesehen am 08.08.2022 
520 |a In this paper, we discuss the estimation of a nonparametric component f1 of a nonparametric additive model Y=f1(X1)+⋯+fq(Xq)+ϵ. We allow the number q of additive components to grow to infinity and we make sparsity assumptions about the number of nonzero additive components. We compare this estimation problem with that of estimating f1 in the oracle model Z=f1(X1)+ϵ, for which the additive components f2,…,fq are known. We construct a two-step presmoothing-and-resmoothing estimator of f1 and state finite-sample bounds for the difference between our estimator and a corresponding smoothing estimator fˆ1(oracle) in the oracle model. In an asymptotic setting, these bounds can be used to show asymptotic equivalence of our estimator and the oracle estimator; the paper thus shows that, asymptotically, under strong enough sparsity conditions, knowledge of f2,…,fq has no effect on estimation accuracy. Our first step is to estimate f1 with an undersmoothed estimator based on near-orthogonal projections with a group Lasso bias correction. In the second step, we construct pseudo responses Yˆ by evaluating this undersmoothed estimator of f1 at the design points and then apply the smoothing method of the oracle estimator fˆ1(oracle) to the nonparametric regression problem with “responses” Yˆ and covariates X1. Our mathematical exposition centers primarily on establishing properties of the presmoothing estimator. We present simulation results demonstrating close-to-oracle performance of our estimator in practical applications. 
650 4 |a 62G08 
650 4 |a 62G20 
650 4 |a Additive models 
650 4 |a bias correction 
650 4 |a Lasso 
650 4 |a near-orthogonality 
650 4 |a Nonparametric curve estimation 
700 1 |a Mammen, Enno  |d 1955-  |e VerfasserIn  |0 (DE-588)170668606  |0 (DE-627)060788658  |0 (DE-576)13153159X  |4 aut 
700 1 |a Wahl, Martin  |d 1983-  |e VerfasserIn  |0 (DE-588)1069853437  |0 (DE-627)822863480  |0 (DE-576)429549156  |4 aut 
773 0 8 |i Enthalten in  |t The annals of statistics  |d Hayward, Calif. : IMS Business Off., 1973  |g 49(2021), 3, Seite 1514-1536  |h Online-Ressource  |w (DE-627)270129162  |w (DE-600)1476670-X  |w (DE-576)094425213  |x 2168-8966  |7 nnas  |a Statistical inference in sparse high-dimensional additive models 
773 1 8 |g volume:49  |g year:2021  |g number:3  |g pages:1514-1536  |g extent:23  |a Statistical inference in sparse high-dimensional additive models 
856 4 0 |u https://doi.org/10.1214/20-AOS2011  |x Verlag  |x Resolving-System  |z lizenzpflichtig  |3 Volltext 
856 4 0 |u https://projecteuclid.org/journals/annals-of-statistics/volume-49/issue-3/Statistical-inference-in-sparse-high-dimensional-additive-models/10.1214/20-AOS2011.full  |x Verlag  |z lizenzpflichtig  |3 Volltext 
951 |a AR 
992 |a 20220808 
993 |a Article 
994 |a 2021 
998 |g 170668606  |a Mammen, Enno  |m 170668606:Mammen, Enno  |d 110000  |d 110200  |d 110000  |d 110400  |e 110000PM170668606  |e 110200PM170668606  |e 110000PM170668606  |e 110400PM170668606  |k 0/110000/  |k 1/110000/110200/  |k 0/110000/  |k 1/110000/110400/  |p 2 
999 |a KXP-PPN1813411689  |e 4176848715 
BIB |a Y 
SER |a journal 
JSO |a {"person":[{"role":"aut","given":"Karl","family":"Gregory","display":"Gregory, Karl"},{"given":"Enno","role":"aut","display":"Mammen, Enno","family":"Mammen"},{"given":"Martin","role":"aut","display":"Wahl, Martin","family":"Wahl"}],"type":{"bibl":"article-journal","media":"Online-Ressource"},"relHost":[{"origin":[{"publisher":"IMS Business Off.","dateIssuedDisp":"1973-","dateIssuedKey":"1973","publisherPlace":"Hayward, Calif."}],"language":["eng"],"recId":"270129162","note":["Gesehen am 08-06-21"],"pubHistory":["1.1973 - 23.1995; 24.1996 -"],"part":{"volume":"49","year":"2021","text":"49(2021), 3, Seite 1514-1536","extent":"23","issue":"3","pages":"1514-1536"},"disp":"Statistical inference in sparse high-dimensional additive modelsThe annals of statistics","corporate":[{"display":"Institute of Mathematical Statistics","role":"isb"}],"type":{"bibl":"periodical","media":"Online-Ressource"},"title":[{"subtitle":"an official journal of the Institute of Mathematical Statistics","title_sort":"annals of statistics","title":"The annals of statistics"}],"physDesc":[{"extent":"Online-Ressource"}],"id":{"zdb":["1476670-X"],"eki":["270129162"],"issn":["2168-8966"]}}],"title":[{"title_sort":"Statistical inference in sparse high-dimensional additive models","title":"Statistical inference in sparse high-dimensional additive models"}],"physDesc":[{"extent":"23 S."}],"id":{"doi":["10.1214/20-AOS2011"],"eki":["1813411689"]},"name":{"displayForm":["Karl Gregory, Enno Mammen and Martin Wahl"]},"origin":[{"dateIssuedDisp":"June 2021","dateIssuedKey":"2021"}],"recId":"1813411689","language":["eng"],"note":["Gesehen am 08.08.2022"]} 
SRT |a GREGORYKARSTATISTICA2021