Efficient functional Lasso kernel smoothing for high-dimensional additive regression

Smooth backfitting has been proposed and proved as a powerful nonparametric estimation technique for additive regression models in various settings. Existing studies are restricted to cases with a moderate number of covariates and are not directly applicable to high dimensional settings. In this pap...

Ausführliche Beschreibung

Gespeichert in:
Bibliographische Detailangaben
Hauptverfasser: Lee, Eun Ryung (VerfasserIn) , Park, Seyoung (VerfasserIn) , Mammen, Enno (VerfasserIn) , Park, Byeong U. (VerfasserIn)
Dokumenttyp: Article (Journal)
Sprache:Englisch
Veröffentlicht: August 2024
In: The annals of statistics
Year: 2024, Jahrgang: 52, Heft: 4, Pages: 1741-1773
ISSN:2168-8966
DOI:10.1214/24-AOS2415
Online-Zugang:Verlag, kostenfrei, Volltext: https://doi.org/10.1214/24-AOS2415
Verlag, kostenfrei, Volltext: https://projecteuclid.org/journals/annals-of-statistics/volume-52/issue-4/Efficient-functional-Lasso-kernel-smoothing-for-high-dimensional-additive-regression/10.1214/24-AOS2415.full
Volltext
Verfasserangaben:Eun Ryung Lee, Seyoung Park, Enno Mammen and Byeong U. Park
Beschreibung
Zusammenfassung:Smooth backfitting has been proposed and proved as a powerful nonparametric estimation technique for additive regression models in various settings. Existing studies are restricted to cases with a moderate number of covariates and are not directly applicable to high dimensional settings. In this paper, we develop new kernel estimators based on the idea of smooth backfitting for high dimensional additive models. We introduce a novel penalization scheme, combining the idea of functional Lasso with the smooth backfitting technique. We investigate the theoretical properties of the functional Lasso smooth backfitting estimation. For the implementation of the proposed method, we devise a simple iterative algorithm where the iteration is defined by a truncated projection operator. The algorithm has only an additional thresholding operator over the projection-based iteration of the smooth backfitting algorithm. We further present a debiased version of the proposed estimator with implementation details, and investigate its theoretical properties for statistical inference. We demonstrate the finite sample performance of the methods via simulation and real data analysis.
Beschreibung:Gesehen am 28.04.2025
Beschreibung:Online Resource
ISSN:2168-8966
DOI:10.1214/24-AOS2415