Efficient functional Lasso kernel smoothing for high-dimensional additive regression
Smooth backfitting has been proposed and proved as a powerful nonparametric estimation technique for additive regression models in various settings. Existing studies are restricted to cases with a moderate number of covariates and are not directly applicable to high dimensional settings. In this pap...
Saved in:
| Main Authors: | , , , |
|---|---|
| Format: | Article (Journal) |
| Language: | English |
| Published: |
August 2024
|
| In: |
The annals of statistics
Year: 2024, Volume: 52, Issue: 4, Pages: 1741-1773 |
| ISSN: | 2168-8966 |
| DOI: | 10.1214/24-AOS2415 |
| Online Access: | Verlag, kostenfrei, Volltext: https://doi.org/10.1214/24-AOS2415 Verlag, kostenfrei, Volltext: https://projecteuclid.org/journals/annals-of-statistics/volume-52/issue-4/Efficient-functional-Lasso-kernel-smoothing-for-high-dimensional-additive-regression/10.1214/24-AOS2415.full 
|
| Author Notes: | Eun Ryung Lee, Seyoung Park, Enno Mammen and Byeong U. Park |
| Summary: | Smooth backfitting has been proposed and proved as a powerful nonparametric estimation technique for additive regression models in various settings. Existing studies are restricted to cases with a moderate number of covariates and are not directly applicable to high dimensional settings. In this paper, we develop new kernel estimators based on the idea of smooth backfitting for high dimensional additive models. We introduce a novel penalization scheme, combining the idea of functional Lasso with the smooth backfitting technique. We investigate the theoretical properties of the functional Lasso smooth backfitting estimation. For the implementation of the proposed method, we devise a simple iterative algorithm where the iteration is defined by a truncated projection operator. The algorithm has only an additional thresholding operator over the projection-based iteration of the smooth backfitting algorithm. We further present a debiased version of the proposed estimator with implementation details, and investigate its theoretical properties for statistical inference. We demonstrate the finite sample performance of the methods via simulation and real data analysis. |
|---|---|
| Item Description: | Gesehen am 28.04.2025 |
| Physical Description: | Online Resource |
| ISSN: | 2168-8966 |
| DOI: | 10.1214/24-AOS2415 |