Variable selection, monotone likelihood ratio and group sparsity

In the pivotal variable selection problem, we derive the exact nonasymptotic minimax selector over the class of all s-sparse vectors, which is also the Bayes selector with respect to the uniform prior. While this optimal selector is, in general, not realizable in polynomial time, we show that its tr...

Ausführliche Beschreibung

Gespeichert in:
Bibliographische Detailangaben
Hauptverfasser: Butucea, Cristina (VerfasserIn) , Mammen, Enno (VerfasserIn) , Ndaoud, Mohamed (VerfasserIn) , Tsybakov, Alexandre B. (VerfasserIn)
Dokumenttyp: Article (Journal)
Sprache:Englisch
Veröffentlicht: February 2023
In: The annals of statistics
Year: 2023, Jahrgang: 51, Heft: 1, Pages: 312-333
ISSN:2168-8966
DOI:10.1214/22-AOS2251
Online-Zugang:Verlag, lizenzpflichtig, Volltext: https://doi.org/10.1214/22-AOS2251
Verlag, lizenzpflichtig, Volltext: https://projecteuclid.org/journals/annals-of-statistics/volume-51/issue-1/Variable-selection-monotone-likelihood-ratio-and-group-sparsity/10.1214/22-AOS2251.full
Volltext
Verfasserangaben:Cristina Butucea, Enno Mammen, Mohamed Ndaoud, Alexandre B. Tsybakov
Beschreibung
Zusammenfassung:In the pivotal variable selection problem, we derive the exact nonasymptotic minimax selector over the class of all s-sparse vectors, which is also the Bayes selector with respect to the uniform prior. While this optimal selector is, in general, not realizable in polynomial time, we show that its tractable counterpart (the scan selector) attains the minimax expected Hamming risk to within factor 2, and is also exact minimax with respect to the probability of wrong recovery. As a consequence, we establish explicit lower bounds under the monotone likelihood ratio property and we obtain a tight characterization of the minimax risk in terms of the best separable selector risk. We apply these general results to derive necessary and sufficient conditions of exact and almost full recovery in the location model with light tail distributions and in the problem of group variable selection under Gaussian noise and under more general anisotropic sub-Gaussian noise. Numerical results illustrate our theoretical findings.
Beschreibung:Gesehen am 18.08.2023
Beschreibung:Online Resource
ISSN:2168-8966
DOI:10.1214/22-AOS2251