PuSH - Publication Server of Helmholtz Zentrum München

Combettes, P.L.* ; Müller, C.L.

Perspective maximum likelihood-type estimation via proximal decomposition.

Electron. J. Statist. 14, 207-238 (2020)
Publ. Version/Full Text DOI
Free journal
Creative Commons Lizenzvertrag
Open Access Green as soon as Postprint is submitted to ZB.
We introduce a flexible optimization model for maximum likelihood-type estimation (M-estimation) that encompasses and generalizes a large class of existing statistical models, including Huber’s concomitant M-estimator, Owen’s Huber/Berhu concomitant estimator, the scaled lasso, support vector machine regression, and penalized estimation with structured sparsity. The model, termed perspective M-estimation, leverages the observation that convex M-estimators with concomitant scale as well as various regularizers are instances of perspective functions, a construction that extends a convex function to a jointly convex one in terms of an additional scale variable. These nonsmooth functions are shown to be amenable to proximal analysis, which leads to principled and provably convergent optimization algorithms via proximal splitting. We derive novel proximity operators for several perspective functions of interest via a geometrical approach based on duality. We then devise a new proximal splitting algorithm to solve the proposed M-estimation problem and establish the convergence of both the scale and regression iterates it produces to a solution. Numerical experiments on synthetic and real-world data illustrate the broad applicability of the proposed framework.
Altmetric
Additional Metrics?
[➜Log in]
Edit extra informations Login
Publication type Article: Journal article
Document type Scientific Article
Corresponding Author
Keywords Concomitant M-estimator ; Convex Optimization ; Heteroscedastic Model ; Perspective Function ; Proximal Algorithm ; Robust Regression
ISSN (print) / ISBN 1935-7524
e-ISSN 1935-7524
Journal Electronic Journal of Statistics
Quellenangaben Volume: 14, Issue: 1, Pages: 207-238 Article Number: , Supplement: ,
Publisher Cornell University Library
Non-patent literature Publications
Reviewing status Peer reviewed
Institute(s) Institute of Computational Biology (ICB)