Repository logo
 

A new computational framework for log-concave density estimation

Published version
Peer-reviewed

Repository DOI


Change log

Authors

Chen, Wenyu 
Mazumder, Rahul 
Samworth, Richard J 

Abstract

jats:titleAbstract</jats:title>jats:pIn statistics, log-concave density estimation is a central problem within the field of nonparametric inference under shape constraints. Despite great progress in recent years on the statistical theory of the canonical estimator, namely the log-concave maximum likelihood estimator, adoption of this method has been hampered by the complexities of the non-smooth convex optimization problem that underpins its computation. We provide enhanced understanding of the structural properties of this optimization problem, which motivates the proposal of new algorithms, based on both randomized and Nesterov smoothing, combined with an appropriate integral discretization of increasing accuracy. We prove that these methods enjoy, both with high probability and in expectation, a convergence rate of order 1/jats:italicT</jats:italic> up to logarithmic factors on the objective function scale, where jats:italicT</jats:italic> denotes the number of iterations. The benefits of our new computational framework are demonstrated on both synthetic and real data, and our implementation is available in a github repository (Log-Concave Computation).</jats:p>

Description

Acknowledgements: The authors acknowledge MIT SuperCloud and Lincoln Laboratory Supercomputing Center for providing HPC resources that have contributed to the research results reported within this paper. We also thank the anonymous reviewers for constructive comments on an earlier version that helped to improve this paper.


Funder: Massachusetts Institute of Technology (MIT)

Keywords

math.OC, stat.CO, stat.CO, stat.ME

Journal Title

Mathematical Programming Computation

Conference Name

Journal ISSN

1867-2949
1867-2957

Volume Title

16

Publisher

Springer Science and Business Media LLC
Sponsorship
European Commission Horizon 2020 (H2020) ERC (101019498)
Engineering and Physical Sciences Research Council (EP/P031447/1)
Engineering and Physical Sciences Research Council (EP/N031938/1)