On the entropy and information of Gaussian mixtures
Published version
Peer-reviewed
Repository URI
Repository DOI
Change log
Authors
Abstract
jats:titleAbstract</jats:title>jats:pWe establish several convexity properties for the entropy and Fisher information of mixtures of centred Gaussian distributions. Firstly, we prove that if are independent scalar Gaussian mixtures, then the entropy of is concave in , thus confirming a conjecture of Ball, Nayar and Tkocz (2016) for this class of random variables. In fact, we prove a generalisation of this assertion which also strengthens a result of Eskenazis, Nayar and Tkocz (2018). For the Fisher information, we extend a convexity result of Bobkov (2022) by showing that the Fisher information matrix is operator convex as a matrix‐valued function acting on densities of mixtures in . As an application, we establish rates for the convergence of the Fisher information matrix of the sum of weighted i.i.d. Gaussian mixtures in the operator norm along the central limit theorem under mild moment assumptions.</jats:p>
Description
Publication status: Published
Keywords
Journal Title
Conference Name
Journal ISSN
2041-7942
Volume Title
Publisher
Publisher DOI
Sponsorship
ANR (ANR‐10‐LABX‐58)