Repository logo
 

A strong converse bound for multiple hypothesis testing, with applications to high-dimensional estimation

Published version
Peer-reviewed

Type

Article

Change log

Authors

Venkataramanan, Ramji  ORCID logo  https://orcid.org/0000-0001-7915-5432
Johnson, Oliver 

Abstract

In statistical inference problems, we wish to obtain lower bounds on the minimax risk, that is to bound the performance of any possible estimator. A standard technique to do this involves the use of Fano's inequality. However, recent work in an information-theoretic setting has shown that an argument based on binary hypothesis testing gives tighter converse results (error lower bounds) than Fano for channel coding problems. We adapt this technique to the statistical setting, and argue that Fano's inequality can always be replaced by this approach to obtain tighter lower bounds that can be easily computed and are asymptotically sharp. We illustrate our technique in three applications: density estimation, active learning of a binary classifier, and compressed sensing, obtaining tighter risk lower bounds in each case.

Description

Keywords

Journal Title

Electronic Journal of Statistics

Conference Name

Journal ISSN

Volume Title

12

Publisher

Institute of Mathematical Statistics
Sponsorship
European Commission (631489)