Title :
Lower Bounds for the Minimax Risk Using
-Divergences, and Applications
Author :
Guntuboyina, Adityanand
Author_Institution :
Dept. of Stat., Yale Univ., New Haven, CT, USA
fDate :
4/1/2011 12:00:00 AM
Abstract :
Lower bounds involving f-divergences between the underlying probability measures are proved for the minimax risk in estimation problems. Our proofs just use simple convexity facts. Special cases and straightforward corollaries of our bounds include well known inequalities for establishing minimax lower bounds such as Fano´s inequality, Pinsker´s inequality and inequalities based on global entropy conditions. Two applications are provided: a new minimax lower bound for the reconstruction of convex bodies from noisy support function measurements and a different proof of a recent minimax lower bound for the estimation of a covariance matrix.
Keywords :
convex programming; covariance matrices; entropy; estimation theory; minimax techniques; probability; Fano\´s inequality; Pinsker\´s inequality; convex body; convexity facts; covariance matrix estimation; estimation problems; f-divergences; global entropy conditions; lower bounds; minimax lower bound; minimax risk; noisy support function measurements; probability measures; Atmospheric measurements; Convex functions; Density measurement; Equations; Estimation; Particle measurements; $f$-Divergences; Fano\´s inequality; Pinsker\´s inequality; minimax lower bounds; reconstruction from support functions;
Journal_Title :
Information Theory, IEEE Transactions on
DOI :
10.1109/TIT.2011.2110791