Title :
Parameter Bounds on Estimation Accuracy Under Model Misspecification
Author :
Richmond, Christ D. ; Horowitz, Larry L.
Author_Institution :
MIT Lincoln Lab., Lexington, MA, USA
Abstract :
When the assumed data distribution differs from the true distribution, the model is said to be misspecified or mismatched. Model misspecification at some level is an inevitability of engineering practice. While Huber´s celebrated work assesses maximum-likelihood (ML) performance under misspecification, no simple theory for bounding parameter estimation exists. The class of parameter bounds emerging from the covariance inequality, or equivalently the minimum norm theorem is revisited. The expectation operator is well-known to form an inner product space. Flexibility in the choice of expectation integrand and measure for integration exists, however, to establish a class of parameter bounds under a general form of model misspecification, i.e., distribution mismatch. The Cramér-Rao bound (CRB) primarily, and secondarily the Barankin/Hammersley-Chapman-Robbins, Bhattacharyya, and Bobrovsky-Mayer-Wolf-Zakai bounds under misspecification are considered. Huber´s sandwich covariance is readily established as a special case of the misspecified CRB subject to ML constraints, and generalizations of the Slepian and Bangs formulae under misspecification are obtained.
Keywords :
covariance matrices; maximum likelihood estimation; signal classification; Bangs formulae; CRB; Cramer-Rao bound; ML performance; Slepian formulae; covariance inequality; data distribution; engineering practice; maximum-likelihood performance; model misspecification; parameter estimation; sandwich covariance; Correlation; Data models; Distributed databases; Maximum likelihood estimation; Parameter estimation; Vectors; Covariance inequality; Cramér-Rao; Slepian-Bangs; mismatch; misspecification; misspecified model; parameter bound; sandwich covariance;
Journal_Title :
Signal Processing, IEEE Transactions on
DOI :
10.1109/TSP.2015.2411222