Title of article :
Statistical inference for the -entropy and the quadratic Rényi entropy
Author/Authors :
Leonenko، نويسنده , , Nikolaj and Seleznjev، نويسنده , , Oleg، نويسنده ,
Issue Information :
دوفصلنامه با شماره پیاپی سال 2010
Abstract :
Entropy and its various generalizations are widely used in mathematical statistics, communication theory, physical and computer sciences for characterizing the amount of information in a probability distribution. We consider estimators of the quadratic Rényi entropy and some related characteristics of discrete and continuous probability distributions based on the number of coincident (or ϵ -close) vector observations in the corresponding independent and identically distributed sample. We show some asymptotic properties of these estimators (e.g., consistency and asymptotic normality). These estimators can be used in various problems in mathematical statistics and computer science (e.g., distribution identification problems, average case analysis for random databases, approximate pattern matching in bioinformatics, cryptography).
Keywords :
Quadratic Rényi entropy , Entropy estimation , U -statistics
Journal title :
Journal of Multivariate Analysis
Journal title :
Journal of Multivariate Analysis