Title :
An entropy estimator with least square error [biological signals]
Author :
Yokota, Yasunari
Author_Institution :
Dept. of Inf. Sci., Gifu Univ., Japan
Abstract :
Presents a new entropy estimator which minimizes mean squared error between its estimate and true entropy. It uses a new entropy function approximated by a polynomial when an information source outputs two kinds of source symbols independently. In conventional entropy estimation, entropy has been estimated by replacing true occurrence probabilities of each source symbol in the entropy function with their estimates. In this case, the entropy estimator is not optimum in the meaning of least square error. This article demonstrates that the proposed entropy estimator achieves excellent mean squared error compared to a conventional entropy estimator.
Keywords :
biology; least mean squares methods; minimum entropy methods; neurophysiology; polynomial approximation; statistical analysis; biological signals; conventional entropy estimation; entropy estimator; entropy function; information source; least square error; mean squared error; polynomial; source symbol; source symbols; statistical properties; true occurrence probabilities; Biology; Entropy; Error analysis; Estimation error; Information rates; Information science; Least squares approximation; Performance analysis; Polynomials; Signal analysis;
Conference_Titel :
Engineering in Medicine and Biology, 2002. 24th Annual Conference and the Annual Fall Meeting of the Biomedical Engineering Society EMBS/BMES Conference, 2002. Proceedings of the Second Joint
Print_ISBN :
0-7803-7612-9
DOI :
10.1109/IEMBS.2002.1134450