Entropy power factors for linear discrete systems

Author

Ratz, H.C.

Author_Institution

Dept. of Electrical Engng., Univ. of Waterloo, Waterloo, Ont., Canada

Volume

8

Issue

2

fYear

1983

fDate

4/1/1983 12:00:00 AM

Firstpage

73

Lastpage

78

Abstract

The change in entropy of an ergodic signal ensemble that passes through a linear discrete filter is written in terms of the z-transform transfer function of the system and expressed as the entropy power factor of the filter. The entropy change in the first order continuous amplitude distribution is separated from the sequential component that results from the effect of the system on the correlation function and power spectrum of the ensemble. A new entropy power factor is defined which expresses the change in entropy associated with the sequential redundancy alone. The results are used to calculate the information transmission rate of a signal ensemble with a given autocovariance function.

Keywords

filtering and prediction theory; linear systems; signal processing; z-transform transfer function; autocovariance function; correlation function; entropy; ergodic signal; first order continuous amplitude distribution; information transmission rate; linear discrete filter; linear discrete systems; power factor; power spectrum; sequential redundancy; Digital filters; Entropy; Maximum likelihood detection; Nonlinear filters; Reactive power; Redundancy; Transfer functions;

fLanguage

English

Journal_Title

Electrical Engineering Journal, Canadian

Publisher

ieee

ISSN

0700-9216

Type

jour

DOI

10.1109/CEEJ.1983.6593781

Filename

6593781