DocumentCode
1145978
Title
Effect of Coefficient Rounding in Floating-Point Digital Filters
Author
Kaneko, Toyohisa ; Liu, Bede
Issue
5
fYear
1971
Firstpage
995
Lastpage
1003
Abstract
The effect of coefficient rounding in digital filters using floating-point arithmetic is analyzed. An error is defined as the difference between the output of a digital filter realized with a finite number of bits and the output of the same filter using infinite number of bits. It is shown that this error consists of two uncorrelated components. One component is due to the rounding of the arithmetic operations alone, and the other component represents the additional error due to coefficient rounding. Expressions are derived for the mean-square value of the error for the three canonical programming forms. The stability problem is studied by examining the shift of the pole locations due to the coefficient rounding. The mean-square value of the shift is calculated. Good agreement between theoretical and experimental results is obtained.
Keywords
Aerodynamics; Application software; Computational modeling; Computer simulation; Control system synthesis; Digital arithmetic; Digital filters; Floating-point arithmetic; Frequency response; Stability;
fLanguage
English
Journal_Title
Aerospace and Electronic Systems, IEEE Transactions on
Publisher
ieee
ISSN
0018-9251
Type
jour
DOI
10.1109/TAES.1971.310342
Filename
4103832
Link To Document