• DocumentCode
    1145978
  • Title

    Effect of Coefficient Rounding in Floating-Point Digital Filters

  • Author

    Kaneko, Toyohisa ; Liu, Bede

  • Issue
    5
  • fYear
    1971
  • Firstpage
    995
  • Lastpage
    1003
  • Abstract
    The effect of coefficient rounding in digital filters using floating-point arithmetic is analyzed. An error is defined as the difference between the output of a digital filter realized with a finite number of bits and the output of the same filter using infinite number of bits. It is shown that this error consists of two uncorrelated components. One component is due to the rounding of the arithmetic operations alone, and the other component represents the additional error due to coefficient rounding. Expressions are derived for the mean-square value of the error for the three canonical programming forms. The stability problem is studied by examining the shift of the pole locations due to the coefficient rounding. The mean-square value of the shift is calculated. Good agreement between theoretical and experimental results is obtained.
  • Keywords
    Aerodynamics; Application software; Computational modeling; Computer simulation; Control system synthesis; Digital arithmetic; Digital filters; Floating-point arithmetic; Frequency response; Stability;
  • fLanguage
    English
  • Journal_Title
    Aerospace and Electronic Systems, IEEE Transactions on
  • Publisher
    ieee
  • ISSN
    0018-9251
  • Type

    jour

  • DOI
    10.1109/TAES.1971.310342
  • Filename
    4103832