• DocumentCode
    1183041
  • Title

    Sheppard\´s correction for variances and the "quantization noise model"

  • Author

    Vardeman, Stephen B.

  • Author_Institution
    Stat. & Ind. & Manuf. Syst. Eng. Departments, Iowa State Univ., Ames, IA, USA
  • Volume
    54
  • Issue
    5
  • fYear
    2005
  • Firstpage
    2117
  • Lastpage
    2119
  • Abstract
    In this paper, we examine the relevance of Sheppard\´s correction for variances and (both the original and a valid weak form of) the so-called "quantization noise model" to understanding the effects of integer rounding on continuous random variables. We further consider whether there is any real relationship between the two. We observe that the strong form of the model is not really relevant to describing rounding effects. We demonstrate using simple cases the substantial limitations of the Sheppard correction, and use simple versions of a weak form of the model to establish that there is no real connection between the correction and the model.
  • Keywords
    noise; probability; quantisation (signal); Sheppard correction; continuous random variables; dithering; histogram density; integer rounding; quantization noise model; uniform distribution; Analysis of variance; Electrical engineering; Helium; Histograms; Manufacturing industries; Manufacturing systems; Quantization; Random variables; Statistical distributions; Systems engineering and theory; Dithering; histogram density; independent; rounding; uncorrelated; uniform distribution;
  • fLanguage
    English
  • Journal_Title
    Instrumentation and Measurement, IEEE Transactions on
  • Publisher
    ieee
  • ISSN
    0018-9456
  • Type

    jour

  • DOI
    10.1109/TIM.2005.853348
  • Filename
    1514672