• DocumentCode
    818826
  • Title

    Distortion program-size complexity with respect to a fidelity criterion and rate-distortion function

  • Author

    Yang, En-Hui ; Shen, Shi-Yi

  • Author_Institution
    Dept. of Math., Nankai Univ., Tianjin, China
  • Volume
    39
  • Issue
    1
  • fYear
    1993
  • fDate
    1/1/1993 12:00:00 AM
  • Firstpage
    288
  • Lastpage
    292
  • Abstract
    A novel concept of distortion Kolmogorov-chaitin complexity is proposed. Bearing analogy to ordinary Kolmogorov-Chaitin complexity that represents the information content of a single message, distortion Kolmogorov-Chaitin complexity can be regarded as the amount of information about a single message that must be conveyed in order to reproduce it with a bounded distortion. This explanation is justified by the properties of distortion Kolmogorov-Chaitin complexity and the equivalences between distortion Kolmogorov-Chaitin complexity and the rate-distortion function, which are analogous to those between ordinary Kolmogorov-Chaitin complexity and the Shannon entropy. Some implications for universal almost sure data compression are also discussed
  • Keywords
    communication complexity; data compression; information theory; bounded distortion; distortion Kolmogorov-chaitin complexity; fidelity criterion; information content; rate-distortion function; single message; universal almost sure data compression; Brownian motion; Data compression; Entropy; Least squares approximation; Noise measurement; Nonlinear distortion; Nonlinear systems; Rate-distortion; State estimation; Technological innovation;
  • fLanguage
    English
  • Journal_Title
    Information Theory, IEEE Transactions on
  • Publisher
    ieee
  • ISSN
    0018-9448
  • Type

    jour

  • DOI
    10.1109/18.179376
  • Filename
    179376