• DocumentCode
    1343227
  • Title

    Simplistic universal coding

  • Author

    Neuhoff, David L. ; Shields, Paul C.

  • Author_Institution
    Dept. of Electr. Eng. & Comput. Sci., Michigan Univ., Ann Arbor, MI, USA
  • Volume
    44
  • Issue
    2
  • fYear
    1998
  • fDate
    3/1/1998 12:00:00 AM
  • Firstpage
    778
  • Lastpage
    781
  • Abstract
    A conceptually simple coding method may be described as follows. The source sequence is parsed into fixed-length blocks and a list of these blocks is placed in a dictionary. In the lossless case, the dictionary is transmitted and each successive block is encoded by giving its dictionary location. In the lossy case, the smallest collection of blocks such that every member of the dictionary is within distortion δ of the collection is determined, this codebook is transmitted, and each successive block is encoded by giving the location of a member of the code within δ of it. We show that by optimizing on the block length, this method is universal, that is, for any ergodic process it achieves entropy in the limit in the lossless case and the rate-distortion function R(δ) in the lossy case
  • Keywords
    block codes; entropy; rate distortion theory; source coding; block codes; block length optimisation; codebook; dictionary location; entropy rate; ergodic process; fixed-length blocks; lossless theorem; lossy theorem; rate-distortion function; source sequence; successive block encoding; universal coding; Convergence; Entropy; Information theory; Jacobian matrices; Mathematical model; Random variables; Read only memory; Sufficient conditions; Upper bound; Welding;
  • fLanguage
    English
  • Journal_Title
    Information Theory, IEEE Transactions on
  • Publisher
    ieee
  • ISSN
    0018-9448
  • Type

    jour

  • DOI
    10.1109/18.661520
  • Filename
    661520