• DocumentCode
    397327
  • Title

    Context-dependent vs. context-free: performance comparison of grammar-based codes

  • Author

    Yang, En-Hui ; He, Da-Ke

  • Author_Institution
    Dept. of Electr. & Comput. Eng., Waterloo Univ., Ont., Canada
  • fYear
    2003
  • fDate
    29 June-4 July 2003
  • Firstpage
    51
  • Abstract
    In this paper, we compare the performance of two types of universal data compression algorithms: context-dependent grammar-based (CDG-based) codes and context-free grammar-based (CFG-based) codes. The theoretical comparison of two algorithm is complicated by the following two facts observed: 1) Both CDG-based codes and CFG-based codes are universal for the class of stationary, ergodic sources with a finite alphabet; and 2) When the number of distinct contexts is upper bounded by a fixed number, the upper bounds on worst-case redundancy of CDG-based codes and CFG-based codes against any finite context arithmetic codes are in the same order of O(log log n/ log n). previously, two universal algorithms were compared only on the basis of some individual sequences. It was shown that for any sequential lossless code that is performable on a computer, there exists a sequence that is not compressible by the given code.
  • Keywords
    arithmetic codes; context-free grammars; data compression; context-dependent grammar-based code; context-free grammar-based codes; ergodic sources; finite alphabet; finite context arithmetic code; universal data compression algorithms; Arithmetic; Binary sequences; Compression algorithms; Context modeling; Councils; Data compression; Entropy; Information technology; Technological innovation; Upper bound;
  • fLanguage
    English
  • Publisher
    ieee
  • Conference_Titel
    Information Theory, 2003. Proceedings. IEEE International Symposium on
  • Print_ISBN
    0-7803-7728-1
  • Type

    conf

  • DOI
    10.1109/ISIT.2003.1228065
  • Filename
    1228065