• DocumentCode
    2920409
  • Title

    An application of universal data compression to statistical analysis of time series

  • Author

    Ryabko, Boris

  • Author_Institution
    Inst. of Comput. Technol., Siberian State Univ. of Telecommun. & Inf., Russia
  • fYear
    2010
  • fDate
    6-8 Jan. 2010
  • Firstpage
    1
  • Lastpage
    5
  • Abstract
    It is shown that universal data compressors (or universal codes) can be used for solving some of the most important statistical problems for time series. By definition, a universal lossless data compressor (or a universal code) can compress any sequence generated by a stationary and ergodic source asymptotically to the Shannon entropy, which, in turn, is the best achievable ratio for lossless data compressors. We consider finite-alphabet and real-valued time series and the following problems: estimation of the limiting probabilities for finite-alphabet time series and estimation of the density for real-valued time series and the on-line prediction for both types of the time series and the following problems of hypothesis testing: goodness-of-fit testing and testing of serial independence. On the one hand, all problems are considered in the framework of classical mathematical statistics and, on the other hand, everyday methods of data compression (or archivers) can be used as a tool for the estimation and testing. It turns out, that quite often the suggested methods and tests are more powerful than known ones when they are applied in practice.
  • Keywords
    data compression; statistical analysis; time series; Shannon entropy; finite-alphabet time series; goodness-of-fit testing; lossless data compressor; real-valued time series; sequence compression; serial independence testing; statistical analysis; time series online prediction; universal codes; universal data compression; Compressors; Data compression; Decoding; Entropy; Informatics; NIST; Random number generation; Statistical analysis; Telecommunication computing; Testing;
  • fLanguage
    English
  • Publisher
    ieee
  • Conference_Titel
    Information Theory (ITW 2010, Cairo), 2010 IEEE Information Theory Workshop on
  • Conference_Location
    Cairo
  • Print_ISBN
    978-1-4244-6372-5
  • Type

    conf

  • DOI
    10.1109/ITWKSPS.2010.5503156
  • Filename
    5503156