• DocumentCode
    1391744
  • Title

    Using Resampling Techniques to Compute Confidence Intervals for the Harmonic Mean of Rate-Based Performance Metrics

  • Author

    Patil, Shruti ; Lilja, David J.

  • Author_Institution
    Dept. of Electr. & Comput. Eng., Univ. of Minnesota, Minneapolis, MN, USA
  • Volume
    9
  • Issue
    1
  • fYear
    2010
  • Firstpage
    1
  • Lastpage
    4
  • Abstract
    Rate-based metrics such as floating point operations per second, instructions per cycle and so forth are commonly used to measure computer performance. In addition to the average or mean performance of the metric, indicating the precision of the mean using confidence intervals helps to make informed decisions and comparisons with the data. In this paper, we discuss the determination of confidence intervals for the harmonic mean of rate-based metrics using two statistical resampling techniques - Jackknife and Bootstrap. We show using Monte Carlo simulations that resampling indeed works as expected, and can be used for generating confidence intervals for harmonic mean.
  • Keywords
    Monte Carlo methods; performance evaluation; statistical analysis; Monte Carlo simulations; bootstrap technique; computer performance measurement; confidence intervals; floating point operations; harmonic mean; jackknife technique; rate-based performance metrics; statistical resampling techniques; Nonparametric statistics; Performance of Systems;
  • fLanguage
    English
  • Journal_Title
    Computer Architecture Letters
  • Publisher
    ieee
  • ISSN
    1556-6056
  • Type

    jour

  • DOI
    10.1109/L-CA.2010.1
  • Filename
    5394469