• DocumentCode
    2243947
  • Title

    The relationship between test coverage and reliability

  • Author

    Malaiya, Yashwant K. ; Li, Naixin ; Bieman, Jim ; Karcich, Rick ; Skibbe, Bob

  • Author_Institution
    Dept. of Comput. Sci., Colorado State Univ., Fort Collins, CO, USA
  • fYear
    1994
  • fDate
    6-9 Nov 1994
  • Firstpage
    186
  • Lastpage
    195
  • Abstract
    Models the relationship between testing effort, coverage and reliability, and presents a logarithmic model that relates testing effort to test coverage: statement (or block) coverage, branch (or decision) coverage, computation use (c-use) coverage, or predicate use (p-use) coverage. The model is based on the hypothesis that the enumerables (like branches or blocks) for any coverage measure have different detectability, just like the individual defects. This model allows us to relate a test coverage measure directly to the defect coverage. Data sets for programs with real defects are used to validate the model. The results are consistent with the known inclusion relationships among block, branch and p-use coverage measures. We show how the defect density controls the time-to-next-failure. The model can eliminate variables like the test application strategy from consideration. It is suitable for high-reliability applications where automatic (or manual) test generation is used to cover enemerables which have not yet been tested
  • Keywords
    program testing; software fault tolerance; software metrics; software reliability; automatic test generation; block coverage; branch coverage; c-use coverage; computation use coverage; decision coverage; defect coverage; defect density; enumerables detectability; high-reliability applications; inclusion relationships; logarithmic model; p-use coverage; predicate use coverage; software reliability; software test coverage; statement coverage; test application strategy; test coverage measure; testing effort; time-to-next-failure; Application software; Automatic control; Automatic testing; Computer science; Predictive models; Software measurement; Software systems; Software testing; Space technology; System testing;
  • fLanguage
    English
  • Publisher
    ieee
  • Conference_Titel
    Software Reliability Engineering, 1994. Proceedings., 5th International Symposium on
  • Conference_Location
    Monterey, CA
  • Print_ISBN
    0-8186-6665-X
  • Type

    conf

  • DOI
    10.1109/ISSRE.1994.341373
  • Filename
    341373