Skip to main content
SpringerLink
Log in

Software Reliability Models Incorporating Testing Effort

  • Published:
OPSEARCH Aims and scope Submit manuscript

Abstract

Explicitly relating the effectiveness of fault detection to the effort expended in testing, achieved by incorporating testing effort into software reliability models has been the focus of many research efforts. Although the literature is replete with these “testing effort models,” their development appears to be ad hoc and disconnected. The objective of this survey is to propose a framework to classify testing effort models, aimed at identifying their commonalities and highlighting their differences. We conclude the article with a brief discussion of the limitations of the prevalent works in this domain, which also identify directions for future research.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Similar content being viewed by others

References

  1. Kapur P. K., Gupta A., and Jha P. (2007), “Reliability Analysis of Project and Product Type Software in Operational Phase Incorporating the Effect of Fault Removal Efficiency”, International Journal of Reliability, Quality and Safety Engineering,, 14(3), 219–240.

    Article  Google Scholar 

  2. Huang C., Kuo S., and Lyu M. (2007), “An Assessment of Testing-Effort Dependent Software Reliability Growth Models”, IEEE Transactions on Reliability,, 56(2), 198–211.

    Article  Google Scholar 

  3. Kapur P. K., Yadavalli V., and Kumar A. (2006), “A General Software Reliability Growth Model for a Distributed Environment”, South African Journal of Statistics, 40, 151–185.

    Google Scholar 

  4. Bokhari M. and Ahmad N. (2006), “Analysis of a Software Reliability Growth Models: The Case of Log-Logistic Test-Effort Function”, in Proc. of IASTED ICMS, 540–545.

  5. Huang C. and Lin C. (2006), “Software Reliability Analysis by Considering Fault Dependency and Debugging Time Lag”, IEEE Transactions on Reliability.,, 55(3), 436–450.

    Article  Google Scholar 

  6. Huang C. and Lyu M. (2005), “Optimal Release Time for Software Systems Considering Cost, Testing-Effort, and Test Efficiency”, IEEE Transactions on Reliability,, 54(4), 583–591.

    Article  Google Scholar 

  7. Huang C. and Lin C. (2005), “Reliability Prediction and Assessment of Fielded Software Based on Multiple Change-Point Models”, in Proc. of PRDC, 379–386.

  8. Ishii T. and Dohi T. (2005), “Two-Dimensional Software Reliability Model and Their Applications”, in Proc. of PRDC, 3–10.

  9. Kapur P. K., Goswami D., and Gupta A. (2004), “A Software Reliability Growth Model with Testing Effort Dependent Learning Function for Distributed Systems”, International Journal of Reliability, Quality and Safety Engineering,, 11(4), 365–377.

    Article  Google Scholar 

  10. Inoue S. and Yamada S. (2004), “Stochastic Differential Equation Modeling for Testing-Effort Dependent Software Reliability Assessment”, in Proc. of ISSAT, 256–260.

  11. Kapur P. K., Jha P., and Bardhan A. (2004), “Optimal Allocation of Testing Resource for a Modular Software”, Asia-Pacific Journal of Operational Research,, 21(3), 333–354.

    Article  Google Scholar 

  12. Kapur P. K., Jha P., and Bardhan, A. (2003), “Dynamic Programming Approach to Testing Resource Allocation Problem for Modular Software”, Journal Ratio Mathematica, 14, 27–40.

    Google Scholar 

  13. Kapur P. K. and Bardhan A. (2002), “Testing Effort Control Through Software Reliability Growth Modelling”, International Journal of Modeling and Simulation,, 22(1), 90–96.

    Article  Google Scholar 

  14. Huang G. and Kuo S. (2002), “Analysis of Incorporating Logistic Testing Effort Function into Software Reliability Modeling”, IEEE Transactions on Reliability,, 51(3), 261–270.

    Article  Google Scholar 

  15. Kuo S., Huang C., and Lyu M. (2001), “Framework for Modeling Software Reliability, Using Various Testing-Efforts and Fault-Detection Rates”, IEEE Transactions on Reliability,, 50(3), 310–320.

    Article  Google Scholar 

  16. Dohi T., Wakana N., Osaki S., and Trivedi K. (2001), “Analysis of Hypergeometric Distribution Software Reliability Model”, in Proc. of ISSRE, 166–175.

  17. Yamada S., Tamura Y., and Kimura M. (2000), “A Software Reliability Growth Model for a Distributed Development Environment”, Electronics and Communication in Japan,, 83(12), 1446–1453.

    Article  Google Scholar 

  18. Huang C., Lo J., and Kuo S. (1998), “A Pragmatic Study of Parametric Decomposition Models for Estimating Software Reliability Growth”, in Proc. of ISSRE, 111–123.

  19. Chatterjee R., Misra B., and Alam S. (1997), “Joint Effect of Test Effort and Learning Factor on Software Reliability and Optimal Release Policy”, International Journal of Systems Science,, 28(4), 391–396.

    Article  Google Scholar 

  20. Gokhale, S., Marinos, P, and Trivedi, K. (1996), “Important Milestones in Software Reliability Modeling”, Communications in Reliability, Maintainability, and Serviceability.

  21. Kapur P. K., Younes S., and Agarwal S. (1995), “Generalized Erlang Software Reliability Growth Model”, ASOR Bulletin,, 14(1), 5–11.

    Google Scholar 

  22. Kapur P. K. and Younes S. (1995), “Testing Effort Control Problem for an S-shaped Software Reliability Growth Model”, ASOR Bulletin,, 14(1), 12–19.

    Google Scholar 

  23. Tian J., Lu P., and Palma J. (1995), “Test-Execution-Based Reliability Measurement and Modeling for Large Commercial Software”, IEEE Transactions on Software Engineering,, 21(5), 405–414.

    Article  Google Scholar 

  24. Kapur P. K., Grover P., and Younes S. (1994), “Modeling an Imperfect Debugging Phenomenon with Testing Effort”, in Proc. of ISSRE, 178–183.

  25. Kapur P. K., Xie M., Garg R., and Jha A. (1994), “A Discrete Software Reliability Growth Model with Testing Effort”, in Proc. of STRQA, 16–20.

  26. Hou R., Kuo S., and Chang Y. (1994), “Applying Various Learning Curves to Hyper-Geometric Distribution Software Reliability Growth Model,” in Proc. of ISSRE, 8–17.

  27. Kenney G. (1993), “Estimating Defects in Commercial Software During Operational Use”, IEEE Transactions on Reliability,, 42(1), 107–115.

    Article  Google Scholar 

  28. Jacoby R. and Masuzawa K. (1992), “Test Coverage Dependent Software Reliability Estimation by the HGD Model”, in Proc. of ISSRE, 193–204.

  29. Everett W. (1992), “An “Extended Execution Time” Software Reliability Model”, in Proc. of ISSRE, 4–13.

  30. Kapur P. K. and Garg R. (1991), “Optimal Release Policies for Software Systems with Testing Effort”, International Journal of Systems Science,, 22(9), 1563–1571.

    Article  Google Scholar 

  31. S Yamada S. (1991), “Software Quality/Reliability Measurement and Assessment: Software Reliability Growth Models and Data Analysis”, Journal of Information Processing,, 14(3), 254–266.

    Google Scholar 

  32. Jacoby R. and Tohma Y. (1991), “Parameter Value Computation by Least Squares Method and Evaluation of Software Availability and Reliability at Service-Operation by the Hypergeometric Distribution Software Reliability Growth Model”, in Proc. of ICSE, 226–237.

  33. Yamada, S. and Ohtera, H. (1990), “Software Reliability Growth Model for Testing-Effort Control”, European Journal of Operational Research, 46, 343–349.

    Article  Google Scholar 

  34. Trachtenberg M. (1990), “A General Theory of Software-Reliability Modeling,” IEEE Transactions on Reliability, 39(1), 92–96.

    Article  Google Scholar 

  35. Tohma Y., Tokunaga K., Nagase S., and Murata Y. (1989), “Structural Approach to the Estimation of the Number of Residual Software Faults Based on the Hyper-Geometric Distribution”, IEEE Transactions on Software Engineering,, 15(3), 345–355.

    Article  Google Scholar 

  36. Tohma Y., Jacoby R., Murata Y., and Yamamoto M. (1989), “Hyper-Geometric Distribution Model to Estimate the Number of Residual Software Faults”, in Proc. of COMPSAC, 610–617.

  37. Yamada S., Ohtera H., and Narihisa H. (1986), “Software Reliability Growth Models with Testing-Effort”, IEEE Transactions on Reliability, R-35(1), 19–23.

  38. Ohba, M. (1984), “Software Reliability Analysis Models,” IBM Journal of Research and Development, 28(4), 428–443.

    Article  Google Scholar 

  39. Musa, J. and Okumoto K. (1984), “A Logarithmic Poisson Execution Time Model for Software Reliability Measurement,” in Proc. of ICSE, 230–238.

  40. Boehm B. (1981), Software Engineering Economics. Englewood Cliffs, NJ, Prentice-Hall.

    Google Scholar 

  41. Brooks W. and Motley R. (1980), “Analysis of Discrete Software Reliability Models”, RADC-TR-80-84.

  42. Goel A. and Okumoto K. (1979), “Time-Dependent Error-Detection Rate Model for Software Reliability and Other Performance Measures”, IEEE Transactions on Reliability, R-28(3), 206–211.

    Article  Google Scholar 

  43. Goel, A. (1979), “Software Error Detection Model with Applications”, The Journal of Systems and Software, 1, 243–249.

    Article  Google Scholar 

  44. Musa, J. (1975), “A Theory of Software Reliability and Its Application”, IEEE Transactions on Software Engineering, SE-1(3), 312–327.

    Article  Google Scholar 

  45. Mills H. (1972), “On the Statistical Validation of Computer Programs”, FCS-72–6015.

  46. Feller, W. (1968), An Introduction to Probability and its Application, New York, Wiley, Third Edition

    Google Scholar 

Download references

Author information

Authors and Affiliations

  1. Department of Computer Science & Engineering, University of Connecticut, 06269, Storrs, CT, USA

    Lance Fiondella & Swapna S. Gokhale

Authors
  1. Lance Fiondella
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Swapna S. Gokhale
    View author publications

    You can also search for this author in PubMed Google Scholar

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Fiondella, L., Gokhale, S.S. Software Reliability Models Incorporating Testing Effort. OPSEARCH 45, 351–368 (2008). https://doi.org/10.1007/BF03398825

Download citation

  • Received:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/BF03398825

Keywords

Search

Navigation