Minimum Test Case for Discrete-Type Software Reliability Testing by Stratified Sampling

Abstract:

The traditional approach for generating software reliability test cases according to operational profile (OP) can be regarded as a simple random sampling. The stratified sampling is a complex but more accurate sampling approach which can make the sampling results more accurate and less variance by dividing the population into several subsets and randomly sampling from each subset respectively. Firstly, this paper introduced the traditional method which can be used to determine the number of test cases in the discrete-type software reliability demonstration testing. Secondly, the necessary condition for the minimum test case based on the stratified sampling was studied. Then a new approach was proposed and its principle was analyzed for determining the minimum test case of the discrete-type software by using the stratified sampling. Finally, the future work was discussed.

• Periodical: Applied Mechanics and Materials (Volumes 263-266)
• Pages: 1874-1879
• DOI: https://doi.org/10.4028/www.scientific.net/AMM.263-266.1874
• Online since: December 2012
• Authors: Qiu Ying Li*, Lei Luo
• Keywords: Discrete-Type Software, Minimum Test Case, Software Reliability Testing, Stratified Sampling

References

[1] J. D. Musa: Operational profiles in software reliability engineering, IEEE Software, Vol.10, no.2 (1993), pp.14-32.

DOI: 10.1109/52.199724

[2] J. A. Whittaker, G. Thomason: A markov chain model for statistical software testing, IEEE Transactions on Software Engineering, Vol.20, no.10 (1994), pp.812-824.

DOI: 10.1109/32.328991

[3] Q.Y. Li, M.Y. Lu, L. Ruan: Theoretical research on software reliability testing adequacy, Journal of Beijing University of Aeronautics and Astronautics, Vol.29, no.4 (2003), pp.312-316(in Chinese).

[4] W. G. Cochran: Sampling technique (Chinese statistic press, Beijing 1985) (in Chinese).

[5] L. Kish: Sampling technique (Chinese statistic press, Beijing 1997) (in Chinese).

[6] S.Y. Feng, J.X. Ni and G.H. Zou: The theory and approach of sampling investigation (Chinese statistic press, Beijing 1998) (in Chinese).

[7] Y. J. Jin, Y. Jiang and X.Y. Li. Sampling technique (Chinese People University press, Beijing 2003) (in Chinese).

[8] Z.F. Du: Sampling technique and its application (Tsinghua University press, Beijing 2005) (in Chinese).

[9] J.D. Musa: Software reliability engineering (McGraw-Hill Book Company, New York 1996).

[10] K.Y. Cai: Towards a conceptual framework of software run reliability modeling, Information Sciences, Vol.126 (2000), pp.137-163

DOI: 10.1016/s0020-0255(00)00018-9

[11] B. Littlewood, L. Strigini: Assessment of ultra-high dependability for software-based systems, Communications of ACM, Vol.36, no.11 (1993), pp.69-80.

DOI: 10.1145/163359.163373

[12] D. L. Parnas, A. J. van Schouwen and S. P. Kwan: Evaluation of safety-critical software, Communications of ACM, Vol.33, no.6 (1990), pp.636-648.

DOI: 10.1145/78973.78974

[13] B. Littlewood, W. David: Some conservative stopping rules for the operational testing of safety critical software, IEEE Transactions on software Engineering, Vol.23, no.11 (1997), pp.673-683.

DOI: 10.1109/32.637384

[14] MIL-HDBK2781 A, Handbook for reliability test methods, plans and environments for engineering, development, qualification, and production, 1996.

[15] O. Tal, C. McCollin and A. Bendell: Reliability demonstration for safety-critical systems, IEEE Transactions on Reliability, Vol.50, no.2 (2001), pp.194-203.

DOI: 10.1109/24.963127

[16] J.C. Li: Application of sampling technique (Science press, Beijing 2006) (in Chinese).