Research on the Credibility Evaluation Methods of Combat Simulation

Abstract:

Credibility is the key performance index and the lifeline for system simulation. Verification, validation and accreditation (VV&A) of all system simulation life can insure the credibility, and credibility evaluation is a very necessary approach to obtain the credibility. Combat simulation is a special simulation for its many characteristics of multi-level, more elements, overall emergence, uncertainty, morbid and multi-granularity model, and so on. Credibility is vital to combat simulation. The evaluation method is one of the aspects of credibility evaluation. In this paper, the methods of credibility evaluation are researched. The common evaluation methods are analyzed and compared. Aiming at the characteristics of combat simulation system, the subjective comprehensive evaluation method based on subject matter expert (SME) is put forward, which is applied to a combat simulation. The practice shows that the subjective comprehensive evaluation method is very effective. The results are sufficiently credible to support the application.

• Periodical: Applied Mechanics and Materials (Volumes 713-715)
• Pages: 2139-2142
• DOI: https://doi.org/10.4028/www.scientific.net/AMM.713-715.2139
• Online since: January 2015
• Authors: Jian Bing Tang*, Tian Tian Guo, Qi Gao Hu, Ya Bing Zha
• Keywords: Accreditation, Combat Simulation, Credibility Evaluation, Evaluation Method, Subject Matter Expert (SME), Subjective Comprehensive Evaluation, Validation, Verification

References

[1] Biggs A.G., Cawthorne A.R. Bloodhood missile evaluation. Journal of the Royal Aeronautical Society. 1962(9). p.571~598.

[2] Mihram G.A. et al. What makes a simulation credible? Proceeding of the 5th annual conference on modeling and simulation. 1974. 4. Vol5. Part2.

[3] DoD. DoD Instruction 5000. 61: DoD Modeling And Simulation Verification, Validation, And Accreditation U.S. Department of Defense. May 13, (2003).

DOI: 10.21236/ada315867

[4] Sargent, R. G. Verification and Validation of Simulation Models., In Proc. 2007 Winter Simulation Conf., edited by S. G. Henderson, B. Biller, M. -H. Hsieh, J. D. Tew, and R. R. Barton, 124-137. Piscataway, New Jersey: Institute of Electrical and Electronic Engineers Inc. (2007).

[5] Averill M. Law. How to build valid and credible simulation models. Proceedings of Winter Simulation Conference, pp.39-47, (2008).

DOI: 10.1109/wsc.2008.4736054

[6] Balci, O. A Methodology for Certification of Modeling and Simulation Applications., ACMTrans. on Modeling and Computer Simulation 11(4): 352-377. (2001).

DOI: 10.1145/508366.508369

[7] Michael L. Metz, S.Y. Harmon. Using Subject Matter Experts for Results Validation of a Complex Theater Warfare Simulation: A Progress Report. 02S-SIW-095.

[8] Dale K. Pace. Use of Subject Matter Experts (SMEs) in Simulation Evaluation. Proceedings of Fall SIW, (1999).