Research on Dichotomy Model Evaluation Method of Weighted Comprehensive Indexes

Abstract:

It is an important link for supporting business operations and decision-making to select optimal model from multiple models. Based on the analysis on traditional dichotomy model evaluation methods, the paper presented a kind of method to evaluate model performance that consider multiple individual evaluation indexes to compute comprehensive index ranking score. The method solves the problem of difficulty for modeling personnel when using multiple traditional evaluation indexes to evaluate a group model that different conclusion caused by different methods. The evaluation example based on the method shows that the weighted comprehensive index based evaluation method is of reference value for the optimal selection of dichotomy model.

• Periodical: Advanced Materials Research (Volumes 482-484)
• Pages: 2297-2300
• DOI: https://doi.org/10.4028/www.scientific.net/AMR.482-484.2297
• Online since: February 2012
• Authors: Ni Zhao, Juan Mei Zhang
• Keywords: Dichotomy Model, Model Evaluation, Omprehensive Index Ranking, Weighted

References

[1] Zhao W., He J. M., Wang C. L. and Chen J. B., "Application of a Cost-sensitive Method for Churn Prediction in Telecommunication Industry," Journal of Southeast University, vol. 23, 2007, pp.135-138.

[2] Zheng E. H., Li P. and Song Z. H., "SVM-based Cost Sensitive Mining," Information and Control, vol. 35, 2006, pp.294-298.

[3] Viaene S. and Dedene G., "Cost-sensitive Learning and Decision-making Revisited," European Journal of Operational Research, vol. 166, 2005, pp.212-220.

DOI: 10.1016/j.ejor.2004.03.031

[4] Liu Y., Yang Y. and Carbonell J., "Boosting to Correct Inductive Bias in Text Classification," Proceedings of the Eleventh International Conference on Information and Knowledge Management. Pittsburgh, USA, 2002, pp.348-355.

DOI: 10.1145/584792.584850