Fuzzy Kappa Coefficient with Simulated Comparisons


Article Preview

The purpose of this study is to provide a new Kappa coefficient based on fuzzy scoring. This new Kappa is called fuzzy Kappa. Fuzzy theory has been widely used in quantitative research and many researches indicate its positive utility. Moreover, viewpoints of measurement according to fuzzy theory conform to the thinking of human thoughts. Therefore, it is feasible to measure the scoring of decision-making or judgment. In addition, Kappa coefficient is one kind of rater reliability and it is to measure the consistency on judgment among raters. Traditional Kappa coefficient is based on the crisp measurement and it violates the psychological nature of human decision-making. Therefore, in this study, fuzzy Kappa, which is based on the fuzzy measurement, is provided. Besides, data simulation is designed to compare of these two Kappa coefficients. The results show that fuzzy Kappa performs better than traditional Kappa. Based on the findings of this study, some suggestions and recommendations are discussed for future research.



Edited by:

Yun-Hae Kim and Prasad Yarlagadda




Y. H. Lin, "Fuzzy Kappa Coefficient with Simulated Comparisons", Applied Mechanics and Materials, Vols. 303-306, pp. 372-375, 2013

Online since:

February 2013





[1] B. C. Arabacioglu: Applied Soft Computing Vol. 10 (2010) p.926–937.

[2] W. Dou, Y. Ren, Q. Wu, S. Ruan, Y. Chen, D. Bloyet, and J. M. Constans: Neurocomputing, Vol. 70 (2007) p.726–734.

DOI: https://doi.org/10.1016/j.neucom.2006.10.007

[3] M. L. Sands, and J. R. Murphy: Journal of Clinical Epidemiology Vol. 49 (1996) pp.1045-1051.

[4] J. F. Reed: Computer Methods and Programs in Biomedicine Vol. 63 (2000) pp.43-46.

[5] M. Banerjee, M. Capozzoli, L. McSweeney, and D. Sinha: The Canadian Journal of Statistics Vol. 27 (1999) pp.3-23.

[6] J. Sim, and C. C. Wright: Physical Therapy Vol. 85 (2005) pp.257-268.

[7] K. Gwet: British Journal of Mathematical and Statistical Psychology Vol. 61 (2008) pp.29-48.

[8] J. Carletta: Computational Linguistics Vol. 22 (1996) p.249–254.

[9] M. A. Tanner, and M. A. Young: Journal of the American Statistical Association Vol. 80 (1985) pp.175-180.

[10] L. A. Zadeh: Information and Control Vol. 8 (1965) pp.338-353.

[11] A. Agresti: Biometrica Vol. 44 (1988) pp.539-548.

[12] Y. H. Lin, and J. M. Yih: Applied Mechanics and Materials, Vol. 55-57 (2011), pp.2197-2201.

[13] A. Agresti: Analysis of Ordinal Categorical Data (New York: Wiley 2010).