The purpose of this study is to provide a new Kappa coefficient based on fuzzy scoring. This new Kappa is called fuzzy Kappa. Fuzzy theory has been widely used in quantitative research and many researches indicate its positive utility. Moreover, viewpoints of measurement according to fuzzy theory conform to the thinking of human thoughts. Therefore, it is feasible to measure the scoring of decision-making or judgment. In addition, Kappa coefficient is one kind of rater reliability and it is to measure the consistency on judgment among raters. Traditional Kappa coefficient is based on the crisp measurement and it violates the psychological nature of human decision-making. Therefore, in this study, fuzzy Kappa, which is based on the fuzzy measurement, is provided. Besides, data simulation is designed to compare of these two Kappa coefficients. The results show that fuzzy Kappa performs better than traditional Kappa. Based on the findings of this study, some suggestions and recommendations are discussed for future research.