Sentence Similarity Metric and its Application in FAQ System

Abstract:

FAQ system is a question answering system which finds the question sentence from question-answer collection and then returns its corresponding answer to user. The task of matching questions to corresponding question-answer pairs has become a major challenge in FAQ system. This paper proposes a method for sentence similarity metric between questions according to its semantic similarity as well as the length of question length. Experiments show that this method can improve the accuracy and intelligence of answering system, has some practical value.

• Periodical: Advanced Materials Research (Volumes 718-720)
• Pages: 2248-2251
• DOI: https://doi.org/10.4028/www.scientific.net/AMR.718-720.2248
• Online since: July 2013
• Authors: Pei Ying Zhang
• Keywords: Frequently Asked Questions System (FAQ System), Question Answering System, Sentence Similarity Metric, Word Form Similarity, Word Semantic Similarity

References

[1] Dong Zhen-dong. HowNet [OL]. http://www.keenage.com

[2] Jiang Min, Xiao Shi-bin, Wang Hong-wei et al, 2008.An improved word similarity computing method based on HowNet[J]. Journal of Chinese information processing

[3] Ma Yinhua, Wang Yongcheng, Su Guiyang, Zhang Yumeng.A Novel Chinese Text Subject Extraction Method Based on Character Co-occurrence. Journal of Computer Research and Development, 2003, 40(6):874-878

[4] Zhong Min Juan. An Effective Similarity Measurement for FAQ Question Answering System. 2010 International Conference on Electrical and Control Engineering

DOI: 10.1109/icece.2010.1121

[5] Nomoto, M. A New Approach to Unsupervised Text Summarization. Proceedings of the 24th ACM SIGIR, pp.26-34(2001)

[6] Erkan, G., Radev, D. Graph-based Lexical Centrality as Salience in Text Summarization. Journal of Art. Int. Research 22,457-479 (2004)

DOI: 10.1613/jair.1523

[7] Salton, G. Automatic Text Processing. The Transformation, Analysis, and Retrieval of information by Computer. Addison-Wesley, Reading (1989)

[8] Aliguliyev, R.M. (2009). A new sentence similarity measure and sentence based extractive technique for automatic text summarization. Expert Systems with Applications, 36,7764-7772.

DOI: 10.1016/j.eswa.2008.11.022

[9] Susu Jiang and Zhu Yonghua, "The Design for Semantic Based Intelligent Q&A System". First International Workshop on Education Technology and Computer Science, IEEE, 2009, pp.90-92

DOI: 10.1109/etcs.2009.29

[10] Min-Kyoung kim and Han-joon Kim, "Design of question answering system with automated question generation", IEEE, 2008, pp.365-369

[11] E. Sneiders, "Automated Question Answering: Template-Based Approach", PhD thesis, Stockholm University / KTH press, Sweden, 2002.

[12] CUI Heng, CAI Dongfeng, MIAO Xuelei, "Research on Web-based Chinese Question Answering System and Answer Extraction", Journal of Chinese Information Processing. 2004, 18(3): 24-31

DOI: 10.1109/cit.2004.1357348

[13] Li Sujian, Zhang Jian, Huang Xiong, et al. "Semantic computation in a Chinese question-answering system". Journal of Computer Science Technology, vol.17 iss.6, pp.993-999.

[14] Bekhti, S., Rehman, A., Al-Harbi, M., Saba, T. An Arabic question-answering system based on extensive question analysis and answer relevance scoring. International Journal of Academic Research, 2011, 3(4):45-54.