Paper Title:
Identification of Chinese Unknown Word Based on Finite Multi-List Method
  Abstract

Unknown word is a kind of word that is not included in the sub_word vocabulary, but must be cut out by the word segmentation program. Peoples’ names, place names and translated names are the major unknown words.Unknown Chinese words is a difficult problem in natural language processing, and also contributed to the low rate of correct segmention. This paper introduces the finite multi-list method that using the word fragments’ capability to composite a word and the location in the word tree to process the unknown Chinese words.The experiment recall is 70.67% ,the correct rate is 43.65% .The result of the experiment shows that unknown Chinese word identification based on the finite multi-list method is feasible.

  Info
Periodical
Key Engineering Materials (Volumes 474-476)
Edited by
Garry Zhu
Pages
460-465
DOI
10.4028/www.scientific.net/KEM.474-476.460
Citation
B. Sun, S. H. Huang, X. H. Liu, "Identification of Chinese Unknown Word Based on Finite Multi-List Method", Key Engineering Materials, Vols. 474-476, pp. 460-465, 2011
Online since
April 2011
Export
Price
$32.00
Share

In order to see related information, you need to Login.

In order to see related information, you need to Login.

Authors: Xue Guang Wang, Jie Ke Lin
Abstract:Rang-free distributed localization algorithm has advantages of low power consumption, low cost etc, but it is weak in the localization...
4028
Authors: Sheng Mei Zhou, Ting Lei Huang
Chapter 18: Technologies of Measuring, Detection and Monitoring in Industry
Abstract:In the process of that based on the RSSI received signal strength indicator technique, resulting in the positioning accuracy is so low, since...
2003
Authors: Zhi Gui Lin, Lin Li, Hui Qi Zhang, Min Li, Fang Qin Yao
Chapter 6: Information Technologies and Networks Engineering, Computational Methods and Management
Abstract:Aiming at misjudgment formed by PIT (Point-In-triangulation Test) and position failure formed by edge effect in APIT algorithm, this paper...
1038
Authors: Yan Yuan, La Yuan Li, Chun Lin Li
Chapter 7: Monitoring and Data Processing
Abstract:DV-Hop algorithm is a kind of typical range-free node localization algorithm of wireless sensor network. In order to improve the positioning...
560