Effective Analysis of Chinese Word-Segmentation Accuracy

作     者：MA Weiyin 

作者机构：Department of Mathematics and Compute ScienceNanjing Medical UniversityNanjing210029China 

出 版 物：《现代电子技术》 (Modern Electronics Technique)

年 卷 期：2007年第30卷第4期

页      面：108-110页

学科分类：081203[工学-计算机应用技术] 08[工学] 0835[工学-软件工程] 0812[工学-计算机科学与技术（可授工学、理学学位）] 

主　　题：中文信息处理 汉字处理 自动分割 效率分析 

摘      要：Automatic word-segmentation is widely used in the ambiguity cancellation when processing large-scale real text,but during the process of unknown word detection in Chinese word segmentation,many detected word candidates are *** false unknown word candidates deteriorate the overall segmentation accuracy,as it will affect the segmentation accuracy of known *** this paper,we propose several methods for reducing the difficulties and improving the accuracy of the word-segmentation of written Chinese,such as full segmentation of a sentence,processing the duplicative word,idioms and statistical identification for unknown words.A simulation shows the feasibility of our proposed methods in improving the accuracy of word-segmentation of Chinese.