Research On The Model Of Integrating Chinese Word Segmentation With Part-Of-Speech Tagging

In this paper, we presented a model of integrating Chinese word segmentation with part-of-speech tagging. In the early stage, we reserve the top N segmentation results as candidates. After Unknown words recognition and POS tagging, we choose the best result form the top N segmentation candidates by evaluating every one. We also implemented a Chinese lexical analyzer based on this model. The experiment results show that the overall accuracy of the proposed analyzer is 98.1% for segmentation and 95.1% for POS tagging respectively. The research is meaning for Chinese information processing and Chinese search engine based on web.