This paper explores word segmentation and part-of-speech tagging in ancient Chinese, especially in pre-Qin documents. Firstly, word processing (segmentation and part-of-speech tagging) and investigation analysis are carried out on Zuozhuan text. Then conditional random field model (CRF) is used to carry out comparative experiments on automatic segmentation, part-of-speech tagging and segmentation tagging integration. This research can serve for ancient Chinese vocabulary research and corpus construction to make up for the shortage of manual tagging.

错误:搜索内容不能为空,请输入英文关键词
错误:关键词超出字数限制,请精简
高级检索

Research on the Integration of Ancient Chinese Word Segmentation and Labeling Based on CRF

  • Yuling Yang,
  • Ting Zhao

摘要

This paper explores word segmentation and part-of-speech tagging in ancient Chinese, especially in pre-Qin documents. Firstly, word processing (segmentation and part-of-speech tagging) and investigation analysis are carried out on Zuozhuan text. Then conditional random field model (CRF) is used to carry out comparative experiments on automatic segmentation, part-of-speech tagging and segmentation tagging integration. This research can serve for ancient Chinese vocabulary research and corpus construction to make up for the shortage of manual tagging.