<p>Chinese Word Segmentation (CWS) is a fundamental task in Chinese natural language processing (NLP). However, in the geoscience domain, the complexity and diversity of geological terminology pose significant challenges to traditional methods. Existing research indicates that issues such as ambiguous boundaries of geological terms and the scarcity of annotated data severely constrain the effectiveness of CWS in this field. To solve these problems, we propose a novel Large Language Model (LLM)-based semi-supervised framework called LLM-GeoCWS for CWS in geoscience domain. Firstly, we develop a segmentation model based on pseudo-lexicon memory mechanism and BERT to learn word boundary features and recognize complex geological terms with limited labeled data. Additionally, we design an LLM-powered self-training strategy, which uses GPT-4o to generate high-quality extra data by analyzing syntactic and lexical structure from pseudo-labels and retrieved examples, to enhance the generalization ability of the model. Our method outperformed the state-of-the-art baseline methods in extensive experiments, and ablation experiments verified the effectiveness of the proposed segmentation model and self-training strategy.</p>

错误:搜索内容不能为空,请输入英文关键词
错误:关键词超出字数限制,请精简
高级检索

LLM-GeoCWS: a semi-supervised chinese word segmentation method using large language model for geoscience domain

  • Deping Chu,
  • Zhuo Tan,
  • Bo Wan,
  • Fang Fang,
  • Shunping Zhou,
  • Yuanjian Zhu,
  • Mingqing Zhu,
  • Yan Wu

摘要

Chinese Word Segmentation (CWS) is a fundamental task in Chinese natural language processing (NLP). However, in the geoscience domain, the complexity and diversity of geological terminology pose significant challenges to traditional methods. Existing research indicates that issues such as ambiguous boundaries of geological terms and the scarcity of annotated data severely constrain the effectiveness of CWS in this field. To solve these problems, we propose a novel Large Language Model (LLM)-based semi-supervised framework called LLM-GeoCWS for CWS in geoscience domain. Firstly, we develop a segmentation model based on pseudo-lexicon memory mechanism and BERT to learn word boundary features and recognize complex geological terms with limited labeled data. Additionally, we design an LLM-powered self-training strategy, which uses GPT-4o to generate high-quality extra data by analyzing syntactic and lexical structure from pseudo-labels and retrieved examples, to enhance the generalization ability of the model. Our method outperformed the state-of-the-art baseline methods in extensive experiments, and ablation experiments verified the effectiveness of the proposed segmentation model and self-training strategy.