Standardization and knowledge integration pose significant challenges in domain-specific learning, especially for low-resource languages and specialized tasks. For International Classification of Diseases (ICD) code assignment, while datasets such as MIMIC offer abundant resources for English-language research, similar resources are scarce in non-English clinical settings. This paper presents CLSurCoder, a cross-lingual transfer learning approach that facilitates knowledge transfer across languages by selecting, transforming, and translating publicly available English datasets. This method significantly enhances the automatic coding capabilities of general-purpose large language models (LLMs) for Chinese Surgical Operation Records (CSOR). To validate our approach, we compiled CSOR-ICD, a dataset comprising de-identified records from six clinical departments, each annotated with expert-validated ICD codes. Experimental results show that CLSurCoder effectively improves model performance for ICD coding in low-resource language environments through transfer learning. This demonstrates a promising solution for addressing the challenges faced in multilingual medical natural language processing. We will make CSOR-ICD publicly available at http://icrc.hitsz.edu.cn/xszy/yjzy.htm .

错误:搜索内容不能为空,请输入英文关键词
错误:关键词超出字数限制,请精简
高级检索

CLSurCoder: LLMs Based Cross-Lingual Transfer Learning for Low-Resource Language Surgical Records Coding

  • Dawen Chu,
  • Pengyu Ren,
  • Fen Yang,
  • Bingchen Zhong,
  • Lu Zhang,
  • Xiangping Wu,
  • Shuoran Jiang,
  • Jianlin Li,
  • Qingcai Chen

摘要

Standardization and knowledge integration pose significant challenges in domain-specific learning, especially for low-resource languages and specialized tasks. For International Classification of Diseases (ICD) code assignment, while datasets such as MIMIC offer abundant resources for English-language research, similar resources are scarce in non-English clinical settings. This paper presents CLSurCoder, a cross-lingual transfer learning approach that facilitates knowledge transfer across languages by selecting, transforming, and translating publicly available English datasets. This method significantly enhances the automatic coding capabilities of general-purpose large language models (LLMs) for Chinese Surgical Operation Records (CSOR). To validate our approach, we compiled CSOR-ICD, a dataset comprising de-identified records from six clinical departments, each annotated with expert-validated ICD codes. Experimental results show that CLSurCoder effectively improves model performance for ICD coding in low-resource language environments through transfer learning. This demonstrates a promising solution for addressing the challenges faced in multilingual medical natural language processing. We will make CSOR-ICD publicly available at http://icrc.hitsz.edu.cn/xszy/yjzy.htm .