Multi-label text classification (MLTC) presents a complex challenge, requiring classifiers to assign multiple labels to each document, resulting in diverse label combinations across a large corpus. While substantial advancements have been made in traditional MLTC tasks, existing studies often overlook the impact of compositional generalization (CG) challenges on model performance. Current models struggle to generalize to novel and complex label combinations, which are typically formed from fundamental labels. This study addresses this limitation by proposing a straightforward and scalable data grouping approach, termed best-fit document (BFD), which optimizes large-scale training documents based on their lengths to enhance the classifier’s capacity to model novel label combinations. A comprehensive evaluation of BFD was conducted across four datasets with specialized data splits. The experimental findings indicate that our method significantly enhances the CG ability of classification models on the evaluated benchmarks.

错误:搜索内容不能为空,请输入英文关键词
错误:关键词超出字数限制,请精简
高级检索

Best-Fit Document: Enhancing Compositional Generalization in Multi-label Text Classification

  • Hengliang Guo,
  • Shengguang Zhu,
  • Haitao Wang,
  • Junjie Chen,
  • Jiaru Li,
  • Ruikai Ma,
  • Gang Wu

摘要

Multi-label text classification (MLTC) presents a complex challenge, requiring classifiers to assign multiple labels to each document, resulting in diverse label combinations across a large corpus. While substantial advancements have been made in traditional MLTC tasks, existing studies often overlook the impact of compositional generalization (CG) challenges on model performance. Current models struggle to generalize to novel and complex label combinations, which are typically formed from fundamental labels. This study addresses this limitation by proposing a straightforward and scalable data grouping approach, termed best-fit document (BFD), which optimizes large-scale training documents based on their lengths to enhance the classifier’s capacity to model novel label combinations. A comprehensive evaluation of BFD was conducted across four datasets with specialized data splits. The experimental findings indicate that our method significantly enhances the CG ability of classification models on the evaluated benchmarks.