Few-shot text classification aims to allocate text information into predefined categories using limited labeled samples. Current data augmentation techniques can mitigate the issue of limited labeled data by increasing sample numbers, yet they often overlook variations between samples. In this paper, we introduce leveled learning (LL), a novel technique based on linear interpolation, to alleviate the above problem. Specifically, we evaluate prediction difficulty for all simples, interpolate similar-difficulty samples at the hidden layer, and train them sequentially from easiest to hardest to facilitate the model’s learning across different training stages. Additionally, to increase the diversity of samples, we utilize a pre-trained language model to generate descriptive information for categories, subsequently using this information to generate pseudo samples. We conduct comprehensive experiments on seven commonly employed datasets, demonstrating that our proposed approach notably outperforms various interpolation-based data augmentation methods.

错误:搜索内容不能为空,请输入英文关键词
错误:关键词超出字数限制,请精简
高级检索

Leveled Learning: An Interpolation-Based Data Augmentation Method on Few-Shot Text Classification

  • Yongjun Wang,
  • Fuyong Xu,
  • Bin Wang,
  • Peiyu Liu

摘要

Few-shot text classification aims to allocate text information into predefined categories using limited labeled samples. Current data augmentation techniques can mitigate the issue of limited labeled data by increasing sample numbers, yet they often overlook variations between samples. In this paper, we introduce leveled learning (LL), a novel technique based on linear interpolation, to alleviate the above problem. Specifically, we evaluate prediction difficulty for all simples, interpolate similar-difficulty samples at the hidden layer, and train them sequentially from easiest to hardest to facilitate the model’s learning across different training stages. Additionally, to increase the diversity of samples, we utilize a pre-trained language model to generate descriptive information for categories, subsequently using this information to generate pseudo samples. We conduct comprehensive experiments on seven commonly employed datasets, demonstrating that our proposed approach notably outperforms various interpolation-based data augmentation methods.