<p>Named Entity Recognition (NER) in specialized domains like biomedicine suffers from acute data scarcity, requiring expensive expert annotations. While data augmentation offers a promising solution, it inevitably introduces noisy and mislabeled samples that can degrade model performance. This problem is amplified in few-shot scenarios where every training example matters. We introduce PALAUNER (Policy-based Active Learning to Augment Named Entity Recognition), a reinforcement learning framework that learns to select high-quality samples from augmented data pools. Using a deep Q-network, our agent evaluates samples based on content features and model predictions, deciding which examples will improve NER performance. Experiments across five BioNER benchmarks demonstrate that PALAUNER consistently enhances diverse augmentation methods, from simple perturbations to GPT-based generation. Average F1 improvements are of 0.5−7.1 points in few-shot settings. PALAUNER’s modular design enables seamless integration with emerging augmentation techniques, providing a generalizable solution for training data quality enhancement. We publicly release our code on GitHub: (<a href="https://github.com/picuslab/palauner">https://github.com/picuslab/palauner</a>).</p>

错误:搜索内容不能为空,请输入英文关键词
错误:关键词超出字数限制,请精简
高级检索

Palauner: policy-based active learning to augment named entity recognition datasets

  • Marco Postiglione,
  • Andrea Vignali,
  • Giancarlo Sperlí,
  • Guido Maria Secondulfo,
  • Vincenzo Moscato

摘要

Named Entity Recognition (NER) in specialized domains like biomedicine suffers from acute data scarcity, requiring expensive expert annotations. While data augmentation offers a promising solution, it inevitably introduces noisy and mislabeled samples that can degrade model performance. This problem is amplified in few-shot scenarios where every training example matters. We introduce PALAUNER (Policy-based Active Learning to Augment Named Entity Recognition), a reinforcement learning framework that learns to select high-quality samples from augmented data pools. Using a deep Q-network, our agent evaluates samples based on content features and model predictions, deciding which examples will improve NER performance. Experiments across five BioNER benchmarks demonstrate that PALAUNER consistently enhances diverse augmentation methods, from simple perturbations to GPT-based generation. Average F1 improvements are of 0.5−7.1 points in few-shot settings. PALAUNER’s modular design enables seamless integration with emerging augmentation techniques, providing a generalizable solution for training data quality enhancement. We publicly release our code on GitHub: (https://github.com/picuslab/palauner).