Named Entity Recognition is the basis for many Natural Language Processing technology applications. The traditional sequence labeling-based approach fails to recognize nested entities due to its decoding method of continuous label prediction. Currently, scholars have proposed a span-based named entity recognition method, which extracts bidirectional semantics through character embedding combined with BiLSTM (Bi-directional Long Short-Term Memory) networks and predicts entity boundaries, which realizes the work of recognizing multiple types of entities. However, this character-level approach is limited by the Chinese word-segmentation problem and the BiLSTM network cannot be parallelized. To address the above problems, a Chinese Named Entity Recognition model based on bidirectional self-attention and span is proposed. The model uses a positional embedding-optimized Transformer to construct a bidirectional semantic extraction structure and combines the bidirectional self-attention mechanism to fuse character embedding and external lexicon information to solve the word segmentation problem. Finally, the convolutional module and biaffine module are used for joint decoding. The proposed model experiments on ordinary entity datasets Weibo, Resume, and nested entity dataset Cnerta with F1 values of 73.57, 96.56, and 85.41%.

错误:搜索内容不能为空,请输入英文关键词
错误:关键词超出字数限制,请精简
高级检索

Research on Chinese Named Entity Recognition Based on Bidirectional Self-attention and Span

  • Zimao Li,
  • Hai Jiang,
  • Fan Yin,
  • Ke Xu,
  • Mengmeng Jia,
  • Disheng Jin

摘要

Named Entity Recognition is the basis for many Natural Language Processing technology applications. The traditional sequence labeling-based approach fails to recognize nested entities due to its decoding method of continuous label prediction. Currently, scholars have proposed a span-based named entity recognition method, which extracts bidirectional semantics through character embedding combined with BiLSTM (Bi-directional Long Short-Term Memory) networks and predicts entity boundaries, which realizes the work of recognizing multiple types of entities. However, this character-level approach is limited by the Chinese word-segmentation problem and the BiLSTM network cannot be parallelized. To address the above problems, a Chinese Named Entity Recognition model based on bidirectional self-attention and span is proposed. The model uses a positional embedding-optimized Transformer to construct a bidirectional semantic extraction structure and combines the bidirectional self-attention mechanism to fuse character embedding and external lexicon information to solve the word segmentation problem. Finally, the convolutional module and biaffine module are used for joint decoding. The proposed model experiments on ordinary entity datasets Weibo, Resume, and nested entity dataset Cnerta with F1 values of 73.57, 96.56, and 85.41%.