The Transformer model continues to serve as the standard encoder-decoder architecture in neural machine translation (NMT). It effectively captures the essential features of sentences in the source language through its encoder. However, this representation often encodes source language information in a general manner, over-looking crucial details within the sentence. Therefore, this method may hinder the model from accurately understanding the deep semantics of the source language, ultimately impact the translation quality and may lead to mistranslation. To tackle this issue, this paper presents a novel model for integrating sentence trunk information, aiming to enhance the representational capacity of source language sentences. Specifically, we employed a sentence trunk extraction algorithm that accurately identifies the trunk information within a sentence. The trunk information contains key elements necessary to determine the meaning of the sentence. Subsequently, we smoothly integrate the extracted sentence trunk information into the encoder of the NMT model, thereby enhancing and refining the source language representation. Experimental findings from numerous translation tasks reveal that our pro-posed sentence trunk fusion NMT model considerably enhances the translation performance of NMT models.

错误:搜索内容不能为空,请输入英文关键词
错误:关键词超出字数限制,请精简
高级检索

Sentence Trunk Fusion for Neural Machine Translation

  • Chuncheng Chi,
  • Hong Yan,
  • Peijun Xie,
  • Fuxue Li

摘要

The Transformer model continues to serve as the standard encoder-decoder architecture in neural machine translation (NMT). It effectively captures the essential features of sentences in the source language through its encoder. However, this representation often encodes source language information in a general manner, over-looking crucial details within the sentence. Therefore, this method may hinder the model from accurately understanding the deep semantics of the source language, ultimately impact the translation quality and may lead to mistranslation. To tackle this issue, this paper presents a novel model for integrating sentence trunk information, aiming to enhance the representational capacity of source language sentences. Specifically, we employed a sentence trunk extraction algorithm that accurately identifies the trunk information within a sentence. The trunk information contains key elements necessary to determine the meaning of the sentence. Subsequently, we smoothly integrate the extracted sentence trunk information into the encoder of the NMT model, thereby enhancing and refining the source language representation. Experimental findings from numerous translation tasks reveal that our pro-posed sentence trunk fusion NMT model considerably enhances the translation performance of NMT models.