Controllable story generation has been a hot topic in the field of natural language processing in recent years. Current research can effectively integrate text features and event features through the cross-attention mechanism. However, it lacks the efficient application of commonsense knowledge and still adopts the method of post-training on public commonsense knowledge corpora. Although this can improve the performance of the model to a certain extent, there is still much room for improvement in terms of adaptability. To solve this problem, a controllable story generation model with Adaptive Knowledge Enhancement (AKE) is proposed. The commonsense knowledge construction module in it can adaptively construct a matching commonsense knowledge corpus according to the training dataset during fine-tuning to ensure that more relevant additional information is provided for the model. In addition, a multi-task learning component trained with an auxiliary function is added to the model to ensure that it can learn more discriminative feature representations, thereby improving the generalization ability of the model. The experimental results show that AKE significantly outperforms other baseline models in both automatic evaluation indicators and manual evaluation indicators, verifying the superiority of this model in utilizing commonsense knowledge.

错误:搜索内容不能为空,请输入英文关键词
错误:关键词超出字数限制,请精简
高级检索

A Controllable Story Generation Model with Adaptive Knowledge Enhancement

  • Yunxuan Liu,
  • Jiahao Xu,
  • Beier Wang,
  • Chang Liu,
  • Fandi Meng

摘要

Controllable story generation has been a hot topic in the field of natural language processing in recent years. Current research can effectively integrate text features and event features through the cross-attention mechanism. However, it lacks the efficient application of commonsense knowledge and still adopts the method of post-training on public commonsense knowledge corpora. Although this can improve the performance of the model to a certain extent, there is still much room for improvement in terms of adaptability. To solve this problem, a controllable story generation model with Adaptive Knowledge Enhancement (AKE) is proposed. The commonsense knowledge construction module in it can adaptively construct a matching commonsense knowledge corpus according to the training dataset during fine-tuning to ensure that more relevant additional information is provided for the model. In addition, a multi-task learning component trained with an auxiliary function is added to the model to ensure that it can learn more discriminative feature representations, thereby improving the generalization ability of the model. The experimental results show that AKE significantly outperforms other baseline models in both automatic evaluation indicators and manual evaluation indicators, verifying the superiority of this model in utilizing commonsense knowledge.