<p>Event semantic analysis is a crucial area of research in natural language processing. It focuses on deeply understanding the semantics of events and their components. While existing semantic frameworks and event semantic labelling cover a wealth of semantic information, further research is needed to explore the fine-grained semantic relationships across participants in different events. To address this problem, we construct a head–tail event semantic constraint predicate framework that relates the complex semantics between different event components. However, considering the large-scale data, an automated method for generating constraint predicates is essential. Therefore, we combine parameter-efficient fine-tuning (PEFT) of large language models (LLMs) with retrieval-augmented generation (RAG) technologies. Specifically, this paper makes four significant contributions. Firstly, we construct a detailed framework of head–tail events semantic constraint predicates by combining manual definitions with the GPT-4o model. The framework includes 117 types of constraint predicates between head–tail events. Secondly, based on this framework, we annotate a dataset of head–tail events semantic constraint predicates and apply it to PEFT LLMs. Thirdly, we use PEFT LLMs prediction error data to construct an event knowledge base covering event entities, semantic roles, and entity types. Fourth, using the event knowledge base, the PEFT LLMs integrate the dual RAG techniques of keywords and vectors to improve the accuracy of generating the constraint predicates. Experimental results show that the method outperforms the baselines, achieving a precision of 97.18% and recall of 97.39%. This research fills the gap in semantic relationships between components across events and provides a novel approach for complex semantic generation tasks.</p>

错误:搜索内容不能为空,请输入英文关键词
错误:关键词超出字数限制,请精简
高级检索

A framework for Chinese event semantic constraint predicates and their generation using PEFT LLM and RAG

  • Qiaojuan Huang,
  • Shi Wang,
  • Qing He,
  • Cungen Cao

摘要

Event semantic analysis is a crucial area of research in natural language processing. It focuses on deeply understanding the semantics of events and their components. While existing semantic frameworks and event semantic labelling cover a wealth of semantic information, further research is needed to explore the fine-grained semantic relationships across participants in different events. To address this problem, we construct a head–tail event semantic constraint predicate framework that relates the complex semantics between different event components. However, considering the large-scale data, an automated method for generating constraint predicates is essential. Therefore, we combine parameter-efficient fine-tuning (PEFT) of large language models (LLMs) with retrieval-augmented generation (RAG) technologies. Specifically, this paper makes four significant contributions. Firstly, we construct a detailed framework of head–tail events semantic constraint predicates by combining manual definitions with the GPT-4o model. The framework includes 117 types of constraint predicates between head–tail events. Secondly, based on this framework, we annotate a dataset of head–tail events semantic constraint predicates and apply it to PEFT LLMs. Thirdly, we use PEFT LLMs prediction error data to construct an event knowledge base covering event entities, semantic roles, and entity types. Fourth, using the event knowledge base, the PEFT LLMs integrate the dual RAG techniques of keywords and vectors to improve the accuracy of generating the constraint predicates. Experimental results show that the method outperforms the baselines, achieving a precision of 97.18% and recall of 97.39%. This research fills the gap in semantic relationships between components across events and provides a novel approach for complex semantic generation tasks.