An LLM Agent-Based Complex Semantic Table Annotation Approach
摘要
The Semantic Table Annotation (STA) task involving Column Type Annotation (CTA) and Cell Entity Annotation (CEA) tasks, maps table contents to ontology entities, playing important roles in various semantic applications. However, complex tables often pose challenges such as semantic loss of column names or cell values, strict ontological hierarchy annotation, homonyms, spelling errors, abbreviations, which hinder the accuracy of annotation. To tackle these issues, this paper proposes an LLM-based agent approach for CTA and CEA tasks. We design and implement five external tools with tailored prompts based on the ReAct framework, enabling the STA agent to dynamically select suitable annotation strategies based on different table characteristics. The experiments are conducted on the Tough Tables and BiodivTab datasets related to the aforementioned challenges from the SemTab challenge, where it outperforms existing methods in various metrics. Furthermore, by using Levenshtein distance to reduce redundant annotations, we achieve a 70% reduction in time costs and a 60% reduction in LLM token usage, providing an efficient, cost-effective solution for STA task.