LATTE: a joint entity and relation extraction model based on low-rank attention mechanism and residual task-aware bottleneck
摘要
Joint entity and relation extraction aims to simultaneously identify entity boundaries and their semantic relations, providing a reliable foundation for building high-quality knowledge graphs and enhancing downstream reasoning and applications. However, existing methods still suffer from redundant representations, weak interaction modeling between entities and relations, and unstable decision boundaries in complex sentences. To address these issues, we propose LATTE, a novel joint extraction model integrating three key components: a low-rank attention mechanism that compresses irrelevant features while retaining essential semantics; a multi-head relation-aware interaction that aligns relation prototypes to capture overlapping triples; and a residual task-aware bottleneck that performs differentiated compression to stabilize decision boundaries. Experiments on NYT and WebNLG show that LATTE achieves F1 scores of 93.8% and 95.1%, respectively, outperforming mainstream baselines and demonstrating superior robustness and effectiveness for joint extraction tasks.