Ensuring the veracity of assertions is vital for building reliable and consistent knowledge graphs. A variety of automatic fact-checking approaches have been proposed over the past decade. Among these, path-based fact-checking approaches are particularly attractive due to their independence of supplementary external knowledge and their faster runtimes compared to methods reliant on external corpora or embeddings. However, the effectiveness of these approaches is fundamentally limited by the incompleteness of existing knowledge graphs, which often lack the paths necessary to support or refute assertions. To address this limitation, we propose ShallKnow, a framework that supplements the knowledge graph with shallow knowledge—automatically extracted RDF assertions from external unstructured sources—even if this additional knowledge may not always fit a well-defined ontology nor be fully verified. By appending such shallow knowledge, we enhance the graph’s coverage and increase the chances of finding relevant evidence for fact-checking. Comprehensive experiments on three widely used benchmark datasets demonstrate that integrating ShallKnow consistently and significantly enhances the performance of state-of-the-art path-based fact-checking approaches, yielding improvements of up to 0.24 in Area Under the Receiver Operating Characteristic Curve (AUROC). These results establish ShallKnow as a broadly applicable auxiliary component for improving the reliability and coverage of automatic fact-checking in knowledge graphs. Our code is open-source and can be found at https://github.com/dice-group/ShallKnow .

错误:搜索内容不能为空,请输入英文关键词
错误:关键词超出字数限制,请精简
高级检索

No Need to Be a Know-It-All: Fact Checking with Shallow Knowledge

  • Umair Qudus,
  • Neha Pokharel,
  • Michael Röder,
  • Axel-Cyrille Ngonga Ngomo

摘要

Ensuring the veracity of assertions is vital for building reliable and consistent knowledge graphs. A variety of automatic fact-checking approaches have been proposed over the past decade. Among these, path-based fact-checking approaches are particularly attractive due to their independence of supplementary external knowledge and their faster runtimes compared to methods reliant on external corpora or embeddings. However, the effectiveness of these approaches is fundamentally limited by the incompleteness of existing knowledge graphs, which often lack the paths necessary to support or refute assertions. To address this limitation, we propose ShallKnow, a framework that supplements the knowledge graph with shallow knowledge—automatically extracted RDF assertions from external unstructured sources—even if this additional knowledge may not always fit a well-defined ontology nor be fully verified. By appending such shallow knowledge, we enhance the graph’s coverage and increase the chances of finding relevant evidence for fact-checking. Comprehensive experiments on three widely used benchmark datasets demonstrate that integrating ShallKnow consistently and significantly enhances the performance of state-of-the-art path-based fact-checking approaches, yielding improvements of up to 0.24 in Area Under the Receiver Operating Characteristic Curve (AUROC). These results establish ShallKnow as a broadly applicable auxiliary component for improving the reliability and coverage of automatic fact-checking in knowledge graphs. Our code is open-source and can be found at https://github.com/dice-group/ShallKnow .