Large Language Models (LLMs) can produce human-like responses across various domains from healthcare to history. Millions of people use those models and chatbots daily, and some use them to get responses in critical domains like healthcare, law, and so on. However, the most concerning problem found in those models is hallucination, where false, misleading, or exaggerated information is produced. Many people use the models without cross-checking the content generated by the models, which can lead to some unforeseen consequences. Guaranteeing the trustworthiness and reliability of AI systems needs to be done with the utmost caution, given the sensitive nature of some domains. In this study, we use one of the most widely used methods in recent months to detect hallucinations: an LLM-based metric. We propose a novel and unique architecture based on recent advances in the LLM field, especially the advances in agentic AI. We call it “LieToMe”, a multi-agent-based system that we believe can detect hallucinations more accurately than existing systems. It includes 3 worker agents: a Retrieval Augmented Generation agent, a Web agent, and a Domain-based agent. In this paper, the focus is on the healthcare domain, although the modularity of the system allows it to adapt to other domains like law, science, and so on. The system computes a Composite Hallucination Score (CHS) that contains weights we can vary depending on the domain. We use some state-of-the-art models to test our hallucination detection system. Good results have been achieved, constituting solid proof of concept of this method.

错误:搜索内容不能为空,请输入英文关键词
错误:关键词超出字数限制,请精简
高级检索

LieToMe: A Multi-Agent System for Detecting Hallucinations in Large Language Models

  • Kokou Elvis Khorem Blitti,
  • Fitsum Getachew Tola,
  • Madhu Shukla,
  • Vipul Ladva,
  • Neel Dholakia

摘要

Large Language Models (LLMs) can produce human-like responses across various domains from healthcare to history. Millions of people use those models and chatbots daily, and some use them to get responses in critical domains like healthcare, law, and so on. However, the most concerning problem found in those models is hallucination, where false, misleading, or exaggerated information is produced. Many people use the models without cross-checking the content generated by the models, which can lead to some unforeseen consequences. Guaranteeing the trustworthiness and reliability of AI systems needs to be done with the utmost caution, given the sensitive nature of some domains. In this study, we use one of the most widely used methods in recent months to detect hallucinations: an LLM-based metric. We propose a novel and unique architecture based on recent advances in the LLM field, especially the advances in agentic AI. We call it “LieToMe”, a multi-agent-based system that we believe can detect hallucinations more accurately than existing systems. It includes 3 worker agents: a Retrieval Augmented Generation agent, a Web agent, and a Domain-based agent. In this paper, the focus is on the healthcare domain, although the modularity of the system allows it to adapt to other domains like law, science, and so on. The system computes a Composite Hallucination Score (CHS) that contains weights we can vary depending on the domain. We use some state-of-the-art models to test our hallucination detection system. Good results have been achieved, constituting solid proof of concept of this method.