The quality of online customer assistance plays an essential role in shaping the overall user experience across various industries. As customer bases grow, the volume of queries and usage issues also increases, necessitating efficient and cost-effective solutions to manage these demands. The rise of Large Language Models (LLMs) has made automating chatbot solutions essential for delivering effective services, such as technical assistance, troubleshooting, and personalised recommendations. With the abilities of Retrieval-Augmented Generation (RAG) architectures, applying LLMs to domain-specific tasks requiring specialised knowledge has become increasingly important. In this paper, we experiment with different approaches to develop a multimodal chatbot capable of responding to user queries in various formats, including text, images, tables, and audio, across multiple languages. To address the limitations of LLMs in providing accurate answers related to private knowledge sectors, as well as the constraints of traditional RAG models in retrieving information from general knowledge on the web that is not included in the private knowledge base, to tackle this this study presents a multi-agent approach. The chatbot leverages private domain knowledge bases while maintaining the ability to access web-based resources for out-of-domain queries using a multi-agent paradigm. Our study evaluates the impact of different vector stores, embedding models, and chunking parameters on model performance. To refine our results, the evaluation was conducted in two stages, narrowing the focus to the optimal model parameters that achieved higher accuracy. Performance was assessed using RAGAS and hit image rate evaluation methods, ensuring robust measurement of retrieval accuracy. This study demonstrates the applicability of the proposed approach to diverse datasets across various domains, effectively addressing business-specific queries. To produce a smarter, and more capable customised AI chatbot assistant that enhances the overall user experience.

错误:搜索内容不能为空,请输入英文关键词
错误:关键词超出字数限制,请精简
高级检索

Advanced Development of a Customer Assistance Chatbot Using Multimodal Large Language Models to Enhance User Experience

  • Mona Farrag,
  • Nouh Elmitwally,
  • Faisal Saeed,
  • Haitham Mahmoud,
  • Chaithanya Sai,
  • Artid Boonrerng

摘要

The quality of online customer assistance plays an essential role in shaping the overall user experience across various industries. As customer bases grow, the volume of queries and usage issues also increases, necessitating efficient and cost-effective solutions to manage these demands. The rise of Large Language Models (LLMs) has made automating chatbot solutions essential for delivering effective services, such as technical assistance, troubleshooting, and personalised recommendations. With the abilities of Retrieval-Augmented Generation (RAG) architectures, applying LLMs to domain-specific tasks requiring specialised knowledge has become increasingly important. In this paper, we experiment with different approaches to develop a multimodal chatbot capable of responding to user queries in various formats, including text, images, tables, and audio, across multiple languages. To address the limitations of LLMs in providing accurate answers related to private knowledge sectors, as well as the constraints of traditional RAG models in retrieving information from general knowledge on the web that is not included in the private knowledge base, to tackle this this study presents a multi-agent approach. The chatbot leverages private domain knowledge bases while maintaining the ability to access web-based resources for out-of-domain queries using a multi-agent paradigm. Our study evaluates the impact of different vector stores, embedding models, and chunking parameters on model performance. To refine our results, the evaluation was conducted in two stages, narrowing the focus to the optimal model parameters that achieved higher accuracy. Performance was assessed using RAGAS and hit image rate evaluation methods, ensuring robust measurement of retrieval accuracy. This study demonstrates the applicability of the proposed approach to diverse datasets across various domains, effectively addressing business-specific queries. To produce a smarter, and more capable customised AI chatbot assistant that enhances the overall user experience.