Semantic Search and Filtering with AI Agents
摘要
The rapid advancement of pre-trained large language models (LLMs) has enabled the creation of innovative applications, especially in natural language processing. This work employs LLMs alongside our in-house technologies to develop an intuitive database search engine that processes natural language queries. The system uses a network of AI agents, including prompted LLMs and single-purpose neural classifiers, to categorize user queries into conditions for filtering individual data sources or direct matches to database entries. Enhanced with a Retrieval-Augmented Generation (RAG) approach, the application allows users to search large databases conversationally through a voice-enabled web-based interface. Currently, in the demo stage, this project shows full pipeline functionality and has been tested with approximately 150 h of transcribed speech data. Initial findings confirm the overall concept of the application.