LLM-Based Automating Product Information Retrieval for Industry Analysis: A Real-World Application
摘要
In the rapidly evolving digital landscape, effective retrieval of product information from enterprise websites is crucial for enterprise research, industry analysis, and strategic planning, which rely on accurate and comprehensive data. In this context, a “product" is defined as any tangible item, a solution, or a service. This paper proposes a novel method for extracting such product data-such as product name, category, description, and specifications-directly from company websites. Our approach leverages the capabilities of Large Language Models (LLMs) to enhance the accuracy and automation of the web-page information retrieval process. The adoption of LLMs allows for a more sophisticated extraction and organization of data, overcoming the limitations of conventional methods. Currently, there is a notable absence of open-source or commercial databases that comprehensively cover enterprise products, making it challenging to conduct comparative studies. Our proposed method aims to fill this gap, providing a tool for gathering product information that can be used to assess competitive differences.