Web Scraping for Competitive Intelligence: State of the Art and Case Study
摘要
Data collection is a critical technique that involves extracting, organizing, and storing raw data from various sources, whether manual or automated. This article presents a state-of-the-art review along with a case study on the use of web scraping for competitive intelligence. In this study, we collected and merged data from different sources, performed cross-analyses, and visualized the results in informative dashboards to support decision-making. This information was then leveraged to formulate business recommendations aimed at enhancing the competitiveness of the companies studied. The study demonstrated that integrating web scraping into business strategies can improve market understanding and provide valuable insights to outcompete rivals. Additionally, we discuss the challenges associated with the use of web scraping for economic intelligence, while highlighting the potential contribution of artificial intelligence to enhance these systems.