Web Scraping and Data Mining
摘要
This chapter explores modern data science approaches, with a focus on web scraping and data mining. It covers fundamental topics, including the definitions and brief history of web scraping and data mining, their working principles, applications, types, and the tools and architectures involved. The advantages and limitations of these techniques, their integration, and future challenges in the field are also discussed. The second part of the chapter provides hands-on practice using COVID-19 pandemic data from Japan, involving data preprocessing tasks such as renaming headers, deleting rows, updating values, converting data to numeric format, and creating bar plots. Furthermore, spatial data on Japan's administrative boundaries is integrated with the cleaned COVID-19 data to produce visualizations.