The evolving landscape of web and social media archiving: a comprehensive review of current practices in national libraries and archives
摘要
The dynamic and ephemeral nature of online content underscores the critical role of web and social media archiving in preserving digital cultural heritage and supporting research. This study presents a comprehensive review of the current state of national and institutional web and social media archiving practices. Building upon earlier findings, it examines recent developments across national libraries and archival institutions. It highlights the shift from exploratory approaches taken by these institutions to more systematic strategies for capturing content from platforms such as YouTube, Facebook, or Instagram while noting the decline in the archiving of X due to restrictive API policies. Challenges include legal and ethical constraints, platform-specific technical hurdles, and the complexities of ensuring accessibility. Methodologies vary, with advanced tools like SolrWayback enhancing full-text and temporal search functionalities and artificial intelligence (AI) emerging as a promising yet nascent solution for metadata generation and content classification. Collaborative efforts among institutions and event-driven initiatives, for example, those triggered by the COVID-19 pandemic, reflect the field's adaptability and commitment to addressing shared challenges. The study emphasises the importance of balancing public access with compliance with legal frameworks. It also identifies areas for improvement, including coping with AI-generated content and enhancing participatory approaches. This review provides a comprehensive overview of evolving archiving practices and calls for further research into scalability, cross-institutional collaboration, and the integration of advanced technologies to preserve and enhance accessibility to archived web and social media content.