Queries Optimised LLM-Empowered Active Learning for Social Media Analysis of Human Behaviour in Bushfire Evacuations
摘要
This research addresses the critical gap in bushfire evacuation studies: the lack of empirical data on human behavior during evacuations. Social media platforms offer a rich source of data, but effectively mining and analyzing this data presents significant challenges due to its unstructured nature, noise, ambiguity and large volume. To overcome these challenges, we propose Queries-Optimized LLM-Empowered Active Learning (QOLEAL), a novel data mining approach that leverages a large language model (LLM) and active learning techniques. QOLEAL accurately filters and refines social media posts, identifying relevant information about evacuation decisions, destinations, and locations. The LLM’s efficiency is significantly improved through batched-operation optimization. QOLEAL demonstrates superior accuracy compared to existing approaches, achieving high precision and F1 scores while maintaining comparable recall. The method’s effectiveness is validated through experiments on three real-world datasets. Furthermore, ablation tests highlight the positive impact of batch size optimization on runtime efficiency.