The increasing frequency and severity of natural disasters in Brazil, particularly in 2024, highlight the urgent need for innovative solutions in Search and Rescue (SAR) operations. This work presents an approach which integrates Retrieval-Augmented Generation (RAG) techniques with Unmanned Aerial Vehicles (UAVs) to enhance real-time data processing, usability, and operator decision-making. By incorporating advanced technologies such as FrameNet Brasil, Robot Operating System 2 (ROS2), and Large Language Models (LLMs), the system transforms UAV-captured data into actionable insights accessible through natural language interfaces. Testing demonstrates its ability to improve situational awareness, identify critical points of interest, and streamline mission execution. This modular and scalable approach lays the groundwork for future advancements in SAR technologies and their application in disaster-prone regions.

错误:搜索内容不能为空,请输入英文关键词
错误:关键词超出字数限制,请精简
高级检索

Using UAVs and Retrieval Augmented Generation for Situational Awareness in Rescue Operations

  • Matheus B. Jenevain,
  • Milena F. Pinto,
  • Mario A. R. Dantas,
  • Laís R. Berno

摘要

The increasing frequency and severity of natural disasters in Brazil, particularly in 2024, highlight the urgent need for innovative solutions in Search and Rescue (SAR) operations. This work presents an approach which integrates Retrieval-Augmented Generation (RAG) techniques with Unmanned Aerial Vehicles (UAVs) to enhance real-time data processing, usability, and operator decision-making. By incorporating advanced technologies such as FrameNet Brasil, Robot Operating System 2 (ROS2), and Large Language Models (LLMs), the system transforms UAV-captured data into actionable insights accessible through natural language interfaces. Testing demonstrates its ability to improve situational awareness, identify critical points of interest, and streamline mission execution. This modular and scalable approach lays the groundwork for future advancements in SAR technologies and their application in disaster-prone regions.