In this work, we present a complete pipeline for the detection and three-dimensional reconstruction of archaeological artifacts in underwater environments. Our approach leverages the advantages of Large Multimodal Models (LMMs) that allow for integrating historical, geographical, and contextual data with captured images, a necessary step in the identification and interpretation of objects of possible archaeological interest, otherwise unattainable through unimodal models. In addition to multimodal integration, our pipeline suggests the use of a 3D visualization method (Gaussian Splatting) that has not yet been applied to underwater archaeology but is, in many respects, a natural candidate to replace photogrammetry techniques, which encounter many problems in underwater environments. To demonstrate the effectiveness of the methodology, we have concretely implemented a version of this pipeline and applied it to the study of the wreck of the SS Main steamship (1892), located in Porto Pim Bay, Faial Island, Azores.

错误:搜索内容不能为空,请输入英文关键词
错误:关键词超出字数限制,请精简
高级检索

Multimodal Pipeline for Underwater Artifact Detection and 3D Reconstruction with VLM and Gaussian Splatting

  • Niccolò Simonato,
  • Daniele Corradetti,
  • José Bettencourt

摘要

In this work, we present a complete pipeline for the detection and three-dimensional reconstruction of archaeological artifacts in underwater environments. Our approach leverages the advantages of Large Multimodal Models (LMMs) that allow for integrating historical, geographical, and contextual data with captured images, a necessary step in the identification and interpretation of objects of possible archaeological interest, otherwise unattainable through unimodal models. In addition to multimodal integration, our pipeline suggests the use of a 3D visualization method (Gaussian Splatting) that has not yet been applied to underwater archaeology but is, in many respects, a natural candidate to replace photogrammetry techniques, which encounter many problems in underwater environments. To demonstrate the effectiveness of the methodology, we have concretely implemented a version of this pipeline and applied it to the study of the wreck of the SS Main steamship (1892), located in Porto Pim Bay, Faial Island, Azores.