This study highlights the critical role of Large Language Model (LLM) in simplifying technical content and integrating visual data for accessible communication. It compares GPT-4 and Llama-3.2-90b-Vision-Preview, focusing on readability, semantic similarity, and multimodal interpretation using robust metrics like Flesch Reading Ease, Gunning Fog Index, and CLIP Score. GPT-4 retains key information and achieves high semantic and textual integration scores, making it more suitable for complex technical scenarios. Furthermore, LLaMA prioritizes readability and simplicity, outperforming in generating accessible captions. Both models show optimal performance with a temperature setting of 0.5, balancing simplicity and meaning preservation. The research underscores LLM potential to democratize technical knowledge across disciplines but notes precision and multimodal integration limitations. Future directions include fine-tuning for domain-specific applications and expanding input modalities to enhance accessibility and efficiency in real-world technical tasks.

错误:搜索内容不能为空,请输入英文关键词
错误:关键词超出字数限制,请精简
高级检索

Comparative Evaluation of Multimodal Large Language Models for Technical Content Simplification and Visual Interpretation

  • Leonardo Pilarski,
  • Luiz E. Luiz,
  • Gonçalo S. Gomes,
  • Tiago Pinto,
  • Vitor M. Filipe,
  • Gonçalo Rijo,
  • João Barroso

摘要

This study highlights the critical role of Large Language Model (LLM) in simplifying technical content and integrating visual data for accessible communication. It compares GPT-4 and Llama-3.2-90b-Vision-Preview, focusing on readability, semantic similarity, and multimodal interpretation using robust metrics like Flesch Reading Ease, Gunning Fog Index, and CLIP Score. GPT-4 retains key information and achieves high semantic and textual integration scores, making it more suitable for complex technical scenarios. Furthermore, LLaMA prioritizes readability and simplicity, outperforming in generating accessible captions. Both models show optimal performance with a temperature setting of 0.5, balancing simplicity and meaning preservation. The research underscores LLM potential to democratize technical knowledge across disciplines but notes precision and multimodal integration limitations. Future directions include fine-tuning for domain-specific applications and expanding input modalities to enhance accessibility and efficiency in real-world technical tasks.