The rapid growth of textual data in the digital age has necessitated the development of efficient Text Summarization systems to distill critical information from extensive documents. This study presents a metric-driven comprehensive comparative analysis of three state-of-the-art Large Language Models (LLMs) for Text Summarization: ChatGPT-4o, Gemini 1.5 Pro, and Cohere Command. By adopting sophisticated evaluation measures like ROUGE, BERTScore, METEOR, and Cosine Similarity, the effectiveness of these algorithms in producing precise and cohesive summaries is evaluated. The findings show that ChatGPT-4o continuously performs better than its counterparts in terms of semantic similarity and structural coherence, even if all three models have noteworthy capabilities. The study highlights how LLMs can improve text summarization tasks and offers important insights into their strengths and limitations.

错误:搜索内容不能为空,请输入英文关键词
错误:关键词超出字数限制,请精简
高级检索

A Metric-Driven Comparative Study of Text Summarization Models: Insights from State-of-the-Art LLMs

  • Shivang Gaur,
  • Aman Karunik,
  • Swapnali Naik

摘要

The rapid growth of textual data in the digital age has necessitated the development of efficient Text Summarization systems to distill critical information from extensive documents. This study presents a metric-driven comprehensive comparative analysis of three state-of-the-art Large Language Models (LLMs) for Text Summarization: ChatGPT-4o, Gemini 1.5 Pro, and Cohere Command. By adopting sophisticated evaluation measures like ROUGE, BERTScore, METEOR, and Cosine Similarity, the effectiveness of these algorithms in producing precise and cohesive summaries is evaluated. The findings show that ChatGPT-4o continuously performs better than its counterparts in terms of semantic similarity and structural coherence, even if all three models have noteworthy capabilities. The study highlights how LLMs can improve text summarization tasks and offers important insights into their strengths and limitations.