The exponential growth of research literature across domains has brought along with it difficulties in successfully analyzing big corpora to identify upcoming themes, underlying relations, and evolving trends. This work proposes a new framework that merges Large Language Models (LLMs) with cutting-edge topic modeling and graph analysis to address these challenges. Semantic embeddings are created and optimized with Uniform Manifold Approximation and Projection (UMAP) and Hierarchical Density-Based Spatial Clustering of Applications with Noise (HDBSCAN) for improved topic relevance. After topic assignment, keyword extraction is performed using KeyBERT and further optimized using Maximal Marginal Relevance (MMR). The LLM aggregates representative documents in order to enhance the interpretability of topics, after which they are converted into graph models to reveal centrality features and influence within research themes. This dual strategy offers both scalability and interpretability and outperforms previous strategies in the identification of sophisticated patterns and offering actionable insights. Future research could focus on dynamic topic tracking to uncover temporal trends, highlighting emerging and declining research areas.

错误:搜索内容不能为空,请输入英文关键词
错误:关键词超出字数限制,请精简
高级检索

Reading Between the Lines: LLM-Powered Topic Modelling and Graph-Based Insights from Research Abstracts

  • Mohammed Saqlain,
  • Nishaan Padanthaya,
  • Fiza Haneen,
  • Bhaskarjyoti Das

摘要

The exponential growth of research literature across domains has brought along with it difficulties in successfully analyzing big corpora to identify upcoming themes, underlying relations, and evolving trends. This work proposes a new framework that merges Large Language Models (LLMs) with cutting-edge topic modeling and graph analysis to address these challenges. Semantic embeddings are created and optimized with Uniform Manifold Approximation and Projection (UMAP) and Hierarchical Density-Based Spatial Clustering of Applications with Noise (HDBSCAN) for improved topic relevance. After topic assignment, keyword extraction is performed using KeyBERT and further optimized using Maximal Marginal Relevance (MMR). The LLM aggregates representative documents in order to enhance the interpretability of topics, after which they are converted into graph models to reveal centrality features and influence within research themes. This dual strategy offers both scalability and interpretability and outperforms previous strategies in the identification of sophisticated patterns and offering actionable insights. Future research could focus on dynamic topic tracking to uncover temporal trends, highlighting emerging and declining research areas.