<p>The rise of Large Language Models (LLMs) has transformed how Natural Language Processing (NLP) and its subdomains are approached.&#xa0;Recent technological advancements have driven this transformation. This study offers researchers a detailed overview of LLMs, comparing them with traditional rule-based systems, statistical techniques, machine learning, neural networks, and the rise of transformer-based architectures.&#xa0;From a wider perspective, language models such as GPT, BERT, T5, PaLM, and LLaMA have facilitated the transformation of entire sectors, including healthcare and business, due to their highly scalable nature. Despite their wide range of applications, LLMs face numerous challenges, such as output biases, limited interpretability, high computational requirements, low granularity, and, most importantly, limited accessibility. This paper highlights modern adaptive learning processes, domain-specific applications, and multimodal learning, along with critical issues such as fairness, ethical deployment, and sustainability. There is a growing need for more effective regulation, the development of multilingual capabilities, and, above all, the creation of general-purpose AI systems to enhance inclusion. This research emphasizes ethical accountability by examining the social implications of advanced AI systems.&#xa0;It further promotes interdisciplinary collaboration to develop AI systems that are ethical, effective, and socially responsible within a clearly defined decision-making framework for research and application.</p>

错误:搜索内容不能为空,请输入英文关键词
错误:关键词超出字数限制,请精简
高级检索

Large language models in NLP: evolution, architectural trends, and open challenges

  • Haseeb Javed,
  • Babar Shah,
  • Farman Ali,
  • Daehan Kwak

摘要

The rise of Large Language Models (LLMs) has transformed how Natural Language Processing (NLP) and its subdomains are approached. Recent technological advancements have driven this transformation. This study offers researchers a detailed overview of LLMs, comparing them with traditional rule-based systems, statistical techniques, machine learning, neural networks, and the rise of transformer-based architectures. From a wider perspective, language models such as GPT, BERT, T5, PaLM, and LLaMA have facilitated the transformation of entire sectors, including healthcare and business, due to their highly scalable nature. Despite their wide range of applications, LLMs face numerous challenges, such as output biases, limited interpretability, high computational requirements, low granularity, and, most importantly, limited accessibility. This paper highlights modern adaptive learning processes, domain-specific applications, and multimodal learning, along with critical issues such as fairness, ethical deployment, and sustainability. There is a growing need for more effective regulation, the development of multilingual capabilities, and, above all, the creation of general-purpose AI systems to enhance inclusion. This research emphasizes ethical accountability by examining the social implications of advanced AI systems. It further promotes interdisciplinary collaboration to develop AI systems that are ethical, effective, and socially responsible within a clearly defined decision-making framework for research and application.