Sentiment analysis determines people’s perceptions of various events by employing natural language processing techniques. Advances in machine learning and deep learning have made it possible to determine emotional tendencies more accurately. Nevertheless, RNN cannot capture long-term dependencies in text, LSTM can only unidirectionally extract contextual information in text, and the training of Transformer requires a lot of computational resources. Also in specific domains will be confronted with specific vocabularies, the processing of these vocabularies directly affects the final classification performance. In this paper, we propose a new GloVe-based Mamba model that combines the advantages of GloVe word embeddings and Mamba networks. First, the model adds specific words to Jieba for segmentation in the data preprocessing stage to make the segmentation results more accurate. Second, the model combines GloVe word embeddings to extract textual contextual information and solve the problem of lack of semantic information. In addition, the Mamba network is utilized to selectively process the input information to improve the accuracy and computational efficiency of Chinese text sentiment polarity classification.

错误:搜索内容不能为空,请输入英文关键词
错误:关键词超出字数限制,请精简
高级检索

Mamba Model Based on GloVe Word Embedding for Sentiment Analysis

  • Liepan Yu,
  • Jiawei Zhu,
  • Zhonglun Wei

摘要

Sentiment analysis determines people’s perceptions of various events by employing natural language processing techniques. Advances in machine learning and deep learning have made it possible to determine emotional tendencies more accurately. Nevertheless, RNN cannot capture long-term dependencies in text, LSTM can only unidirectionally extract contextual information in text, and the training of Transformer requires a lot of computational resources. Also in specific domains will be confronted with specific vocabularies, the processing of these vocabularies directly affects the final classification performance. In this paper, we propose a new GloVe-based Mamba model that combines the advantages of GloVe word embeddings and Mamba networks. First, the model adds specific words to Jieba for segmentation in the data preprocessing stage to make the segmentation results more accurate. Second, the model combines GloVe word embeddings to extract textual contextual information and solve the problem of lack of semantic information. In addition, the Mamba network is utilized to selectively process the input information to improve the accuracy and computational efficiency of Chinese text sentiment polarity classification.