Assessing Pre-trained Transformer Models for Textual Emotion Sensing in Continuous Space
摘要
The purpose of this study is to predict three emotional states such as Valence, Arousal, and Dominance, based on the use of powerful language models built on transformer architecture, which have demonstrated impressive performance in several machine learning tasks such as Text Emotion Recognition (TER). To evaluate the effectiveness of these models in predicting emotional state from text, we will explore various pre-trained models such as BERT, DistilBERT, AlBERTv2, RoBERTa, and GPT2. These models are developed and applied using the IEMOCAP database. To determine the most suitable metric for evaluating Valence, Arousal, and Dominance from text, extensive experiments were conducted to compare model performance across MAE, MSE and CCC. The CCC score is the most efficient according to the results obtained in our work. Our finding advances the domain of Text emotion recognition by demonstrating the superior performance of BERT over other pre-trained transformer models in predicting continuous emotional dimensions using linguistic features and textual data.